gateway
Fast and reliable AI gateway supporting 1,600+ language models and 50+ AI protection measures.
- Type
- MCP
- Transport
- http
- Open source
- Yes
- GitHub Stars
- ★ 12.2k
- Source
- mcp-github
- Repository
- github.com/Portkey-AI/gateway
Overview
Portkey AI Gateway is a lightweight, open-source, enterprise-grade solution that allows you to integrate any language model in 2 minutes. It features ultra-low latency (<1ms) and a small footprint (122KB), having been extensively tested to handle over 10 billion tokens daily. The gateway provides automatic retry, failover, load balancing, conditional routing, and more, ensuring stable operation of your AI applications. Additionally, it supports multimodal capabilities and proxy workflow integration.
Capabilities
- ▪Integrate 1,600+ language models
- ▪50+ AI protection measures
- ▪Automatic retry and failover
- ▪Load balancing and conditional routing
- ▪Multimodal capabilities
- ▪Proxy workflow integration
Use cases
Setup
npx @portkey-ai/gateway
This information was compiled by AI from public sources and may contain inaccuracies — please refer to the source.
FAQ
How to get started quickly?
Run `npx @portkey-ai/gateway` and follow the prompts.
What deployment methods are supported?
Supports Docker, Node.js, Cloudflare Workers, and more.
Related skills
gemini-cli
Gemini CLI is an open-source AI agent that brings Gemini's powerful capabilities directly into the terminal.
private-gpt
Provides a complete API layer for local models, supporting RAG, skills, tools, and more.
planning-with-files
File-based persistent planning skill, ideal for AI coding agents and long-running tasks.
scientific-agent-skills
Transform any AI agent into a scientific assistant with 147 ready-to-use research skills.
susi_alexa_skill
A skill that enables question-and-answer interactions between Alexa and Susi AI.
claude-context
Provides code search capabilities for Claude Code, turning the entire codebase into context.