Portkey AI Gateway
We have open sourced our battle-tested AI Gateway to the community - it connects to 250+ LLMs with a unified interface and a single endpoint, and lets you effortlessly setup fallbacks, load balancing, retries, and more. This gateway is in production at Portkey processing billions of tokens every day.Contribute here.
Portkey Models
Open-source pricing database for 2,300+ LLMs across 35+ providers. Powers cost tracking across the Portkey ecosystem.- UI Explorer — Browse and search all models
- Model Rankings — Top models by usage on Portkey
API Documentation
AI Grants Finder
Community resource for AI builders to findGPU credits, grants, AI accelerators, or investments - all in a single place. Continuously updated, and sometimes also featuring exclusive deals.
Access the data here.
Gateway Reports
We collaborate with the community to dive deep into how the LLMs & their inference providers are performing at scale, and publish gateway reports. We track latencies, uptime, cost changes, fluctuations across various modalitites like time-of-day, regions, token-lengths, and more.2025 AI Infrastructure Benchmark Report
- Trends shaping AI adoption and LLM provider growth.
- Benchmarks to optimize speed, cost and reliability.
- Strategies to scale production-grade AI systems.
The report is available here
GPT-4 is getting faster
