The open-source AI gateway with built-in observability, automatic failover, and a one-line integration. Add credits, and get instant access to 100+ models through one API key. OpenAI compatible, zero markup, and trusted by teams like DeepAI, PodPitch, and Sunrun.
We build open-source tools that help AI startups ship faster and break less. Today, we’re launching the Helicone AI Gateway — one API key for every model, with observability and automatic failover built in.
The Why Over 90% of AI products today use five or more LLMs.
Every AI engineer I talk to is struggling with: - Writing custom logic to handle provider outages - Hitting constant 429s and waiting weeks for limit increases - Managing multiple APIs, keys, and auth flows - Paying 5–10% markup fees just to use a gateway - No visibility into routing or performance
The How The Helicone AI Gateway fixes that. It’s open source, transparent, and simple to use.
🔑 1 API key, 100+ models — add credits and get instant access to every major provider 🎯 0% markup fees — you pay exactly what the provider charges 📊 Observability included — logs, latency, costs, and traces built in 🔄 Reliable by design — automatic failover, caching, and routing that avoids provider rate limits entirely ⚙️ Custom rate limits — define your own per-user or per-segment caps right in the gateway 🔓 Fully open source — MIT licensed, self-host or contribute, no lock-in
The What
✅ OpenAI SDK-compatible (change the baseURL, access 100+ models) ✅ Supports all major providers (OpenAI, Anthropic, Gemini, TogetherAI, and more) ✅ Real-time dashboards and analytics ✅ Built-in caching and request deduplication ✅ Automatic failover and retry logic ✅ Custom per-user rate limits ✅ 0% markup fees, pay provider pricing ✅ Fully open source
Traction
Already processing billions of tokens monthly for teams at Sunrun, DeepAI, and PodPitch.
We’ve been building this in the open for six months, shaped by feedback from hundreds of developers.
Hey everyone 👋
I’m Cole, Co-Founder of Helicone.
We build open-source tools that help AI startups ship faster and break less.
Today, we’re launching the Helicone AI Gateway — one API key for every model, with observability and automatic failover built in.
The Why
Over 90% of AI products today use five or more LLMs.
Every AI engineer I talk to is struggling with:
- Writing custom logic to handle provider outages
- Hitting constant 429s and waiting weeks for limit increases
- Managing multiple APIs, keys, and auth flows
- Paying 5–10% markup fees just to use a gateway
- No visibility into routing or performance
The How
The Helicone AI Gateway fixes that. It’s open source, transparent, and simple to use.
🔑 1 API key, 100+ models — add credits and get instant access to every major provider
🎯 0% markup fees — you pay exactly what the provider charges
📊 Observability included — logs, latency, costs, and traces built in
🔄 Reliable by design — automatic failover, caching, and routing that avoids provider rate limits entirely
⚙️ Custom rate limits — define your own per-user or per-segment caps right in the gateway
🔓 Fully open source — MIT licensed, self-host or contribute, no lock-in
The What
✅ OpenAI SDK-compatible (change the baseURL, access 100+ models)
✅ Supports all major providers (OpenAI, Anthropic, Gemini, TogetherAI, and more)
✅ Real-time dashboards and analytics
✅ Built-in caching and request deduplication
✅ Automatic failover and retry logic
✅ Custom per-user rate limits
✅ 0% markup fees, pay provider pricing
✅ Fully open source
Traction
Already processing billions of tokens monthly for teams at Sunrun, DeepAI, and PodPitch.
We’ve been building this in the open for six months, shaped by feedback from hundreds of developers.
Try it now and tell us what you think: https://www.helicone.ai/signup
GitHub: https://github.com/Helicone/heli...
Docs: https://docs.helicone.ai/gateway...
Would love your feedback!