LLM Gateway & Routing
Put one layer between your app and the model providers, so you can switch models, fail over and track spend without rewriting calls.
Trends
OpenRouter gained the most ground in package downloads: 5.1× against the median npm package over a year.
Public counts each month: pull requests on GitHub, package downloads, stars, Product Hunt followers. They show direction, not market share.
- Oct 19 · Status Helicone is in maintenance mode. Acquired by Mintlify in March 2026; Helicone says the service stays live in maintenance mode — security fixes, new model support and bug fixes, but no new product direction.
- Oct 19 · Product Hunt Cloudflare got 26 new Product Hunt reviews (now 267).
- Oct 2 · Action needed Cloudflare retires the Radar top browser endpoints and the dimensionless NetFlows summary on April 2, 2027; switch to the summary endpoints that take a {dimension} path parameter.
The real choice
Hosted gateway or self-hosted proxy. A hosted gateway gives you one key and one bill in minutes, but every request passes through someone else's service. A self-hosted proxy keeps your provider keys and traffic on your own servers, and you run and update it.
Pick by situation
Tap the ones that are you — the tools that fit light up below.- You want to try or offer many models with one key and one bill, today
OpenRouter
Vercel AI Gateway - You already deploy on Vercel or use the AI SDK
Vercel AI Gateway - Provider keys and request data must stay on your own servers
LiteLLM - You need guardrails, prompt management and request logs alongside routing
Portkey
Helicone
Compare the tools
Grouped by the side of the choice they answer, not ranked. Open a row for when to use it, the trade-off and what makers say.
OpenRouterapi · free tierTrying many models from many providers with one API key and one bill, without opening an account at each.No evidence yet2.8M/wk5.1× vs npm
Use it whenYou want to compare models quickly or offer users a model picker.
Trade-offA fee on top of provider prices, and your traffic and data pass through a third party.
llms.txtIn ReplitNo maker's product we track shows it for this yet.
Vercel AI Gatewayservice · free tierOne key and one bill for hundreds of models at provider list prices, with fallbacks and budgets, built into the AI SDK.No evidence yet23.3M/wk
LiteLLMlibrary · open source · free tierRunning your own OpenAI-compatible proxy in front of your own provider keys, with retries, routing and per-key budgets.No evidence yet20.9M/wk
Heliconeplatform · open source · free tierAdding a gateway when your main goal is logging and debugging every request, with caching and rate limits on the side.
13.8k/wk
Use it whenSeeing every request, its cost and latency matters more to you than advanced routing.
Trade-offIts focus is observability; routing features are thinner than a dedicated gateway's.
llms.txtUsed by Pretty Prompt.
Helps us debug AI, and have clarity on AI analytics, costs, and latency. We've also been able to save quite a lot of credits because of its caching functionality!
Portkeyplatform · open source · free tierA gateway that also handles guardrails, prompt management and request logs in one dashboard.No evidence yet184.6k/wk+25% vs npm
Before you choose
Write your code against the OpenAI-compatible API shape from the start; every option here speaks it, so switching later is a base-URL change. Set a fallback model and a spend limit before launch, not after the first outage or surprise bill. If you only call one provider, you can skip this layer until you add a second.
- Adding a gateway with no fallback model configured, so it becomes one more thing that can go down rather than the thing that keeps you up.
- Sending user data through a hosted gateway without checking its retention settings and adding it to your list of subprocessors.
- Treating a gateway's per-key budget as optional and only discovering a runaway agent loop on the monthly invoice.
Other options
Real choices most makers here won't need to weigh.