Groups of direct competitors Some rivalsRising
Cost-optimizing LLM routers 9 products
Some rivalsRising
LLM usage and cost monitoring proxies 8 products
Puddl Get Complete Breakdown of OpenAI API Usage for Free Inferock Bench An independent receipt for every LLM API call Inferock An independent receipt for every LLM API call Velvet AI Gateway & Platform Tokenwise A smart LLM proxy that shows where you're overpaying Caveman why use many token when few do trick Some rivalsRising
Self-hosted AI gateways 8 products
Some rivalsRising
Unified multi-model APIs 8 products
Some rivals
Serverless GPU model hosting 7 products
ZeroGPU The compute efficient layer for AI inference Inferless Deploy any machine learning models in minutes Banana.dev Serverless GPUs for Machine Learning Inference Fal.ai Generative media platform for developers novita.ai Simple LLM APIs & GPU instance LunaRoute Private AI capacity. Predictable cost. No token surprises. 18 more products in this market fit no group: one of a kind here, or with too little on their Product Hunt page to tell.
How they're built
What 27 of these LLM gateways and routers run on From the stacks we know of them: what their makers say, their websites, their legal pages.
Far more common here than elsewhere Their picks, building block by building block Markets come from the alternatives Product Hunt lists for each product. Groups are drawn by Claude from a few words on what each product is, so read them as a first cut. Launch counts are of the products we have pages for, which lean recent: compare groups with each other rather than reading them as a census. Product Hunt categories here: AI Infrastructure Tools (44), Unified API (19), LLMs (11). Updated 2026-10-14.