
vLLM
Open-source inference engine that serves open-weight models on GPUs behind an OpenAI-compatible API, with high throughput under concurrent load.
43 open-source projects declare vLLM in their code; no maker's live product we track uses it yet.
Profile checked
How makers use vLLM
What vLLM is used for
vLLM vs the alternatives makers chose
| Option | Makers' products | 2026 launches | Open source | |
|---|---|---|---|---|
| 77 42% | 52% | No | ||
| 60 32% | 48% | No | ||
| 23 12% | 2% | No | ||
| 19 10% | 2% | No | ||
| 12 6% | 0% | No | ||
| 5 3% | 2% | No | ||
| 0 0% | 0% | Yes |
For open model hosting & GPUs: how many of the 185 makers' products we know the open model hosting & GPUs of chose each option, and the share among the 48 launched in 2026, since a tool that came first has products from every year.
When to use vLLM, and when not
Pick vLLM if
- You run the GPUs yourself and need an OpenAI-compatible server for many concurrent users. Open Model Hosting & GPUs →
Something else fits better if
- The open model you need is already served by a host and you want to pay per token: Together AI or Fireworks AI or Hugging Face.
- Your workload is your own Python code — a pipeline, batch job or custom model — that should scale to zero: Modal.
- You want a raw GPU machine for experiments, training or a long-running server: Runpod.
- One model is core to the product and needs steady latency under real traffic: Baseten or Hugging Face.
How vLLM itself is built
2 tools, from its own code, website and Product Hunt page.
Who uses it
No maker's live product on record yet, and 43 open-source projects that declare it in their code.
We haven't found a maker's live product that uses vLLM yet — only the open-source projects below, which declare it in their code.
None of these in makers' own words.
Open source: a project that declares vLLM as a dependency in its public code — verifiable, but not necessarily a live product.
What its projects tell coding agents
10 of the 26 open-source products built with vLLM that were worked on in the last 180 days keep instruction files for coding agents — 38%, against 53% of all the projects we read. AGENTS.md is in 10, CLAUDE.md in 6.
Alternatives to vLLM
All alternatives by situation →Questions makers ask about vLLM
What are the alternatives to vLLM?
For open model hosting & GPUs, the other options makers' products we track chose most are Hugging Face (77), Modal (60), Baseten (23), Runpod (19), Together AI (12), Fireworks AI (5). Open source or self-hostable among them: Baseten. Each alternative, with the situation it fits, is on the vLLM alternatives page.
When should you use vLLM?
You run the GPUs yourself and need an OpenAI-compatible server for many concurrent users (open model hosting & GPUs). Something else fits better if: the open model you need is already served by a host and you want to pay per token, pick Together AI or Fireworks AI or Hugging Face; your workload is your own Python code — a pipeline, batch job or custom model — that should scale to zero, pick Modal.
Is vLLM open source or self-hostable?
Open source, and you can self-host it. source ↗
Can AI coding agents work with vLLM?
No llms.txt, official MCP server or CLI found yet.
Who uses vLLM?
No maker's live product we track yet; 43 open-source projects declare it in their code. source ↗