Cerebras Inference API
Very fast inference on a small set of open-weight models, served on Cerebras's own wafer-scale chips through an OpenAI-compatible API.
17 open-source projects declare Cerebras Inference API in their code; no maker's live product we track uses it yet.
Profile checked
- Oct 2026 Now covered: Cerebras Inference API, for llm api.
How makers use Cerebras Inference API
What Cerebras Inference API is used for
Cerebras Inference API vs the alternatives makers chose
| Option | Makers' products | 2026 launches | Free for | At 10,000 users | Open source | |
|---|---|---|---|---|---|---|
| 736 80% | 77% | ~1,000 users | $10/mo · GPT-6 Luna | No | ||
| 252 27% | 21% | ~1,000 users | $10/mo · Claude Haiku 5.5 | No | ||
| 99 11% | 12% | ~360 users | $28/mo · Gemini 3.1 Flash-Lite | No | ||
| 39 4% | 3% | ~1,500 users | $6.75/mo · GPT OSS 20B | No | ||
| 22 2% | 0% | — | — | No | ||
| 15 2% | 1% | ~1,700 users | $6.00/mo · Ministral 3 (3B) | No | ||
| Cerebras Inference API | 0 0% | 0% | ~400 users | — | Unknown |
For LLM API: how many of the 923 makers' products we know the LLM API of chose each option, and the share among the 256 launched in 2026, since a tool that came first has products from every year, and what each costs at 10,000 users.
Costs are the cheapest plan that fits, from each vendor's pricing page, at the usage our stack planner assumes for a product with that many users. Free for: the users its cheapest plan a business can use stays free for.
When to use Cerebras Inference API, and when not
Something else fits better if
- You want the strongest general models and the widest ecosystem of examples and integrations: OpenAI API or Claude or Gemini API.
- Token cost dominates your budget, for example high-volume batch or agent workloads: DeepSeek or Groq or Mistral AI.
- You want to try or mix many models with one key and one bill, and fall back when a provider is down: OpenRouter.
- You want that routing and spend control but self-hosted, with keys and logs on your servers: LiteLLM.
- The open model you need is already served by a host and you want to pay per token: Together AI or Fireworks AI or Hugging Face.
Cerebras is a US chipmaker whose wafer-scale processors it also runs as a cloud. The Inference API serves open-weight models from other labs at very high output speeds — Cerebras lists around 3,000 tokens per second for OpenAI's gpt-oss-120b and around 1,850 for Qwen 3.8 27B, the two models on its self-serve shared tier. Many more model families, and fine-tuned weights, are available on Dedicated Inference by contract.
More about Cerebras Inference API
You call it with Cerebras's own SDKs (cerebras_cloud_sdk for Python, @cerebras/cerebras_cloud_sdk for Node) or with the OpenAI SDK by setting the base URL to https://api.cerebras.ai/v1; the Vercel AI SDK has a Cerebras provider as well. Pay-as-you-go usage is bought as prepaid credits, with optional auto-recharge.
Useful for a small team: speed, for features where users wait on long outputs or agents chain many calls; a Free Trial with $5 of credit for 30 days after you add a payment method; and once you buy credits, no hourly or daily token caps. Prompt caching is automatic, and cached tokens don't count toward the main uncached-token rate limit, so a high cache hit rate raises effective throughput. Shared models are served unpruned, and Cerebras commits not to change a model ID's architecture without notice.
The main limits: only two models on the self-serve tier, and anything else means talking to sales. Context is capped at 131k tokens on paid plans (about half that on the trial), cached input is billed at the full input rate, and the trial is meant for evaluation, not production.
What Hacker News says about Cerebras Inference API
On Hacker News, 24% of comments about Cerebras Inference API recommend it and 7% criticize it: net praise +17%, 8th best liked of 12 tools HN discusses for LLM API.
By year
| Year | Comments choosing it, per month | Net praise |
|---|---|---|
| 2023 | 0.0 | 0% |
| 2024 | 0.1 | 0% |
| 2025 | 2.5 | +16% |
| 2026 (8 mo) | 2.9 | +25% |
In their words
- “I use them heavily in production because OSS 120B on Groq/Cerebras is one of the fastest models available” HN, Mar 2026
- “Worked great and was so stupidly fast it made me realize” HN, May 2026
- “I used Qwen3-480B-Coder with Cerebras and it was not very good for my use case.” HN, Oct 2025
Hacker News comments January 2023 to August 2026 that name Cerebras Inference API in a sentence like "I use" or "we moved to", Claude read a sample of 68 and the counts scale it to all of them; net praise is comments recommending it minus comments criticizing it, as a share of all comments about it. How it's counted, and how HN compares with makers.
Reliability and open issues
Cerebras Inference API's status page posted 3 incidents in the last 90 days, 1 major.
Incidents on its status page
3 in the last 90 days, 1 major · 29 in the last year- major Partial Service Disruption Sep 2026
- minor Resolved Aug 2026
- minor Partial Service Disruption Jul 2026
Who uses it
No maker's live product on record yet, and 17 open-source projects that declare it in their code.
We haven't found a maker's live product that uses Cerebras Inference API yet — only the open-source projects below, which declare it in their code.
None of these in makers' own words.
Open source: a project that declares Cerebras Inference API as a dependency in its public code — verifiable, but not necessarily a live product.
Alternatives to Cerebras Inference API
All alternatives by situation →Further reading
Questions makers ask about Cerebras Inference API
What are the alternatives to Cerebras Inference API?
For LLM API, the other options makers' products we track chose most are OpenAI API (736), Claude (252), Gemini API (99), Groq (39), Azure OpenAI (22), Mistral AI (15). Each alternative, with the situation it fits, is on the Cerebras Inference API alternatives page.
Can I use the OpenAI SDK?
Yes. Set the base URL to https://api.cerebras.ai/v1 and use a Cerebras API key. A few OpenAI features differ — for example, images must be sent as base64 data URIs rather than external URLs. source ↗
Is there a free tier?
There is a Free Trial, not a permanent free tier. New accounts get $5 of credits after adding a verified payment method; they expire after 30 days, and API access pauses when they run out until you buy credits. source ↗
Which models can I use without a contract?
The shared tier currently serves gpt-oss-120b and Qwen 3.8 27B, on both the Free Trial and pay-as-you-go. Other families — more Qwen, GPT-OSS, MiniMax and Gemma variants, and your own fine-tuned weights — run on Dedicated Inference. source ↗
What are the rate limits?
Limits apply per organization and per model, counted in requests and tokens per minute, with separate caps on uncached and total tokens. On pay-as-you-go, gpt-oss-120b allows 1,000 requests and 1M uncached tokens per minute, with no hourly or daily caps; the Free Trial is far lower, at 5 requests per minute and 1M tokens per day. source ↗
Does prompt caching lower the price?
No. Caching is automatic and reduces latency, but cached input tokens are billed at the normal input rate. Cached tokens don't count toward your uncached-token limit, and cache entries last at least 5 minutes. source ↗
Are the models compressed to make them faster?
Shared models are the original, unpruned versions. Cerebras stores some weights in lower precision and dequantizes them on the fly, while activations, attention and the KV cache stay at full precision. source ↗
Can I buy it through another platform?
Yes. Cerebras inference is also offered through AWS Marketplace, OpenRouter, Hugging Face and Vercel. source ↗
Is Cerebras Inference API free?
No permanent free tier; paid use starts at Pay per token. source ↗
Can AI coding agents work with Cerebras Inference API?
No llms.txt, official MCP server or CLI found yet.
Who uses Cerebras Inference API?
No maker's live product we track yet; 17 open-source projects declare it in their code. source ↗