Updated

Groq

Very fast inference for open models on custom LPU hardware.

39 makers' products we track use Groq. For LLM API it's 4th most chosen of 12 options: 39 of the 923 makers' products we know the LLM API of (4%). Among the 256 launched in 2026, 3% chose it, against 3% of those launched in 2024 or earlier. 76 open-source projects also declare it in their code. What makers like most: Inference is extremely fast, enabling real-time voice and agent workflows. On GitHub, 231 public pull requests moved projects to Groq from tools we list, and 109 moved them away.

Free tierPaid from Pay per token

Profile checked

Ask your AI about this, with this page as the source:ChatGPT ↗Claude ↗Perplexity ↗

How makers use Groq

Makers' products we track use Groq for LLM API (39), most often alongside Next.js (51%), Vercel (49%), Resend (33%).

What Groq is used for

LLM API · Open models, hosted →Very low-latency inference on open models, for real-time features.Trade-off: Only the open models it chooses to host, and no frontier closed models.
OpenAI API736Claude252Gemini API99Groq39Azure OpenAI22Makers' products on each, for LLM API
Open Model Hosting & GPUs · Serverless model API →Very fast inference for popular open models on Groq's LPU hardware, with a rate-limited free tier.Trade-off: Limited to the models Groq hosts, and the free tier is rate-limited.
Hugging Face77Modal60Baseten23Runpod19Together AI12Groq0Makers' products on each, for open model hosting & GPUs

Groq vs the alternatives makers chose

For LLM API, 39 of the 923 makers' products we know the choice of picked Groq (4%), behind OpenAI API (80%). Among those launched in 2026 it's 3%.

OptionMakers' products2026 launchesFree forAt 10,000 usersOpen source
OpenAI API736 80%77%~1,000 users$10/mo · GPT-6 LunaNoCompare →
Claude252 27%21%~1,000 users$10/mo · Claude Haiku 5.5NoCompare →
Gemini API99 11%12%~360 users$28/mo · Gemini 3.1 Flash-LiteNoCompare →
Groq39 4%3%~1,500 users$6.75/mo · GPT OSS 20BNo
Azure OpenAI22 2%0%——No
Mistral AI15 2%1%~1,700 users$6.00/mo · Ministral 3 (3B)No

For LLM API: how many of the 923 makers' products we know the LLM API of chose each option, and the share among the 256 launched in 2026, since a tool that came first has products from every year, and what each costs at 10,000 users.

Costs are the cheapest plan that fits, from each vendor's pricing page, at the usage our stack planner assumes for a product with that many users. Free for: the users its cheapest plan a business can use stays free for.

Often paired with

Share of the 39 makers' products on Groq that show this choice.

Markets that build with it most

Product Hunt markets where Groq is in far more of the stacks we know than across every market (1%).

When to use Groq, and when not

Pick Groq if

  • Token cost dominates your budget, for example high-volume batch or agent workloads. LLM API →

Something else fits better if

  • You want the strongest general models and the widest ecosystem of examples and integrations: OpenAI API or Claude or Gemini API.
  • You want to try or mix many models with one key and one bill, and fall back when a provider is down: OpenRouter.
  • You want that routing and spend control but self-hosted, with keys and logs on your servers: LiteLLM.
  • The open model you need is already served by a host and you want to pay per token: Together AI or Fireworks AI or Hugging Face.
  • Your workload is your own Python code — a pipeline, batch job or custom model — that should scale to zero: Modal.
From each decision's guide, written from what makers' products chose and why.

Groq is an inference cloud. It runs open-weight models made by others, such as OpenAI's GPT-OSS, Qwen, Whisper and Orpheus text-to-speech, on its own LPU chips instead of GPUs, and sells access through the GroqCloud API. The point is low latency and high output speed, which matter for voice agents, live autocomplete and multi-step agent loops where every call adds wait time.

More about Groq

The developer model is an OpenAI-style HTTP API at api.groq.com/openai/v1. You can keep the OpenAI client libraries and change only the key and base URL, or use Groq's own Python and TypeScript SDKs. It supports Chat Completions and a Responses API, tool use with built-in browser search and code execution, remote MCP tools, structured outputs and prompt caching.

For a small team the relevant pieces are a free plan to start, a Batch API and Flex processing on the paid Developer plan, spend limits, and data controls an admin can set to zero retention. Groq runs it as a hosted service from data centers in North America, Europe, the Middle East and Australia; stored customer data sits in US Google Cloud buckets.

The limit is the catalog. You get only the models Groq has chosen to host, a few of them, such as the Llama 3 models, now listed as enterprise-only. Preview models can be withdrawn at short notice, and free-plan rate limits are low.

How Groq itself is built

4 tools, from its own code, website and Product Hunt page.

Groq pros and cons

Themes that recur in makers' words and Hacker News comments, each linked to what it summarises, with how Product Hunt tags its reviews.

Pros

  • Inference is extremely fast, enabling real-time voice and agent workflows. PHPH 2PH 3PH 4
  • The free tier is generous, with many models to choose from. PHPH 2HN
  • Its hosted Whisper gives near-instant transcription. PHPH 2HNPH 3
  • The team is helpful to work with. PHPH 2
4.8★ from 5 reviews on Product Hunt ↗

What Hacker News says about Groq

On Hacker News, 29% of comments about Groq recommend it and 4% criticize it: net praise +25%, 5th best liked of 12 tools HN discusses for LLM API.

By year

YearComments choosing it, per monthNet praise
20230.3—
20242.3+29%
20252.9+19%
2026 (8 mo)3.1+26%

In their words

  • “i like groq but models seem to have stagnated” HN, Jun 2026
  • “I use them heavily in production because OSS 120B on Groq/Cerebras is one of the fastest models available” HN, Mar 2026
  • “Groq is still under a 30 request per minute rate-limit” HN, Apr 2024

Hacker News comments January 2023 to August 2026 that name Groq in a sentence like "I use" or "we moved to", Claude read a sample of 79 and the counts scale it to all of them; net praise is comments recommending it minus comments criticizing it, as a share of all comments about it. How it's counted, and how HN compares with makers.

Who switches

More projects move to Groq: 231 pull requests in, 109 out; the most come from Gemini API and leave for Gemini API.

Moving to GroqMoving away
Groq
Gemini API → Groq152 PRs
OpenAI API → Groq50 PRs
Claude → Groq15 PRs
DeepSeek → Groq9 PRs
Mistral AI → Groq5 PRs
Groq → Gemini API64 PRs
Groq → OpenAI API25 PRs
Groq → Claude10 PRs
Groq → DeepSeek7 PRs
Groq → Mistral AI3 PRs

Public pull requests on GitHub since Oct 2024 whose title says "X to Y" — real code changes moving a project from one tool to another, by developers in general.

Who uses it

39 makers' products, each linked to the source that shows it, and 76 open-source projects that declare it in their code. The best known on Product Hunt: MindPal (3,252 followers), inbox-zero (1,451 followers), Vectorize (1,261 followers), Slashy (1,259 followers), Pretty Prompt (1,246 followers).

The maker says so 27Subprocessor list 13Declared in code 77How evidence is collected →
Vectorize
VectorizeAgents that remember. Agents that learn.

“We love using Groq hosting and models. They are a core part of our chat and widget agents. The models are lightning fast and the Groq team is fantastic.”

LLM APIMaker says so +1 · source ↗
MindPal
MindPalMindPal is a no-code platform for turning a person's expertise into AI agents and multi-…

“You can select models hosted on Groq to power the AI agents you build on MindPal!”

LLM APIMaker says so · source ↗
graph8
graph8Turn buyer signals into outbound that works

“We use Groq for ultra-fast inference when analyzing millions of contact records and enriching them with AI. It enables us to run deep research and structured reasoning at speeds that would be impossible on standard GPU setups. This level of performance lets us deliver intelligent outputs in real time, even at scale. We're grateful to the Groq team for building the kind of infrastructure that makes this possible.”

LLM APIMaker says so · source ↗
KushoAI
KushoAIKushoAI uses AI agents to generate and run tests for web interfaces and backend APIs. It…

“Blazingly fast Large Language Model for code generation”

LLM APIMaker says so · source ↗
Antispace
AntispaceAction-Oriented AI: Translate Human Thoughts into Actions

“Groq Chat enhances our LPU's performance significantly, enabling faster inference and improved user interaction.”

LLM APIMaker says so · source ↗
Yap-It
Yap-ItTurn messy voice notes into ready-to-publish content.

“YapIt only exists because of Groq. We needed instant transcription and rapid LLM formatting to make the app feel magical. Groq's whisper model and AI inference speeds are unmatched—they make our voice-to-text pipeline feel like it has zero latency.”

LLM APIMaker says so · source ↗
Magine
MagineSpawn vision-enabled AI agents autonomously browsing the web

“Magine runs on Groq's LLM inference for parallel context optimization.”

LLM APIMaker says so · source ↗
NBot
NBotPersonalized curators that surface what you care about

“Built with Groq for blazing-fast inference NBot is powered by Groq’s inference infrastructure, allowing us to process large volumes of content, run real-time summarization, and deliver high-quality AI responses at low latency. As we scale AI-powered feeds, chat, and synthesis across the internet, Groq’s performance and reliability have been critical to making the experience feel fast, responsive, and production-ready. Huge thanks to the Groq team for supporting us as an early partner.”

LLM APIMaker says so · source ↗
Voicr for Mac
Voicr for MacDictate and get improved or translated text

“Shoutout to Groq — the lightning fast inference engine running Voicr's AI under the hood. Without Groq's speed, that under 3 seconds promise wouldn't be possible.”

LLM APIMaker says so · source ↗
SuperBrain
SuperBrainSelf-hosted, AI-powered second brain for Android

“SuperBrain’s instant audio transcription and text analysis wouldn't be possible without Groq. The inference speed is absolutely game-changing—it allows our backend to summarize long content in milliseconds, making the 'second brain' feel as fast as a real one. If you need speed, Groq is the only way to go.”

LLM APIMaker says so · source ↗
Touring
TouringThe ultimate app for travellers, works literally everywhere

“We integrated Groq into the pipeline that Touring uses to create the stories. The incredible speed that Groq offers makes it possible to provide users with a smoother UX and shorter waits.”

LLM APIMaker says so · source ↗
GodmodeHQ ✊
GodmodeHQ ✊Stand out from competition in your sales process

“Our AI research agents live through Groq APIs and that is how they are so fast. Looking forward to public API access but it is still crushing”

LLM APIMaker says so · source ↗
AI Content Mate
AI Content MateYour AI content mate right inside Figma

“This tool internally uses groqcloud API. Its free tier is more than enough for a day-to-day requirements of a designer. It really brings down the cost of a tool like this.”

LLM APIMaker says so · source ↗

Open source: a project that declares Groq as a dependency in its public code — verifiable, but not necessarily a live product.

What its projects tell coding agents

29 of the 46 open-source products built with Groq that were worked on in the last 180 days keep instruction files for coding agents — 63%, against 53% of all the projects we read. AGENTS.md is in 22, CLAUDE.md in 18.

705words in the median file
npmthe package manager most named, in 7 of 26 files
65%say how to test a change
Named more in these files than in other projects' — in how many of the 26:
What AGENTS.md files say about other tools →What open-source products tell their coding agents →

Further reading

Questions makers ask about Groq

Is Groq good for production?

39 makers' products we track run on it. On GitHub, 231 public pull requests moved projects to Groq from tools we list, and 109 moved them away.

What is Groq used for?

Very fast inference for open models on custom LPU hardware. Makers' products we track use it for LLM API (39).

What are the alternatives to Groq?

For LLM API, the other options makers' products we track chose most are OpenAI API (736), Claude (252), Gemini API (99), Azure OpenAI (22), Mistral AI (15). Each alternative, with the situation it fits, is on the Groq alternatives page.

Is Groq still popular with new products?

Less than before: among the 256 makers' products launched in 2026 that made the LLM API choice, 3% chose Groq, against 3% of the 316 launched in 2024 or earlier.

How much does Groq cost per month?

At 10,000 users, Groq costs $6.75 a month on the cheapest plan that fits (GPT OSS 20B), from its pricing page.

Do developers switch to or away from Groq?

On GitHub, 231 public pull requests moved projects to Groq from tools we list, most from Gemini API (152), OpenAI API (50), Claude (15); 109 moved them away, most to Gemini API (64), OpenAI API (25), Claude (10).

When should you use Groq?

Token cost dominates your budget, for example high-volume batch or agent workloads (LLM API). Something else fits better if: you want the strongest general models and the widest ecosystem of examples and integrations, pick OpenAI API or Claude or Gemini API; you want to try or mix many models with one key and one bill, and fall back when a provider is down, pick OpenRouter.

Can I use the OpenAI SDK with Groq?

Yes. Set the base URL to https://api.groq.com/openai/v1 and use your Groq API key. A few fields, such as logprobs, logit_bias and messages[].name, return a 400 error, and n must be 1. source ↗

Does Groq store my prompts and outputs?

Not by default for inference. It may log them for up to 30 days to troubleshoot reliability problems or investigate abuse, and batch and fine-tuning files are kept while those features need them. Any customer can turn on Zero Data Retention in Data Controls, which disables the features that need storage. source ↗

Where is my data stored?

Customer data Groq retains is kept in Google Cloud buckets in the United States. Transfers from other countries can rely on standard contractual clauses. source ↗

How strict are the free plan's limits?

Limits are per organization and measured in requests and tokens per minute and per day. On the free plan they are low, for example 30 requests per minute and 1,000 per day for the GPT-OSS models. The Developer plan raises them and adds Batch and Flex processing. source ↗

Is there a batch mode for bulk jobs?

Yes. Batch jobs cost 50% less than synchronous calls, don't count against your normal rate limits, and run within a window of 24 hours to 7 days. source ↗

Can I rely on any model in the catalog for production?

Only on the ones Groq labels as production models. Preview models are meant for evaluation and can be discontinued at short notice. source ↗

Which languages have an official SDK?

Python and JavaScript/TypeScript. For anything else, use the REST API or an OpenAI-compatible client. source ↗

Is Groq free?

Yes — there is a free tier a small product can run on; paid use starts at Pay per token. source ↗

Is Groq open source or self-hostable?

Not open source, and hosted only.

Can AI coding agents work with Groq?

No llms.txt, official MCP server or CLI found yet.

Who uses Groq?

39 makers' products we track, each with a source, and 76 open-source projects declare it in their code. The best known of them on Product Hunt: MindPal (3,252 followers), inbox-zero (1,451 followers), Vectorize (1,261 followers), Slashy (1,259 followers), Pretty Prompt (1,246 followers). source ↗