Updated

Whisper

OpenAI's open-weight speech recognition model for transcription and translation in many languages, run locally or on your own servers.

39 open-source projects declare Whisper in their code; no maker's live product we track uses it yet.

Open sourceSelf-hostable

Profile checked

Ask your AI about this, with this page as the source:ChatGPT ↗Claude ↗Perplexity ↗

How makers use Whisper

What Whisper is used for

Speech-to-Text & Text-to-Speech · Open model you run →Transcribing and translating audio in many languages with an open model on your own hardware.Trade-off: Batch-oriented, not built for real-time streaming; large models need a GPU for reasonable speed, and speaker labels need another tool.
ElevenLabs135Deepgram65Cartesia29AssemblyAI26Recall.ai21Whisper0Makers' products on each, for Speech-to-Text & Text-to-Speech

Whisper vs the alternatives makers chose

OptionMakers' products2026 launchesOpen source
ElevenLabs135 56%63%No
Deepgram65 27%25%No
Cartesia29 12%10%No
AssemblyAI26 11%6%No
Recall.ai21 9%6%No
Fish Audio9 4%5%No
Whisper0 0%0%Yes

For Speech-to-Text & Text-to-Speech: how many of the 239 makers' products we know the Speech-to-Text & Text-to-Speech of chose each option, and the share among the 80 launched in 2026, since a tool that came first has products from every year.

When to use Whisper, and when not

Pick Whisper if

Something else fits better if

  • How the voice sounds is part of the product — narration, characters, content: ElevenLabs or Fish Audio.
  • You're building live conversation where every millisecond of delay shows: Cartesia or Deepgram.
  • Users upload recordings to be transcribed and analysed: AssemblyAI or Deepgram.
  • Your product needs recordings and transcripts from Zoom, Meet or Teams calls: Recall.ai.
  • Voice is a side feature and one vendor matters more than fine control: OpenAI API.
From each decision's guide, written from what makers' products chose and why.

Who uses it

No maker's live product on record yet, and 39 open-source projects that declare it in their code.

We haven't found a maker's live product that uses Whisper yet — only the open-source projects below, which declare it in their code.

FinSynth
FinSynth基于Open WebUI框架的金融大模型交互平台——支持多模态非结构化数据处理Speech-to-Text & Text-to-SpeechIn its code · source ↗
khoj
khojYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom…Speech-to-Text & Text-to-SpeechIn its code · source ↗
omi
omiOpen-source AI wearable with mobile and desktop apps that records conversations and meet…Speech-to-Text & Text-to-SpeechIn its code · source ↗
RealChar
RealChar🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One C…Speech-to-Text & Text-to-SpeechIn its code · source ↗

Open source: a project that declares Whisper as a dependency in its public code — verifiable, but not necessarily a live product.

What its projects tell coding agents

17 of the 30 open-source products built with Whisper that were worked on in the last 180 days keep instruction files for coding agents — 57%, against 53% of all the projects we read. AGENTS.md is in 15, CLAUDE.md in 13.

779words in the median file
uvthe package manager most named, in 7 of 17 files
59%say how to test a change
Named more in these files than in other projects' — in how many of the 17:
What AGENTS.md files say about other tools →What open-source products tell their coding agents →

Alternatives to Whisper

All alternatives by situation →

Questions makers ask about Whisper

What are the alternatives to Whisper?

For Speech-to-Text & Text-to-Speech, the other options makers' products we track chose most are ElevenLabs (135), Deepgram (65), Cartesia (29), AssemblyAI (26), Recall.ai (21), Fish Audio (9). Open source or self-hostable among them: ElevenLabs, Deepgram, Cartesia, AssemblyAI. Each alternative, with the situation it fits, is on the Whisper alternatives page.

When should you use Whisper?

Audio must stay on your servers, or volume makes per-minute pricing add up (Speech-to-Text & Text-to-Speech). Something else fits better if: How the voice sounds is part of the product — narration, characters, content, pick ElevenLabs or Fish Audio; you're building live conversation where every millisecond of delay shows, pick Cartesia or Deepgram.

Is Whisper open source or self-hostable?

Open source, and you can self-host it. source ↗

Can AI coding agents work with Whisper?

No llms.txt, official MCP server or CLI found yet.

Who uses Whisper?

No maker's live product we track yet; 39 open-source projects declare it in their code. source ↗