mrkeyoor.com_
Wed 21 Oct 21:20 UTC
AI Toolsevaluationupdated 20 Oct 2026

whisper review

Whisper is OpenAI's speech-recognition model family and Python code for turning recordings into text, identifying the spoken language, and translating speech into English. It lets developers process audio locally through a command-line tool or Python, without sending recordings to a hosted speech API.

+357stars / 7d
Verdict

Our Whisper installation occupied 5,700 MB, and its tests failed after 202 seconds with exit 137 despite a successful build. Choose the reference implementation for local batch work when direct access to OpenAI's code matters and you can validate transcripts on your own recordings. The incomplete test evidence leaves setup confidence unresolved, while live transcription and evaluated speaker identification need work beyond this repository.

We ran it

Lab card: what happened when we ran whisperScreenshot of whisper (github.com/openai/whisper)
Install✓ · 63s81 packages · 5700 MB
Build✓ · 1s
Tests✗ · 202sran, no count parsed
Known vulns0(pip-audit)
Repo45 files~4,315 lines of source · 10.4 MB · 2 CI workflows · tests dir

Answers from our run

Does whisper build from source?

Dependencies installed in 63 seconds (81 packages), and the build succeeded in 1 seconds. We cloned commit 8609812 into a clean Debian container with 3 CPUs and no project-specific setup.

Do whisper's tests pass?

No. The project's own test command exited unsuccessfully after 202 seconds, and its output did not expose an individual test count.

Does whisper have known vulnerabilities in its dependencies?

pip-audit found none in the dependency tree at the time of our run.

Who should not use whisper?

Products expecting live transcription immediately: the model card says real-time transcription is unavailable out of the box.

What are the alternatives to whisper?

faster-whisper, whisper.cpp. Our Whisper installation occupied 5,700 MB, and its tests failed after 202 seconds with exit 137 despite a successful build.

SetupN/ANot assessed: installation and build completed in the lab, but the actual runtime is unverified and the failed suite supplied no diagnostic summary.
Docs4/5On a documentation scale where 1 means unusable instructions, 3 covers ordinary use and 5 resolves platform and deployment paths, this earns 4. The README explains FFmpeg, model choice and translation, and the model card states output limits. Its Python compatibility prose does not establish compatibility with our precise lab runtime.
CommunityN/ARecent pull requests show public activity, but maintainer response quality, resolution time and support outcomes were not assessed.
MaturityN/AThe failed suite has no completed counts or underlying errors, and no transcript accuracy or production stability evaluation was supplied.

Discussed on

  1. hnComplete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic568 points
  2. hnShow HN: Port of OpenAI's Whisper model in C/C++399 points
  3. hnOpenAI quietly launched Whisper V2 in a GitHub commit335 points
  4. hnOpenAI releases Whisper v3, new generation open source ASR model117 points
  5. hnBuzz: Transcribe audio from your microphones in real-time using OpenAI's Whisper79 points

Who it’s for

Python developers processing recorded interviews or audio archives in batches.
Researchers who want OpenAI's reference implementation and access to its transcription and decoding interfaces.
Teams that can check output against representative recordings and keep important passages subject to human review.

Who it’s NOT for

Products expecting live transcription immediately: the model card says real-time transcription is unavailable out of the box.
Applications treating generated text as a verified record: the model card warns that Whisper can invent words and repeat text, and recommends against high-risk decision use.
Translation workflows keeping the default turbo model: the README says it returns the original language even when translation is requested.
Teams requiring an evaluated speaker-identification system: the model card says speaker classification and diarization have not been thoroughly evaluated.
Deployments with little disk headroom: our installed environment occupied 5,700 MB despite a 10.4 MB repository checkout.

Setup reality

Our sandbox installed commit 8609812 in 63 seconds, recording 81 dependencies and 5,700 MB on disk. The build succeeded in 1 second. Tests failed after 202 seconds with exit 137; the supplied tail shows F and dot markers without a completed summary or diagnostic traceback. Pip-audit reported 0 known vulnerabilities.

Local use requires FFmpeg and a model checkpoint, with no hosted API credential. The README warns that Rust may be needed if tiktoken has no prebuilt wheel for your platform. Choose the model, language and transcription or translation task deliberately; turbo does not provide the documented translation behavior.

The recorded sandbox had 3 CPUs and 8 GB of RAM, using image label ghcr.io/astral-sh/uv:python3.12-bookworm. The label does not verify its actual runtime or operating-system version. The README expects Python 3.8 through 3.11, so compatibility with the precise lab runtime remains unresolved. The failed suite alone does not identify an environment or package cause.

Whisper's Python environment occupied 5,700 MB in our sandbox, beside a repository checkout of just 10.4 MB. If you're choosing speech software for a local worker or a desktop feature, that difference deserves attention before the first recording arrives. OpenAI's reference implementation gives you a direct route into the models, with a larger operating footprint than the source tree suggests.

The repository provides command-line and Python interfaces for transcription, language identification, and speech translation into English. Its code and model weights use the MIT license. Recorded interviews and audio archives are sensible starting jobs. You still need to choose a checkpoint, accommodate the runtime, and decide who checks consequential words in the transcript.

What happened when we ran it

Our sandbox installed commit 8609812 in 63 seconds on 2026-10-12, recording 81 dependencies and 5,700 MB on disk. The build succeeded in 1 second. Pip-audit reported 0 known vulnerabilities. The source scan counted 45 files and about 4,315 lines, with 2 CI workflow files, a tests directory, and no Dockerfile.

The test command failed after 202 seconds with exit 137. Its supplied final lines read F........FFFF....FFFF....FFFFFFFF--- summary lines ---. That shows failure markers mixed with dots, followed by the supplied summary marker. It gives no completed pass/fail count, traceback, or diagnostic explanation. We cannot identify which cases failed or explain the process exit from this tail. In particular, it does not establish memory exhaustion or a dependency defect.

The recorded environment had 3 CPUs and 8 GB of RAM, with image label ghcr.io/astral-sh/uv:python3.12-bookworm. An image label alone does not verify an interpreter or operating-system version. Installation and build completed in that sandbox, but the suite did not produce a successful result. None of these measurements establishes transcription accuracy, audio processing speed, or behavior on your chosen hardware.

FFmpeg and model choice remain deployment decisions

The README requires the FFmpeg command-line program in addition to the Python package. It also warns that Rust may be necessary when tiktoken lacks a prebuilt wheel for the platform. Local inference needs a model checkpoint rather than a hosted API key. Account for those files and system tools when preparing an environment, rather than treating the pip command as the whole deployment.

Our 5,700 MB installed environment is the cost we can substantiate. The supplied record does not break that total down by package or model, so we cannot attribute the space to a particular dependency. The README's compatibility prose expects Python 3.8 through 3.11. Without the raw toolchain logs, we cannot establish whether our sandbox fell inside that range or use the range to explain the failed suite.

Turbo does not translate speech into English

The default command-line model is turbo, and the README explicitly says it was not trained for translation tasks. Even with --task translate, it returns the original language. A wrapper that exposes a translation button while always selecting turbo would therefore give users the wrong behavior despite accepting their request.

For speech translation into English, the README points to the multilingual models other than turbo and recommends medium or large for its best translation results. That recommendation comes from upstream, not a comparison we ran. Set the model and task together in your application, and check a known recording before assuming the same configuration covers both transcription and translation.

A finished transcript can contain words nobody said

OpenAI's model card warns that predictions can include text absent from the audio. It also describes repetitive output and uneven accuracy across languages, accents, and dialects. Those limits matter for an archive search feature: a plausible sentence can still send someone to the wrong conclusion about what a speaker said. Successful file generation does not validate the content.

Keep the recording available beside important passages and evaluate examples from your actual speakers and recording conditions. The model card recommends domain-specific evaluation before deployment and advises against high-risk decision use. It also says speaker classification and diarization have not been thoroughly evaluated. A meeting product needing dependable speaker labels therefore has another component and another evaluation to consider.

File transcription needs extra work for live captions

The README says transcribe() reads the entire file and processes audio through a sliding window. The model card explicitly says real-time transcription is unavailable out of the box. For recorded jobs, that interface is straightforward to place behind a queue. A live-caption feature still needs an application layer for incoming audio and partial results, with behavior you must assess separately.

If the runtime is the obstacle, faster-whisper uses CTranslate2 and documents quantized execution. Whisper.cpp provides a C/C++ implementation and CPU execution, with examples for native platforms. Its example CLI also has a WAV-format restriction, so changing runtimes brings different operating requirements. We did not compare their speed or accuracy against this run; use the same recordings and acceptance criteria when choosing between them.

August code activity continues into October pull requests

GitHub recorded the last push on 2026-08-31, while pull request 2891 was updated on October 18. That proposal addresses inconsistent language identifiers returned when a caller supplies a language name. It remains a proposal, so callers should not assume its fix is in the code they download. The latest GitHub release is v20250625, published on June 26, 2025; that older tag alone does not establish abandonment.

Pin the commit or release you evaluate, then keep a small set of recordings with checked transcripts alongside it. Include your ordinary accents and difficult names. Before committing to the Python implementation, require that set to produce acceptable text and obtain the missing failure details for the suite on your intended host.

Alternatives

ProjectWhat it isPick it when
faster-whisper gh↗A CTranslate2 reimplementation of Whisper with quantized execution options.pick this instead when you want a different inference engine while keeping Python; compare it on your audio and hardware before adopting any upstream speed claim.
whisper.cpp gh↗A C and C++ implementation with CPU execution and native platform integrations.pick this instead when a native application or device is a better fit than a Python and PyTorch runtime; its example CLI has its own audio-format requirements.

What people are saying

  1. [velocity-scout] SYSTRAN/faster-whisper

Sources

  1. Whisper README
  2. Whisper model card
  3. faster-whisper README
  4. whisper.cpp README
  5. GitHub repository metadata
  6. Language-code normalization proposal

More ai tools reviews

Beav · PilotDeck · rakazo · BeefTV · OpenDots · reelmimic · the whole board →

Related reading