mrkeyoor.com_
Sat 07 Nov 00:43 UTC
AI Toolsevaluationupdated 28 Sept 2026

VibeVoice review

VibeVoice is Microsoft's research family for speech recognition and speech generation. Its active code covers long-recording ASR with speaker labels and timestamps, plus a smaller single-speaker model that turns incoming English text into audio.

+1,380stars / 7d
Verdict

Our VibeVoice install took 87 seconds, consumed 6,146 MB, and exposed 8 known vulnerabilities before any model was run, so adopting it is a research commitment. Try the 7B ASR path if one-pass speaker-aware transcription is the specific feature you need and you can test it on representative audio. Look elsewhere for a supported production service, customizable realtime voices, or the disabled four-speaker TTS experience.

We ran it

Lab card: what happened when we ran VibeVoiceScreenshot of VibeVoice (microsoft.github.io/VibeVoice)
Install✓ · 87s141 packages · 6146 MB
Build✓ · 9s
Testsn/ano test script
Known vulns8(pip-audit)
Repo110 files~20,550 lines of source · 149.5 MB · 0 CI workflows

Answers from our run

Does VibeVoice build from source?

Dependencies installed in 87 seconds (141 packages), and the build succeeded in 9 seconds. We cloned commit 1541f59 into a clean Debian container with 3 CPUs and no project-specific setup.

Does VibeVoice have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Does VibeVoice have known vulnerabilities in its dependencies?

pip-audit flagged 8 known advisories in the dependency tree at the time of our run.

Who should not use VibeVoice?

Podcast builders expecting the original 90-minute, four-speaker generator: Microsoft disabled its installation and usage after reported misuse.

What are the alternatives to VibeVoice?

Whisper, CosyVoice, F5-TTS. Our VibeVoice install took 87 seconds, consumed 6,146 MB, and exposed 8 known vulnerabilities before any model was run, so adopting it is a research commitment.

Setup2/5Build passes, but the 6,146 MB install precedes models and GPU setup
Docs4/5Separate model guides are detailed, though realtime claims conflict
Community4/554,529 stars and issue activity continued through September 28
Maturity2/5No tests, CI, or tagged release. Production use is discouraged

Discussed on

  1. hnVibeVoice: A Frontier Open-Source Text-to-Speech Model448 points
  2. hnVibeVoice: Open-source frontier voice AI386 points
  3. hnMicrosoft open weights VibeVoice TTS supports 90 minutes speech, 4 speakers14 points
  4. hnVibeVoice-ASR: speech-to-text model designed to handle 60-minute long-form audio11 points
  5. hnMicrosoft pulls VibeVoice speech synthesis repo after misuse5 points

Who it’s for

Speech researchers testing hour-long transcription, diarization, timestamps, or hotword prompting.
GPU-equipped teams willing to evaluate a 7B ASR model on their own recordings and languages.
Developers comparing native Python, Transformers, vLLM, and streaming ASR paths.
Researchers who need LoRA fine-tuning code for VibeVoice-ASR.

Who it’s NOT for

Podcast builders expecting the original 90-minute, four-speaker generator: Microsoft disabled its installation and usage after reported misuse.
Teams seeking a production-approved speech service: the project says commercial and real-world use requires more testing and development.
Products that need custom realtime voices or several TTS speakers: the 0.5B realtime model is single-speaker, and custom voices require contacting Microsoft.
CPU-only teams wanting a small Python dependency: our install occupied 6,146 MB before model weights, while the main guides recommend NVIDIA containers.
Buyers who require an upstream test and release baseline: our checkout had no test target, CI workflow, Dockerfile, or tests directory, and GitHub has no latest release.

Setup reality

Our Python 3.12 sandbox installed 141 packages in 87 seconds and occupied 6,146 MB. The package build succeeded in 9 seconds. There was no test script or target, so tests were skipped. Pip-audit reported 8 known vulnerabilities.

No hosted API key is required for the local code, but actual use needs model weights from Hugging Face. The ASR and realtime TTS guides recommend NVIDIA PyTorch containers with GPU access. ASR demos also need FFmpeg, and some container versions may need FlashAttention installed separately.

The 110-file checkout had no Dockerfile or CI workflow. Its documented ASR container runs privileged, uses host networking and IPC, and exposes every GPU. Our lab result covers packaging, not recognition quality, synthesis quality, or model speed.

The 90-minute TTS feature cannot be installed from this repo

Microsoft's original VibeVoice-TTS promised conversations up to 90 minutes with four speakers, which is still the feature most likely to draw someone to the project. The documentation and samples remain online, but the installation section now says the code is disabled due to widespread misuse. The README dates the removal to September 5, 2025. A buyer cannot treat the old podcast demos as a feature available from the current checkout.

The active family now spans a 7B speech-recognition model, a streaming ASR variant, a separate BitNet CPU project, and a 0.5B realtime TTS model. These share the VibeVoice name and a 7.5 Hz tokenizer idea, yet they solve different jobs and use different runtime paths. Selecting VibeVoice therefore starts with selecting one model. Installing the Python package does not turn every item in the README's model table into a usable service.

The 7B ASR model is the clearest reason to try VibeVoice

VibeVoice-ASR-7B accepts up to 60 minutes of audio in one pass within a 64K token limit. Its output joins recognized words with speaker identity and timestamps, and custom hotwords can bias names or specialist terms. Microsoft documents more than 50 languages and code switching without an explicit language setting. For meetings or interviews where chunk boundaries confuse speaker tracking, that combined output is a concrete reason to evaluate the model.

The 7B path still assumes serious inference equipment. Microsoft's ASR guide recommends an NVIDIA PyTorch container, maps all GPUs into it, and may require a manual FlashAttention install. The Gradio demo adds FFmpeg. Native file inference, Transformers, vLLM, and LoRA fine-tuning give researchers several entry points, but each adds its own compatibility surface. Our 8 GB sandbox verified the package installation and build only. It did not run model weights.

Realtime TTS is a single-speaker English research path

VibeVoice-Realtime-0.5B targets roughly 10 minutes of generated audio from an 8K context window. It uses embedded speaker prompts and supports one speaker, with custom voice requests directed to Microsoft. English is the stated target. Nine additional language voices are offered for experiments, but the guide says their behavior has not been extensively tested. The same guide advertises streaming text input while leaving that function unchecked in its TODO list, a discrepancy worth resolving in your own trial.

Input preparation is part of that trial. The 0.5B guide says code, formulas, and uncommon symbols need normalization, while inputs of three words or fewer may become unstable. It does not generate background noise, music, or sound effects. Microsoft also warns that synthetic speech can enable impersonation and fraud, and it declines to recommend commercial or real-world deployment without further development. That wording places consent, disclosure, and output review on the team using it.

What happened when we ran it

Our run cloned commit 1541f59 into an unprivileged Python 3.12 Bookworm container with 3 CPUs, 8 GB of RAM, and no secrets. Installation succeeded in 87 seconds, adding 141 packages and using 6,146 MB on disk. The package build then succeeded in 9 seconds. Those results show that the source can be packaged in a clean Debian environment, but they do not include any downloaded model weights or GPU runtime.

Tests were skipped because the repository exposed no test script or target. Our scan also found 0 CI workflow files, no Dockerfile, and no tests directory across 110 files and about 20,550 source lines. Pip-audit reported 8 known vulnerabilities in the installed environment. The log supplied no model-quality or inference result, so it would be wrong to turn the successful 9-second build into a claim about transcription accuracy, speech quality, or latency.

A 6,146 MB environment is only the first deployment layer

The checked-out repository measured 149.5 MB, while its installed Python environment grew to 6,146 MB before model weights. That gap matters on developer machines, CI runners, and small containers. The ASR weights, realtime TTS weights, CUDA runtime, and optional FlashAttention sit beyond the successful install we measured. Teams should budget storage and GPU memory for the exact path they choose instead of using the repository build as a proxy for the final service.

VibeVoice provides no Dockerfile in the measured 110-file checkout. The ASR guide's sample container uses privileged mode, host networking, host IPC, unlimited memory locks, and access to every GPU. Those flags are convenient in a research box. A shared service needs a narrower container policy, pinned images and weights, dependency scanning, request isolation, and limits around uploaded audio. The open Gradio issue about one user's Stop action affecting concurrent sessions reinforces that the demo is not a finished multi-user server.

54,529 stars have not produced a tagged release channel

GitHub showed 54,529 stars and 198 combined issues and pull requests on September 28, 2026. The last push was September 3, the same commit our sandbox measured, while new issue and pull-request activity continued on September 28. That is active user interest, not abandonment. Yet GitHub's latest-release endpoint returned no release, and several September fixes remained open pull requests, so adopters must choose and pin source commits themselves.

VibeVoice earns a trial when 60-minute ASR with speaker labels, timestamps, and hotwords could replace several stages in your transcription pipeline. The 87-second install makes that trial possible, while the 6,146 MB environment, missing test target, and 8 audit findings set the terms. Pick one model path, isolate it, and test the recordings your users will actually send. The disabled four-speaker TTS demo is history, not a procurement plan.

Alternatives

ProjectWhat it isPick it when
Whisper gh↗A multilingual speech-recognition model with a narrower job and a much larger deployment ecosystem.pick this instead when dependable transcription support matters more than VibeVoice's integrated speaker and timestamp output.
CosyVoiceA multilingual TTS stack covering inference, training, and service deployment.pick this instead when voice generation, cloning, and deployment are the main job rather than long-recording ASR.
F5-TTSA research TTS implementation focused on fluent speech and reference-voice generation.pick this instead when you want an open voice-generation path and do not need VibeVoice's ASR features.

Sources

  1. VibeVoice README
  2. VibeVoice ASR guide
  3. VibeVoice realtime TTS guide
  4. VibeVoice TTS status
  5. ASR Gradio concurrency report
  6. Measured VibeVoice commit

More ai tools reviews

annotated_deep_learning_paper_implementations · guizang-ppt-skill · copilot-cli · kornia · skills · anarlog · the whole board →