Shypd.aiThe largest open index of AI toolswhisper-diarization is an open-source tool that combines OpenAI's Whisper ASR with speaker diarization. It identifies speakers for each sentence in transcriptions, enhancing speech recognition capabilities.
Trending
Also listed in
About
whisper-diarization is an open-source pipeline designed for automatic speech recognition with integrated speaker diarization, built upon OpenAI's Whisper. It processes audio by first extracting vocals to improve speaker embedding accuracy, then generates a transcription using Whisper. The tool corrects and aligns timestamps with ctc-forced-aligner to minimize diarization errors. It further utilizes MarbleNet for Voice Activity Detection (VAD) and segmentation to exclude silences, and TitaNet to extract speaker embeddings for identifying speakers in each segment. The results are then associated with timestamps and realigned using punctuation models for precise word-level speaker detection. It supports command-line options for audio file processing, model selection, device usage, and language specification, offering a robust solution for detailed audio analysis.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
