Tools

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

C/C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline and outputs subtitles. Runs on CPU, with Apple Silicon and various GPU acceleration. Download a ggml-format model first.

Offline speech transcription and translation based on Whisper; audio never leaves your machine. buzz add exports lectures, interviews and meeting recordings to TXT, SRT or VTT. pip install needs Python 3.12 and FFmpeg; a desktop app is also available. Check transcripts manually.

CLI version of the VideoCaptioner subtitle assistant: transcribes courses, lectures and interviews, uses an LLM to segment, proofread and translate, then burns subtitles into the video. Free ASR and Bing translation work out of the box; LLM refinement needs an API key. Python 3.10 to 3.12.

Adds voice conversations to Claude Code and other agents: speak, and it detects silence, transcribes, and reads replies aloud. Runs offline with local Whisper and Kokoro, or uses OpenAI's speech APIs; needs a microphone and speakers.

Lets Claude Code watch videos: extracts frames with ffmpeg and transcribes timestamped audio from local files or YouTube links, to review footage, summarize lectures or find on-screen text. Needs Node.js 20+ and ffmpeg (yt-dlp for YouTube); transcribe with local Whisper or a Gemini/OpenAI key.

Local transcription that's compatible with the OpenAI Whisper CLI but faster and lighter: outputs SRT/VTT subtitles or text and can transcribe a live microphone. Needs Python; models download on first run; speaker labels need pyannote.audio and a Hugging Face token.

Creates and edits local CapCut (JianYing) drafts from the terminal: rough cuts on silence, styled subtitles and multilingual versions, still editable track by track in CapCut. Needs Node 18+ and desktop CapCut; subtitles need Whisper, translation an Anthropic key. No encrypted drafts. Unofficial.