Tools

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

C/C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline and outputs subtitles. Runs on CPU, with Apple Silicon and various GPU acceleration. Download a ggml-format model first.

All-in-one video translation and dubbing: chains speech recognition, subtitle translation, multi-speaker AI voiceover and audio-video muxing, with local or online models like Faster-Whisper, DeepSeek and Edge-TTS. cli.py supports headless batch runs. Needs FFmpeg.

CLI version of the VideoCaptioner subtitle assistant: transcribes courses, lectures and interviews, uses an LLM to segment, proofread and translate, then burns subtitles into the video. Free ASR and Bing translation work out of the box; LLM refinement needs an API key. Python 3.10 to 3.12.

Adds voice conversations to Claude Code and other agents: speak, and it detects silence, transcribes, and reads replies aloud. Runs offline with local Whisper and Kokoro, or uses OpenAI's speech APIs; needs a microphone and speakers.

Automatically aligns subtitles to audio and video with a neural network, and can transcribe subtitles with Whisper or translate them with local models; supports 10+ formats such as SRT, TTML and SCC. Needs Python 3.9-3.12 and FFmpeg; transcription and translation need the llm extra.