Tools

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

C/C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline and outputs subtitles. Runs on CPU, with Apple Silicon and various GPU acceleration. Download a ggml-format model first.

Industrial-grade open-source speech recognition toolkit from Alibaba's ModelScope, with an agent-friendly funasr command that turns audio into text, JSON or SRT subtitles in one step, with speaker diarization and timestamps. Strong on Chinese. Requires PyTorch.

All-in-one video translation and dubbing: chains speech recognition, subtitle translation, multi-speaker AI voiceover and audio-video muxing, with local or online models like Faster-Whisper, DeepSeek and Edge-TTS. cli.py supports headless batch runs. Needs FFmpeg.

CLI version of the VideoCaptioner subtitle assistant: transcribes courses, lectures and interviews, uses an LLM to segment, proofread and translate, then burns subtitles into the video. Free ASR and Bing translation work out of the box; LLM refinement needs an API key. Python 3.10 to 3.12.

Open-source zero-shot TTS via f5-tts_infer-cli: from a few seconds of reference audio it reads Chinese or English text in the same voice, handy for lessons and videos. Needs Python, PyTorch and FFmpeg, ideally a GPU. Pretrained models are non-commercial; get consent before cloning a voice.

Offline speech toolkit for Apple Silicon Macs: CLI text-to-speech (including Chinese and voice cloning) and speech-to-text, for voicing lessons and explainer videos or transcribing lectures and interviews, with data staying local. Needs an M-series Mac and Python 3.10+; MP3 export needs ffmpeg.

Gemini API development skills: gemini-api-dev (core API and SDKs), gemini-live-api-dev (real-time bidirectional audio/video streaming) and gemini-omni-flash-api (Omni video generation and editing), filling in APIs released after model training cutoffs. Maintained by Google's Gemini team.

MiniMax's official CLI, built for agents: chat with MiniMax models from the terminal and generate images, video and speech, plus speech transcription, image understanding and web search. Works with the international platform. Requires a MiniMax Token Plan subscription.

Translates a video's SRT subtitles into other languages and generates AI voice lines synced to the timings, producing translated subtitles and dubbed audio tracks. Needs Python, FFmpeg and Google Cloud, Azure, DeepL or ElevenLabs API keys; configure the ini files, then run python main.py.

Adds voice conversations to Claude Code and other agents: speak, and it detects silence, transcribes, and reads replies aloud. Runs offline with local Whisper and Kokoro, or uses OpenAI's speech APIs; needs a microphone and speakers.

Turns ComfyUI workflows into MCP tools with no code, covering generation and conversion across text, image, speech and video; works with local ComfyUI or RunningHub in the cloud. Start the server with uvx pixelle and configure an LLM first.

Official skill for BaoCut, a subtitle app by Baoyu: transcribe audio and video, generate and translate subtitles, check speakers, adjust timing and export SRT or finished video. Needs BaoCut on an Apple silicon Mac (macOS 14+); on Windows the skill fetches a preview CLI.

Open-source video translation and dubbing: transcribes lectures, courses and other videos, translates them into one of 33 languages, synthesizes a dub aligned to the picture, and can export SRT subtitles. Needs Python 3.10+, FFmpeg, the violin CLI and a pay-as-you-go Together AI API key.

Uses an LLM to translate SRT, ASS and VTT subtitles into any language in batches, convert formats and transcribe audio or video. Install the CLI from source (Python 3.10+); needs an API key (e.g. OpenRouter) or a local model, and subtitles go to that provider.

Voice skills: TTS with subtitle timing, emotional character voices, translated dubbing, two-host news podcasts, sound effects and songs. Narration and podcasts work with local Kokoro or free voices; emotion, cloning, dubbing, effects and songs need a Noiz API key. Never clone voices to deceive.

Automatically aligns subtitles to audio and video with a neural network, and can transcribe subtitles with Whisper or translate them with local models; supports 10+ formats such as SRT, TTML and SCC. Needs Python 3.9-3.12 and FFmpeg; transcription and translation need the llm extra.

Official HeyGen skill: translates existing videos into 175+ languages with dubbing that clones the speaker's voice and re-syncs lips; you can proof subtitles before rendering. Needs a HeyGen account with credits and an API key plus HeyGen CLI, or the HeyGen MCP.

Official ElevenLabs skills: text to speech, speech to text, sound effects and music generation, voice changing, vocal isolation, multilingual dubbing and building voice agents. Needs an ElevenLabs API key.

Official iFlytek skills: machine translation, video translation and dubbing, Chinese document proofreading, PDF, image and invoice OCR, speech-to-text and TTS, plus contract review (lawyer check needed). Needs iFlytek open platform services and keys; contract review also needs OCR and LLM APIs.

Official iFlytek skill (beta): translates and AI-dubs videos between Chinese, English, Japanese, Korean, Russian, French, Spanish, Arabic and Cantonese, tracks jobs, fetches subtitles and video. Needs iFlytek API keys and Python 3; input must be an online MP4 (Alibaba OSS per docs), up to 5 min.

From Twilio Labs: exposes Twilio's public APIs (SMS, voice, phone numbers, Serverless and more) as MCP tools generated from its OpenAPI specs, with filtering by service or tag. Needs a Twilio API key; marked as a proof of concept.

Perso AI's official plugin: dub videos into other languages with lip sync, transcribe to SRT, translate and burn in subtitles, cut vertical clips. Subtitle and clip tools are free and local; dubbing, lip sync and transcription need a Perso account, billed per second. Needs Node.js 18+.