Tools

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

C/C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline and outputs subtitles. Runs on CPU, with Apple Silicon and various GPU acceleration. Download a ggml-format model first.

Industrial-grade open-source speech recognition toolkit from Alibaba's ModelScope, with an agent-friendly funasr command that turns audio into text, JSON or SRT subtitles in one step, with speaker diarization and timestamps. Strong on Chinese. Requires PyTorch.

Open-source zero-shot TTS via f5-tts_infer-cli: from a few seconds of reference audio it reads Chinese or English text in the same voice, handy for lessons and videos. Needs Python, PyTorch and FFmpeg, ideally a GPU. Pretrained models are non-commercial; get consent before cloning a voice.

Offline speech toolkit for Apple Silicon Macs: CLI text-to-speech (including Chinese and voice cloning) and speech-to-text, for voicing lessons and explainer videos or transcribing lectures and interviews, with data staying local. Needs an M-series Mac and Python 3.10+; MP3 export needs ffmpeg.

Gemini API development skills: gemini-api-dev (core API and SDKs), gemini-live-api-dev (real-time bidirectional audio/video streaming) and gemini-omni-flash-api (Omni video generation and editing), filling in APIs released after model training cutoffs. Maintained by Google's Gemini team.

MiniMax's official CLI, built for agents: chat with MiniMax models from the terminal and generate images, video and speech, plus speech transcription, image understanding and web search. Works with the international platform. Requires a MiniMax Token Plan subscription.

Experimental open-source generative media MCP servers from Google Cloud: Nano Banana images, Veo video, Gemini TTS and Chirp voices, Lyria music, and AVTool for compositing. Each registers separately; needs a billing-enabled Google Cloud project and gcloud login; AVTool needs FFmpeg.

Turns ComfyUI workflows into MCP tools with no code, covering generation and conversion across text, image, speech and video; works with local ComfyUI or RunningHub in the cloud. Start the server with uvx pixelle and configure an LLM first.

Calls image and video models such as FLUX, Veo and Seedance through inference.sh's belt CLI to generate images, video, avatars and voiceovers, plus guides for thumbnails, storyboards, press releases and social copy. Needs belt and a free inference.sh account; model calls are billed per use.

Official ElevenLabs skills: text to speech, speech to text, sound effects and music generation, voice changing, vocal isolation, multilingual dubbing and building voice agents. Needs an ElevenLabs API key.

Official fal.ai skills: agents use the genmedia CLI to call fal's 1,000+ models for text-to-image, image-to-video, voiceover, product shots and ad creatives, and storyboard shorts, with prompting guides per model. Needs a fal.ai account and API key (pay as you go) and the genmedia CLI.

Official agent-first CLI from fal: search and run 1,200+ image, video and speech generation models on fal.ai, check parameters and pricing, upload inputs and download results, with structured JSON output. Good for batch image and promo asset generation. Needs a fal.ai API key, billed per use.

Runway's official plugin: agents batch-generate videos, images, voiceovers and sound effects from one prompt, for ad variations, product videos and multi-shot shorts; also helps developers integrate Runway into apps. Needs a Runway developer account ($10 minimum top-up), an API key and uv.

Community-built MCP for the Genesys Cloud contact center: supervisors and QA staff can check queue volumes, sample conversations, and read call quality, sentiment, topics and transcripts. Needs an OAuth client in your Genesys Cloud org with per-tool permissions, and Node.js. Still in development.