Tag: speech

Official MoneyPrinterTurbo skill: give it a topic or script and the agent installs, configures and produces a short video with voiceover, stock footage, subtitles and music; defaults to Chinese vertical MP4. Needs an LLM API key and a free Pexels key; macOS and Windows.

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

Open-source agentic video production: open Claude Code or Codex in the cloned repo, describe the video, and the agent handles research, script, voiceover, footage, subtitles and editing, confirming storyboard and cost first. Needs Python, Node.js and FFmpeg; free assets work without API keys.

C/C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline and outputs subtitles. Runs on CPU, with Apple Silicon and various GPU acceleration. Download a ggml-format model first.

Official skill for OpenMAIC, Tsinghua THU-MAIC's open-source multi-agent classroom: from a topic or PDF it generates a full lesson with slides, quizzes, interactive simulations, project-based learning and AI teacher narration. Use a hosted access code, or self-host with an LLM API key.

Browser Use's video editing skill: put raw footage in a folder and chat with Claude Code or Codex to get a finished cut, with filler words and pauses removed, color grading, burned-in subtitles, animations and per-cut self-checks. Needs ffmpeg, Python (uv) and an ElevenLabs API key.

Fast speech transcription built on faster-whisper, with word-level timestamps and speaker diarization, suited to meeting notes and subtitles. Diarization needs a Hugging Face token; GPU acceleration needs CUDA.

Offline speech transcription and translation based on Whisper; audio never leaves your machine. buzz add exports lectures, interviews and meeting recordings to TXT, SRT or VTT. pip install needs Python 3.12 and FFmpeg; a desktop app is also available. Check transcripts manually.

Continuously records your screen and audio locally, extracting on-screen text and transcribing speech, so agents can search pages, docs and meetings you saw and summarize your day. Data stays local. Needs screenpipe running: source is free for personal use, desktop app is a subscription.

Industrial-grade open-source speech recognition toolkit from Alibaba's ModelScope, with an agent-friendly funasr command that turns audio into text, JSON or SRT subtitles in one step, with speaker diarization and timestamps. Strong on Chinese. Requires PyTorch.

Official MCP from the FunASR project: transcribes audio files locally with the SenseVoice model, supporting Mandarin, Cantonese, English, Japanese and Korean, with optional segment timestamps. Local inference needs no API key and audio stays on your machine. Docker image available.

Unofficial Python library and CLI for driving Google NotebookLM (now Gemini Notebook): bulk-import sources, ask cited questions, and generate and download podcasts, videos, slides, quizzes and flashcards. Ships an agent skill. Relies on undocumented APIs and needs a Google sign-in.

All-in-one video translation and dubbing: chains speech recognition, subtitle translation, multi-speaker AI voiceover and audio-video muxing, with local or online models like Faster-Whisper, DeepSeek and Edge-TTS. cli.py supports headless batch runs. Needs FFmpeg.

CLI version of the VideoCaptioner subtitle assistant: transcribes courses, lectures and interviews, uses an LLM to segment, proofread and translate, then burns subtitles into the video. Free ASR and Bing translation work out of the box; LLM refinement needs an API key. Python 3.10 to 3.12.

Open-source zero-shot TTS via f5-tts_infer-cli: from a few seconds of reference audio it reads Chinese or English text in the same voice, handy for lessons and videos. Needs Python, PyTorch and FFmpeg, ideally a GPU. Pretrained models are non-commercial; get consent before cloning a voice.

Rewrites an article or script as narration, then builds a click-through 16:9 web presentation you can screen-record into an explainer video, with optional synthesized voiceover. Good for lessons, YouTube tutorials and product walkthroughs. Needs Node.js; voiceover needs a MiniMax or OpenAI key.

Converts text to speech with Microsoft Edge's online TTS service and can generate subtitle files at the same time. No API key needed, with voices for many languages. Not an official Microsoft project and depends on that online service staying available.

Official skill for Anarlog (formerly Hyprnote), an open-source, local-first meeting notes app: lets agents query notes, summaries, transcripts, attendees and action items from local data, with no meeting bot needed. Requires the Anarlog desktop app and CLI; remote cloud access needs Pro.

Offline speech toolkit for Apple Silicon Macs: CLI text-to-speech (including Chinese and voice cloning) and speech-to-text, for voicing lessons and explainer videos or transcribing lectures and interviews, with data staying local. Needs an M-series Mac and Python 3.10+; MP3 export needs ffmpeg.

Higgsfield's official Codex plugin: uses its remote MCP to generate images and video from text or photos, like product-shot video ads or animated stills, with built-in flows for faceless narration, voiceover and burned-in captions. Needs a Higgsfield account; billed in credits.

One command extracts or summarizes web pages, PDFs, YouTube videos, podcasts and media files, with JSON output. Summaries can use many model APIs, local models or a logged-in Codex or Claude CLI; plain extraction needs no key. Also has a browser sidebar extension.

Open-source alternative to NotebookLM's podcast feature: turns web pages, PDFs, images, YouTube videos or text into two-host conversational audio, useful for lecture notes or articles. Uses Gemini and OpenAI API keys by default, or local models plus free Edge TTS.

Unofficial nlm CLI and MCP server for NotebookLM (now Gemini Notebook): bulk-create notebooks, import web pages and docs, and generate audio overviews, quizzes, flashcards, mind maps and slides for teaching and study. Relies on undocumented APIs and a Google sign-in, so it may break.

Unofficial CLI and MCP that let agents work with NotebookLM (now Gemini Notebook): bulk-import sources, ask questions with citations, and generate audio overviews, quizzes, flashcards, mind maps and slides. Uses undocumented APIs and may break; needs a Google sign-in and uv.