Tools

Command-line audio and video downloader supporting thousands of sites: pick formats and quality, grab subtitles and metadata, and merge or transcode with FFmpeg. The actively maintained fork of youtube-dl.

In-process analytical SQL database. Its CLI queries CSV, Parquet and JSON files directly with SQL, no import or server needed, so agents can sample and aggregate large files. Officially maintained.

Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use.

Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.

Command-line edition of the open-source OpenBB investment research platform: query stock prices, financial statements, macroeconomic and other financial data from the terminal, and automate data pulls with Routine scripts. Officially maintained; some sources need API keys.

Write videos in HTML, CSS and frame-seekable animations, preview them from the CLI and render deterministic MP4s. Comes with agent skills for product launch videos, captions and talking-head re-edits. Maintained by HeyGen; needs Node.js 22+ and FFmpeg.

Cross-platform shell built around structured data: pipelines pass tables instead of plain text, and you can open and query JSON, CSV, TOML and more directly. Default builds include nu --mcp, which serves it to agents as an MCP server.

One CLI for Gmail, Drive, Calendar, Docs, Sheets and other Google Workspace APIs, with commands generated from the Discovery service, JSON output and 100+ Agent Skills. From the googleworkspace org but not officially supported; needs OAuth via a Google Cloud project.

Turns websites and Electron desktop apps into deterministic CLIs, with built-in adapters for Reddit, Hacker News, Bilibili, Zhihu, Xiaohongshu and more, and lets agents operate any page through your signed-in Chrome. Needs its companion browser extension.

Removes image backgrounds with one command: single images, whole folders or watched directories, mask-only output and switchable models like U2Net and SAM. Can also run as an HTTP server or process video frames with FFmpeg. Default models run locally.

Command-line tool for bulk-downloading galleries and posts from many image hosts and social platforms, with flexible file naming and config, and yt-dlp integration for video. Main development has moved to Codeberg; the GitHub repo stays in sync.

All-in-one video translation and dubbing: chains speech recognition, subtitle translation, multi-speaker AI voiceover and audio-video muxing, with local or online models like Faster-Whisper, DeepSeek and Edge-TTS. cli.py supports headless batch runs. Needs FFmpeg.

Official Lark (Feishu) CLI with 200+ commands for messages, docs, Base, Sheets, calendar, mail, approvals, OKRs, meetings and Minutes, plus 20+ bundled lark-* agent skills and structured output. Create a Lark app and sign in first.

Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit.

Command-line framework for warehouse modeling and ELT transformations: write models in SQL and let dbt handle dependencies, data tests and documentation. v2 is rewritten in Rust as a single binary. Maintained by dbt Labs; needs a data warehouse connection.

PostgreSQL command-line client with smart autocompletion and syntax highlighting. Compatible with psql environment variables, and -c runs a statement and exits, so agents can query databases non-interactively.

Simon Willison's LLM CLI and Python library: call OpenAI, Claude, Gemini and local models from the terminal, with conversations logged to SQLite automatically, plus embeddings, structured extraction, tool calling and a plugin system.

MySQL terminal client with smart autocompletion and syntax highlighting, also compatible with MariaDB and TiDB. Supports --execute and batch mode with CSV or table output, so agents can run SQL directly.

Pipes live streams from Twitch, YouTube and many other platforms to a local player, or saves them to video files with --output or --record, for keeping and re-editing replays of your own or partners' streams. Viewing needs a player like VLC. Only record content you have rights to.

Publishes SQLite databases as browsable, queryable web pages and JSON APIs, with SQL queries, metadata and plugins, and deploys to Cloud Run and other platforms with datasette publish. Great for data exploration and data journalism. Needs Python 3.10+.

Reads the exact position of every character, line and table cell in digital PDFs: the CLI exports layout-preserving text or CSV/JSON details, and the Python API extracts tables and form fields, ideal for invoices, statements and reports. Runs locally with Python; scans need OCR first.

Universal psql-style SQL command line: one tool to connect to PostgreSQL, MySQL, SQLite, SQL Server, Oracle and dozens of other SQL and NoSQL databases, with support for copying data between databases.

Processes CSV, TSV, JSON and other structured data like awk, sed, cut, join and sort, but by field name, for cleaning, aggregation, format conversion and pretty-printing. The command is mlr; written in Go with no runtime dependencies.

Linter and formatter for 20+ SQL dialects that auto-fixes most issues and handles Jinja templating and dbt projects (dbt needs a plugin), suited to warehouse code review and CI.