도구

Local LLM inference engine in plain C/C++ with a command-line chat and an OpenAI-compatible HTTP server; pulls and runs GGUF models straight from Hugging Face. Supports Apple Silicon, CUDA, Vulkan and other hardware, plus low-bit quantization.

Minimal, extensible terminal AI agent that can write its own prompt templates, skills, extensions and themes. Offers print, JSON and RPC modes for scripting, plus a TypeScript SDK. Needs Node.js 22.19+.

Multi-agent investment research framework where fundamental, sentiment, news and technical analysts, bull and bear researchers, a trader and risk managers debate a stock and produce a report and rating. Covers US, Hong Kong and A-shares. Needs Python and an LLM API key; not investment advice.

OpenAI's open-source general-purpose speech recognition model. The whisper command transcribes many languages, translates foreign speech into English and writes subtitle files. Needs FFmpeg; faster with a GPU.

For fuzzy requirements: the agent asks one question at a time with its own guess, clarifying users, motivation, success criteria and constraints, and restates the intent for your confirmation before planning. Needs you answering live, so not for unattended runs. From Addy Osmani's agent-skills.

High-throughput LLM inference and serving engine: vllm serve starts an OpenAI- and Anthropic-compatible server in one command. Supports 200+ model architectures from Hugging Face, quantization and distributed inference. Aimed mainly at NVIDIA, AMD and other GPUs.

Provides a sequential_thinking tool that guides the model to break complex problems into revisable, branching steps. Good for planning, analysis and tasks that need careful iteration. Official MCP reference server.

Baidu PaddlePaddle's official OCR and document parsing tool: the paddleocr command reads text from images and parses PDFs and scans into Markdown or JSON, supporting 100+ languages with models that run locally.

Official PaddleOCR MCP: text recognition and layout parsing for images and PDFs (PP-OCR, PP-StructureV3, PaddleOCR-VL), returning text or Markdown. Runs inference locally, or calls the official API or a self-hosted service.

Astral's extremely fast Python package and project manager written in Rust, replacing pip, pipx, poetry, pyenv and more. Supports lockfiles and multiple Python versions, and uvx runs Python tools without installing them.

MCP server built into the adaptive Python scraping framework Scrapling: supports plain HTTP requests, browser rendering and stealth fetching, and uses CSS selectors to pass only the target content to the AI, saving tokens and filtering out prompt injection.

Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use.

Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.

Document parser from OpenDataLab that turns PDFs, images and Office files into Markdown or JSON, handling tables, formulas and complex layouts well, with page-by-page reading and citation anchors for agents. Parses locally by default; needs Python 3.10+.

Reads messy invoices and receipts (PDFs, scans, screenshots), extracts vendor, date and amount, renames and files them by vendor, category or year, keeps originals and can export a CSV for your accountant. Needs an agent with local file access; no account required.

Classic open-source OCR engine and CLI that reads text from images and outputs plain text, hOCR, searchable PDF or TSV. Supports 100+ languages; install the language data for each language you need.

Multi-agent orchestration framework for Claude Code and Codex, formerly Claude Flow: swarm coordination, self-learning memory and cross-machine federated communication. The marketplace offers 30+ plugins; full features need npx ruflo init.

Multi-agent orchestration framework formerly called Claude Flow: ruflo init gives Claude Code nearly 100 specialized subagents, swarm coordination, cross-session vector memory and hooks; add --codex to configure Codex instead. Also works as a standalone MCP server or plugin marketplace.

All-in-one LLM fine-tuning framework: llamafactory-cli handles pretraining, SFT, PPO/DPO alignment and LoRA/QLoRA training, plus chat inference, weight merging and export, and OpenAI-style API serving for 100+ open models. Has a Web UI; training usually needs a GPU.

Job search system that runs in your local AI coding CLI: scans job portals, scores roles with a structured A-H evaluation and a 1-5 rating, flags fake listings, tailors ATS resumes and cover letters, and tracks applications. Never submits for you. Needs Node.js.

Parses PDF, DOCX, PPTX, XLSX, HTML, images and audio, recovering layout, reading order, tables and formulas, and exports Markdown, HTML or lossless JSON. Started by IBM Research, now hosted by the LF AI & Data Foundation; runs fully locally.

Command-line toolkit for transcoding, cutting, joining, frame extraction and streaming of audio and video, including ffmpeg, ffprobe and ffplay. A core dependency for agents handling media. The GitHub repo is the official mirror.

Searches Reddit, X, YouTube, Hacker News, Polymarket and more in parallel for the past 30 days of discussion on a topic, scores it by engagement and summarizes it into a brief. Good for market research and meeting prep. Needs Python 3.12+; some sources need API keys.

Generates natively editable PPTX from PDFs, Word files, web pages and other sources, with native shapes, data charts and master layouts. Can also fill your own template and add animations and narration to finished decks. Needs Python 3.10+ and its dependencies.