Tools

Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change.

Turns 18 kinds of sources, including doc sites, GitHub repos, PDFs and videos, into skill packages for Claude and other platforms, or exports RAG chunks and vector store data. Optional MCP server, and it can call a local agent like Claude Code to enrich content. Needs Python 3.10+.

Simon Willison's LLM CLI and Python library: call OpenAI, Claude, Gemini and local models from the terminal, with conversations logged to SQLite automatically, plus embeddings, structured extraction, tool calling and a plugin system.

ByteDance's open-source, general software engineering agent: trae-cli edits files and runs commands from natural language, supports multiple model providers and MCP, and records full execution trajectories. Transparent design suits agent research and customization. Needs your own model API key.

Bundles 60+ full-stack specialist skills into one plugin: experts for 12 languages including Python, TypeScript, Go, Rust and Java, and frameworks like React, Django and Spring Boot, activated automatically by request. Also includes Jira and Confluence workflow commands (needs Atlassian MCP).

Hugging Face's official skills: manage Hub models and datasets with the hf CLI, fine-tune language and vision models, run model evaluations, and build Gradio apps deployed to Spaces. Needs an HF account; cloud training on HF Jobs requires a paid plan.

High-accuracy retrieval-augmented Q&A over paper PDFs, text and Office documents, filling in citation metadata, checking retractions and attaching traceable sources to answers. Provides the pqa CLI and a Python library. Needs an LLM API key by default; local models can be configured.

Offline speech toolkit for Apple Silicon Macs: CLI text-to-speech (including Chinese and voice cloning) and speech-to-text, for voicing lessons and explainer videos or transcribing lectures and interviews, with data staying local. Needs an M-series Mac and Python 3.10+; MP3 export needs ffmpeg.

Open-source LLM evaluation platform: one opencompass command picks the model and datasets and runs the evaluation across hundreds of benchmarks. Works with local Hugging Face models and API models, with vLLM and LMDeploy for faster inference.

Creates, edits and validates reproducible Python and SQL Jupyter notebooks: organizes cells as reports or tutorials, checks conclusions against actual output and reruns top to bottom before handoff. Maintained by OpenAI in the Data Analytics plugin of openai/plugins.

Python library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline.

Font toolkit: pyftsubset subsets fonts to the characters you use and outputs WOFF2 to shrink web fonts, and ttx converts fonts to editable XML for inspection and edits. Needs Python 3.11+ and the woff extra for WOFF2; check the license before subsetting commercial fonts.

Mistral's official open-source terminal coding assistant: uses Mistral models to read and write code, run commands and search the codebase, with multiple agent profiles and subagents, plus Skills, MCP and a --prompt scripting mode. Needs a Mistral API key.

Hugging Face's official hf CLI: search, download and upload models and datasets, manage repos and storage buckets, and run jobs on Hugging Face's cloud. Output adapts automatically for agents, and hf skills add installs companion skills. Uploads and similar actions need a login.

Unified search across 20+ academic sources including arXiv, PubMed, bioRxiv, Semantic Scholar and OpenAlex, returning deduplicated, normalized results and downloading full text via open-access channels first. Most sources need no API key.

Simon Willison's website screenshot CLI: batch screenshots from YAML, record demo videos, export PDF and HTML, run JavaScript in pages to extract data, and dump accessibility trees. Built on Playwright; install a browser on first use.

Runs open image models like FLUX, Qwen Image and Z-Image locally on a Mac: text-to-image, reference-based edits, inpainting and upscaling, all on-device. Needs Apple Silicon and uv; the first run downloads models and is slow. Check each model's license before commercial use.

Self-hostable long-term memory for agents, offering MCP, a REST API and a web dashboard: semantic search, knowledge graph and automatic memory consolidation. Embeddings are computed locally; choose SQLite, Cloudflare or Milvus as the backend.

Crawls an entire site, counts words and keywords per page, and checks technical SEO such as titles, meta descriptions, image alt text, H1s and social tags. Outputs JSON by default or an HTML report for agents to act on. Needs Python; the optional AI content review needs an API key.

Connects agents to live Jupyter notebooks: read, write, insert and execute cells and read multimodal outputs like charts, for interactive data analysis. Bring your own JupyterLab or JupyterHub; open source, maintained by Datalayer.

LangChain's official skill collection: framework selection, quickstarts, middleware, persistence, human-in-the-loop approval, RAG and eval design across LangChain, LangGraph and Deep Agents, in Python and TypeScript. Also installable as a Claude Code plugin. Still in early development.

The standard machine translation scorer: computes BLEU, chrF and TER with significance tests and downloads public test sets such as WMT, to compare engines or prompts. Needs Python 3.9+ and reference translations; automatic metrics are a rough screen, so final copy still needs human review.

ComfyUI's official CLI: install and launch ComfyUI in one step, manage custom nodes and model downloads, and run image and video workflows, with --json output on every command for agents. Can also submit jobs to paid Comfy Cloud.

Redis's official MCP server: read and write strings, hashes, lists, streams, JSON and other data structures in natural language, with vector indexing and search and pub/sub. Bring your own Redis instance; runs via uvx.