# Tools

> Every listed resource, editors’ picks first. The filters below can be combined.

- Search: append `?q=<keywords>` to the URL. Separate several keywords with spaces; all of them must match. Matches name, repository, tags, professions, description and README.
- Filter by type: append `?type=<cli|skill|plugin|mcp>` to the URL.
- Filter by profession: append `?profession=<profession id>` to the URL. Separate several ids with commas; a resource matches when it suits any of them. Ids are listed at https://hebbmind.com/api/v1/professions
- Filter by tag: append `?tag=<tag>` to the URL. Separate several tags with commas; a resource must carry all of them. Tags are listed at https://hebbmind.com/api/v1/tags

Resources for ML / AI or Data engineering or Research / Academia: 402 items.

> - ML / AI: Model training, evaluation and LLM application development.
> - Data engineering: Data pipelines, warehouse modeling, ETL and data quality.
> - Research / Academia: Literature search and reviews, experimental data analysis, paper writing and submission.

- [promptfoo](https://hebbmind.com/ja/cli/promptfoo.md): [CLI] CLI and library for evaluating and red-teaming LLM apps: compare prompts and model outputs in bulk, scan for security vulnerabilities and plug into CI/CD, with evals running locally. Now part of OpenAI and still open source under MIT.
- [calibre](https://hebbmind.com/ja/cli/calibre.md): [CLI] Open-source e-book manager whose command-line tools (ebook-convert, ebook-meta, calibredb) batch-convert between EPUB, MOBI, AZW3, PDF, DOCX and more and manage library metadata. The install command is Linux-only; on macOS and Windows use the installer.
- [WhisperX](https://hebbmind.com/ja/cli/whisperx.md): [CLI] Fast speech transcription built on faster-whisper, with word-level timestamps and speaker diarization, suited to meeting notes and subtitles. Diarization needs a Hugging Face token; GPU acceleration needs CUDA.
- [anydoc](https://hebbmind.com/ja/cli/anydoc.md): [CLI] From Firecrawl: converts Word, PowerPoint, Excel, PDF, EPUB, RTF and more into clean Markdown locally in milliseconds, keeping headings, tables, footnotes and formulas so agents can read attachments. Needs Node.js; optional Firecrawl cloud OCR for scans uploads the whole file.
- [Buzz](https://hebbmind.com/ja/cli/buzz.md): [CLI] Offline speech transcription and translation based on Whisper; audio never leaves your machine. buzz add exports lectures, interviews and meeting recordings to TXT, SRT or VTT. pip install needs Python 3.12 and FFmpeg; a desktop app is also available. Check transcripts manually.
- [BigQuery Basics](https://hebbmind.com/ja/skill/bigquery-basics.md): [Skill] Manages BigQuery datasets, tables and jobs with the bq and gcloud CLIs, runs SQL queries and loads data, with references for client libraries, MCP and Terraform. Google's official skill; requires a Google Cloud project.
- [Google Agent Skills](https://hebbmind.com/ja/skill/google-google-skills.md): [Skill] Google's official skill library, focused on Google Cloud: 100+ skills for gcloud, Cloud Run, GKE, BigQuery, IAM, monitoring and logging, and the Well-Architected Framework, plus Ads and Analytics.
- [Google Skills](https://hebbmind.com/ja/plugin/google-skills.md): [Plugin] Google's official skill library and plugin marketplace: nearly 150 skills focused on Google Cloud (GKE, BigQuery, Cloud Run, IAM and more), plus 17 product plugins pairing skills with MCP for Cloud SQL, Spanner, AlloyDB, BigQuery, GCS and others.
- [FunASR](https://hebbmind.com/ja/cli/funasr.md): [CLI] Industrial-grade open-source speech recognition toolkit from Alibaba's ModelScope, with an agent-friendly funasr command that turns audio into text, JSON or SRT subtitles in one step, with speaker diarization and timestamps. Strong on Chinese. Requires PyTorch.
- [notebooklm-py](https://hebbmind.com/ja/cli/notebooklm-py.md): [CLI] Unofficial Python library and CLI for driving Google NotebookLM (now Gemini Notebook): bulk-import sources, ask cited questions, and generate and download podcasts, videos, slides, quizzes and flashcards. Ships an agent skill. Relies on undocumented APIs and needs a Google sign-in.
- [olmOCR](https://hebbmind.com/ja/cli/olmocr.md): [CLI] AI2's tool for converting PDFs and scans to Markdown with a vision LLM, handling equations, tables, handwriting and multi-column layouts, suited to bulk digitizing papers and archives. Local runs need an NVIDIA GPU with 12GB+ VRAM; otherwise use a paid OpenAI-compatible remote endpoint.
- [Browser Harness](https://hebbmind.com/ja/cli/browser-harness.md): [CLI] Browser control from the browser-use team: an editable CDP connection lets agents drive the Chrome you are already using, writing missing helper functions as they go and keeping them for reuse. Also offers an MCP server. Allow remote debugging in Chrome on first use.
- [ARIS (Auto-claude-code-research-in-sleep)](https://hebbmind.com/ja/skill/auto-claude-code-research-in-sleep.md): [Skill] Lets Claude Code push ML research forward unattended: literature review, topic selection, experiment deployment, cross-model review loops and paper writing through rebuttal, in 80+ skills. Codex acts as the independent reviewer by default; other model pairings work too.
- [Agent Skills for Context Engineering](https://hebbmind.com/ja/skill/agent-skills-for-context-engineering.md): [Skill] Context and harness engineering skills: context fundamentals, degradation diagnosis and compression, multi-agent architectures, memory systems, tool design, LLM-as-judge evaluation and self-improvement loops. Focused on principles and design patterns, not tied to any agent platform.
- [Agent Skills for Context Engineering](https://hebbmind.com/ja/plugin/agent-skills-for-context-engineering.md): [Plugin] Context and harness engineering skills covering context compression and optimization, multi-agent architectures, memory systems, tool design and LLM-as-judge evaluation, activated automatically by task. Aimed at building production-grade agent systems.
- [RenderCV](https://hebbmind.com/ja/cli/rendercv.md): [CLI] Write your resume in YAML and render a cleanly typeset PDF from the command line: multiple themes, fine control of margins, colors and fonts, strict field validation and multi-language support. A companion agent skill is available. Needs Python 3.12+.
- [Harper](https://hebbmind.com/ja/cli/harper.md): [CLI] Automattic's offline English grammar checker: checks spelling, grammar and word choice locally in milliseconds without sending your text anywhere. Homebrew installs harper-cli for batch-checking files (still experimental) and harper-ls for editors. English only.
- [DataX](https://hebbmind.com/ja/cli/datax.md): [CLI] Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit.
- [claude-obsidian](https://hebbmind.com/ja/plugin/claude-obsidian.md): [Plugin] Turns an Obsidian vault into a local-first knowledge base: imports sources into interlinked notes with citations, answers questions from what is already in the vault, and adds 15 skills including search, vault health checks and Canvas knowledge graphs.
- [ms-swift](https://hebbmind.com/ja/cli/ms-swift.md): [CLI] ModelScope's official training framework for LLMs and multimodal models: the swift command covers pretraining, fine-tuning, RL, inference, evaluation, quantization and deployment for 600+ text and 400+ multimodal models, with Megatron parallelism and a web UI. Usually needs a GPU.
- [DVC](https://hebbmind.com/ja/cli/dvc.md): [CLI] Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change.
- [monolith](https://hebbmind.com/ja/cli/monolith.md): [CLI] Bundles a whole web page with its CSS, images, fonts and scripts into a single HTML file that opens offline exactly as it looked, good for archiving pages or handing them to an agent for offline analysis. It does not run JavaScript, so pre-render dynamic pages with a headless browser.
- [F5-TTS](https://hebbmind.com/ja/cli/f5-tts.md): [CLI] Open-source zero-shot TTS via f5-tts_infer-cli: from a few seconds of reference audio it reads Chinese or English text in the same voice, handy for lessons and videos. Needs Python, PyTorch and FFmpeg, ideally a GPU. Pretrained models are non-commercial; get consent before cloning a voice.
- [Prompt Master](https://hebbmind.com/ja/skill/prompt-master.md): [Skill] Writes precise prompts for a specific AI tool: identifies the target tool, extracts your intent, asks at most three questions if details are missing, then outputs a lean, paste-ready prompt. Covers dozens of tools including ChatGPT, Claude Code, Cursor, Midjourney and Sora.
- [Skill Seekers](https://hebbmind.com/ja/cli/skill-seekers.md): [CLI] Turns 18 kinds of sources, including doc sites, GitHub repos, PDFs and videos, into skill packages for Claude and other platforms, or exports RAG chunks and vector store data. Optional MCP server, and it can call a local agent like Claude Code to enrich content. Needs Python 3.10+.
- [Apify MCP Server](https://hebbmind.com/ja/mcp/apify-mcp-server.md): [MCP] Lets agents call thousands of ready-made scrapers and automation Actors from Apify Store to pull data from social media, search engines, maps, e-commerce sites and more. Maintained by Apify; needs an Apify account (OAuth) or API token.
- [AI Research Skills](https://hebbmind.com/ja/plugin/ai-research-skills.md): [Plugin] Plugin marketplace for AI research with nearly 100 skills in 23 categories, from ideation, fine-tuning and post-training to distributed training, inference serving, evaluation and paper writing, coordinated end to end by the autoresearch skill.
- [AI Research Skills](https://hebbmind.com/ja/skill/ai-research-skills.md): [Skill] Nearly 100 skills spanning the AI research workflow: ideation and literature review, fine-tuning and post-training, distributed training, inference serving, evaluation, interpretability and paper writing, tied together by an autoresearch orchestration skill.
- [dbt](https://hebbmind.com/ja/cli/dbt.md): [CLI] Command-line framework for warehouse modeling and ELT transformations: write models in SQL and let dbt handle dependencies, data tests and documentation. v2 is rewritten in Rust as a single binary. Maintained by dbt Labs; needs a data warehouse connection.
- [ARS-Codex](https://hebbmind.com/ja/plugin/academic-research-skills-codex.md): [Plugin] Codex-native version of Academic Research Skills: one skill chains topic selection and literature review, drafting, simulated peer review, revision guidance and experiment planning, with citation verification and integrity checks. For grad students and faculty. Needs Codex; CC BY-NC 4.0 license.
- [pgcli](https://hebbmind.com/ja/cli/pgcli.md): [CLI] PostgreSQL command-line client with smart autocompletion and syntax highlighting. Compatible with psql environment variables, and -c runs a statement and exits, so agents can query databases non-interactively.
- [LLM](https://hebbmind.com/ja/cli/llm.md): [CLI] Simon Willison's LLM CLI and Python library: call OpenAI, Claude, Gemini and local models from the terminal, with conversations logged to SQLite automatically, plus embeddings, structured extraction, tool calling and a plugin system.
- [Trae Agent](https://hebbmind.com/ja/cli/trae-agent.md): [CLI] ByteDance's open-source, general software engineering agent: trae-cli edits files and runs commands from natural language, supports multiple model providers and MCP, and records full execution trajectories. Transparent design suits agent research and customization. Needs your own model API key.
- [Arize Phoenix MCP Server](https://hebbmind.com/ja/mcp/phoenix-mcp.md): [MCP] Connects to the Arize Phoenix observability platform so agents can query LLM traces and sessions, manage prompts, browse datasets and read experiment evaluation results. Maintained by Arize; needs a self-hosted or cloud Phoenix instance.
- [mycli](https://hebbmind.com/ja/cli/mycli.md): [CLI] MySQL terminal client with smart autocompletion and syntax highlighting, also compatible with MariaDB and TiDB. Supports --execute and batch mode with CSV or table output, so agents can run SQL directly.
- [Presidio CLI](https://hebbmind.com/ja/cli/presidio.md): [CLI] Scans files and directories for personal data such as names, emails and credit card numbers using Presidio Analyzer, with configurable entity types, confidence thresholds and ignore rules. Needs Python 3.10+ and a spaCy language model.
- [Datasette](https://hebbmind.com/ja/cli/datasette.md): [CLI] Publishes SQLite databases as browsable, queryable web pages and JSON APIs, with SQL queries, metadata and plugins, and deploys to Cloud Run and other platforms with datasette publish. Great for data exploration and data journalism. Needs Python 3.10+.
- [Supervisor-Skills](https://hebbmind.com/ja/skill/supervisor-skills.md): [Skill] Twelve research skills from Prof. Yuyu Luo's team at HKUST (Guangzhou), built on a decade of top-venue publishing and reviewing: idea evaluation, intro and body writing, polishing, surveys, pre-submission review, figures, Draw.io rebuilds and rebuttals. Non-commercial license.
- [Hugging Face LLM Trainer](https://hebbmind.com/ja/skill/huggingface-llm-trainer.md): [Skill] Lets agents fine-tune language and vision models with TRL or Unsloth on Hugging Face Jobs cloud GPUs, supporting SFT, DPO, GRPO and reward models, and convert results to GGUF for local use. Requires an HF Pro or higher paid plan. Maintained by Hugging Face.
- [Hugging Face Skills](https://hebbmind.com/ja/plugin/huggingface-skills.md): [Plugin] Lets agents work with the Hugging Face Hub through the hf CLI: search and download models and datasets, manage repos and Spaces, and run training and evaluation jobs on cloud GPUs, with more workflow skills installable as needed. Maintained by Hugging Face.
- [Hugging Face CLI (hf-cli)](https://hebbmind.com/ja/skill/hf-cli.md): [Skill] Teaches agents the Hugging Face Hub CLI hf: search and download models, manage datasets, Spaces, Buckets and repos, and run Jobs and inference endpoints. The skill content is generated from your local CLI, so install hf first. Maintained by Hugging Face.
- [Hugging Face Skills](https://hebbmind.com/ja/skill/huggingface-skills.md): [Skill] Hugging Face's official skills: manage Hub models and datasets with the hf CLI, fine-tune language and vision models, run model evaluations, and build Gradio apps deployed to Spaces. Needs an HF account; cloud training on HF Jobs requires a paid plan.
- [MCP Inspector](https://hebbmind.com/ja/cli/inspector.md): [CLI] The official MCP debugging tool: connect to any MCP server through a web UI, CLI or terminal UI to list and call its tools, resources and prompts. CLI mode outputs JSON, suited to scripts and CI smoke tests.
- [usql](https://hebbmind.com/ja/cli/usql.md): [CLI] Universal psql-style SQL command line: one tool to connect to PostgreSQL, MySQL, SQLite, SQL Server, Oracle and dozens of other SQL and NoSQL databases, with support for copying data between databases.
- [Feynman](https://hebbmind.com/ja/cli/feynman.md): [CLI] Open-source research agent: one command runs literature reviews, deep research, paper reviews, paper-code consistency checks and replication plans, searching arXiv, PubMed and more with sources recorded. Good for grad students writing reviews. Run feynman setup to sign in to a model provider.
- [Miller](https://hebbmind.com/ja/cli/miller.md): [CLI] Processes CSV, TSV, JSON and other structured data like awk, sed, cut, join and sort, but by field name, for cleaning, aggregation, format conversion and pretty-printing. The command is mlr; written in Go with no runtime dependencies.
- [SQLFluff](https://hebbmind.com/ja/cli/sqlfluff.md): [CLI] Linter and formatter for 20+ SQL dialects that auto-fixes most issues and handles Jinja templating and dbt projects (dbt needs a plugin), suited to warehouse code review and CI.
- [AWS HealthLake MCP Server](https://hebbmind.com/ja/mcp/healthlake-mcp-server.md): [MCP] Official AWS MCP for managing FHIR health data in AWS HealthLake: CRUD, advanced search, full patient records, and import and export, with a read-only mode to prevent changes. Needs an AWS account, a paid HealthLake data store and local AWS credentials; clinical conclusions need professional review.
- [Defuddle](https://hebbmind.com/ja/cli/defuddle.md): [CLI] Extracts the main content of a web page, stripping comments, sidebars, headers and footers, and outputs clean HTML or Markdown with metadata like title, author and publish date, saving tokens when agents read the web. Built for Obsidian Web Clipper by kepano; still in development.
- [garak](https://hebbmind.com/ja/cli/garak.md): [CLI] NVIDIA's open-source LLM vulnerability scanner that probes for prompt injection, jailbreaks, data leakage, hallucination and harmful content, supporting OpenAI, Hugging Face, Bedrock and most REST-accessible models. Scanning cloud models needs their API keys.

Next page: https://hebbmind.com/ja/tools.md?page=4&profession=algorithm%2Cdata-engineering%2Cresearch
