# Tools

> Every listed resource, editors’ picks first. The filters below can be combined.

- Search: append `?q=<keywords>` to the URL. Separate several keywords with spaces; all of them must match. Matches name, repository, tags, professions, description and README.
- Filter by type: append `?type=<cli|skill|plugin|mcp>` to the URL.
- Filter by profession: append `?profession=<profession id>` to the URL. Separate several ids with commas; a resource matches when it suits any of them. Ids are listed at https://hebbmind.com/api/v1/professions
- Filter by tag: append `?tag=<tag>` to the URL. Separate several tags with commas; a resource must carry all of them. Tags are listed at https://hebbmind.com/api/v1/tags

Resources for Data engineering or Security: 150 items.

> - Data engineering: Data pipelines, warehouse modeling, ETL and data quality.
> - Security: Code audits, vulnerability triage, penetration testing and compliance.

- [MarkItDown](https://hebbmind.com/de/cli/markitdown.md): [CLI] Converts PDF, Word, Excel, PowerPoint, HTML, images, audio and more into Markdown that keeps headings, lists and tables, ready for LLMs to read and analyze. Maintained by Microsoft; requires Python 3.10+.
- [DuckDB](https://hebbmind.com/de/cli/duckdb.md): [CLI] In-process analytical SQL database. Its CLI queries CSV, Parquet and JSON files directly with SQL, no import or server needed, so agents can sample and aggregate large files. Officially maintained.
- [Claude Security](https://hebbmind.com/de/plugin/claude-security.md): [Plugin] Orchestrates subagents in-session to map the architecture, build a threat model and hunt for vulnerabilities. Every finding is independently verified before it goes in the report, which also comes as SARIF, and optional patch files are left for you to apply. Official Anthropic plugin.
- [MCP Toolbox for Databases](https://hebbmind.com/de/mcp/mcp-toolbox.md): [MCP] Google's open-source database MCP server with ready-made query and SQL tools for dozens of sources, including PostgreSQL, MySQL, BigQuery, Spanner and MongoDB. Define controlled custom queries in tools.yaml.
- [Trail of Bits Skills](https://hebbmind.com/de/skill/trailofbits-skills.md): [Skill] Skills from security firm Trail of Bits: 40+ plugins for code auditing, CodeQL and Semgrep static analysis, differential review, smart-contract and cryptography audits, fuzzing and more. Also installable as a Claude Code or Codex plugin marketplace.
- [ECC](https://hebbmind.com/de/plugin/ecc.md): [Plugin] A complete harness for coding agents: dozens of subagents, nearly 300 skills, hooks, rules, memory and continuous learning, plus the AgentShield security scanner. Built mainly for Claude Code, with Codex support.
- [PaddleOCR](https://hebbmind.com/de/cli/paddleocr.md): [CLI] Baidu PaddlePaddle's official OCR and document parsing tool: the paddleocr command reads text from images and parses PDFs and scans into Markdown or JSON, supporting 100+ languages with models that run locally.
- [uv](https://hebbmind.com/de/cli/uv.md): [CLI] Astral's extremely fast Python package and project manager written in Rust, replacing pip, pipx, poetry, pyenv and more. Supports lockfiles and multiple Python versions, and uvx runs Python tools without installing them.
- [Scrapling](https://hebbmind.com/de/mcp/scrapling.md): [MCP] MCP server built into the adaptive Python scraping framework Scrapling: supports plain HTTP requests, browser rendering and stealth fetching, and uses CSS selectors to pass only the target content to the AI, saving tokens and filtering out prompt injection.
- [Scrapling](https://hebbmind.com/de/cli/scrapling.md): [CLI] Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use.
- [Crawl4AI](https://hebbmind.com/de/cli/crawl4ai.md): [CLI] Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.
- [MinerU](https://hebbmind.com/de/cli/mineru.md): [CLI] Document parser from OpenDataLab that turns PDFs, images and Office files into Markdown or JSON, handling tables, formulas and complex layouts well, with page-by-page reading and citation anchors for agents. Parses locally by default; needs Python 3.10+.
- [Tesseract OCR](https://hebbmind.com/de/cli/tesseract.md): [CLI] Classic open-source OCR engine and CLI that reads text from images and outputs plain text, hOCR, searchable PDF or TSV. Supports 100+ languages; install the language data for each language you need.
- [Docling](https://hebbmind.com/de/cli/docling.md): [CLI] Parses PDF, DOCX, PPTX, XLSX, HTML, images and audio, recovering layout, reading order, tables and formulas, and exports Markdown, HTML or lossless JSON. Started by IBM Research, now hosted by the LF AI & Data Foundation; runs fully locally.
- [rclone](https://hebbmind.com/de/cli/rclone.md): [CLI] 'rsync for cloud storage': sync and copy files across dozens of providers such as S3, Google Drive, OneDrive and Alibaba Cloud OSS, with encryption and mounting. Set up remotes with rclone config before use.
- [Agentic Awesome Skills](https://hebbmind.com/de/skill/agentic-awesome-skills.md): [Skill] Collection of 2,400+ installable SKILL.md skills across development, security, cloud and ops, AI, marketing and more, with the AAS Core local MCP and an installer that help agents search, pick skills and preview install plans. Formerly antigravity-awesome-skills.
- [aria2](https://hebbmind.com/de/cli/aria2.md): [CLI] Lightweight multi-protocol command-line downloader that fetches in parallel segments from multiple sources over HTTP(S), FTP, SFTP, BitTorrent and Metalink. Resumes downloads, reads URLs in bulk from text files and offers a JSON-RPC interface for scripts or agents.
- [Data Engineering](https://hebbmind.com/de/plugin/data-engineering.md): [Plugin] Data engineering plugin from the wshobson/agents marketplace: a data engineer subagent, a data pipeline command, and skills for Airflow DAGs, dbt transformations, Spark tuning and data quality, to help build ETL and data warehouses.
- [wshobson/agents](https://hebbmind.com/de/plugin/wshobson-agents.md): [Plugin] Multi-host plugin marketplace with 90+ single-purpose plugins, 200+ subagents and 180+ skills covering language-specific development, ops, security, data and multi-agent orchestration. Installing a plugin loads only that plugin's content.
- [Machine Learning Ops](https://hebbmind.com/de/plugin/machine-learning-ops.md): [Plugin] MLOps plugin from the wshobson/agents marketplace: data scientist, ML engineer and MLOps engineer subagents and a /ml-pipeline command that runs the pipeline in phases from data analysis and training to deployment and monitoring, plus ML pipeline and recommender system skills.
- [Security Scanning](https://hebbmind.com/de/plugin/security-scanning.md): [Plugin] Security plugin from the wshobson/agents marketplace: commands for SAST, dependency vulnerability scanning and hardening, security auditor and threat modeling subagents, and threat analysis skills such as STRIDE and attack trees.
- [wshobson/agents](https://hebbmind.com/de/skill/wshobson-agents.md): [Skill] The 180+ skills bundled with the 90+ plugins in the wshobson/agents marketplace, covering development across many languages and frameworks, testing, ops, security, data and LLM apps. Install individually with npx skills or gh skill; skills only, without subagents or commands.
- [GDPR Data Handling](https://hebbmind.com/de/skill/gdpr-data-handling.md): [Skill] EU GDPR compliance skill covering lawful bases, consent management, access and deletion requests, data retention and breach notification, with checklists and sample code so legal and engineering can review privacy together. No account or API key; have a lawyer check conclusions.
- [Nushell](https://hebbmind.com/de/cli/nushell.md): [CLI] Cross-platform shell built around structured data: pipelines pass tables instead of plain text, and you can open and query JSON, CSV, TOML and more directly. Default builds include nu --mcp, which serves it to agents as an MCP server.
- [Marker](https://hebbmind.com/de/cli/marker.md): [CLI] Converts PDFs, images, PPTX, DOCX, XLSX, EPUB and more into Markdown, JSON or HTML, preserving tables, formulas and layout, with optional LLM help for higher accuracy. Needs Python 3.10+ and PyTorch; large-scale commercial use of the model weights needs a paid license.
- [Security Guidance](https://hebbmind.com/de/plugin/security-guidance.md): [Plugin] Three layers of security checks on agent-written code: rule-based warnings on about 25 risky patterns during edits, a model review of the diff at turn end, and an agent tracing cross-file bugs like IDOR and SSRF at commit. Official Anthropic plugin; needs Python 3.8+ and model API access.
- [Pyright LSP](https://hebbmind.com/de/plugin/pyright-lsp.md): [Plugin] Connects Claude Code to the Pyright language server for static type checking and code intelligence in Python. Install pyright first with npm, pip or pipx. Official Anthropic plugin.
- [Trivy](https://hebbmind.com/de/cli/trivy.md): [CLI] All-in-one security scanner for container images, filesystems, Git repos and Kubernetes clusters: finds known vulnerabilities, IaC misconfigurations, leaked secrets and software licenses, and generates SBOMs. Open source, maintained by Aqua Security.
- [Lightpanda Browser](https://hebbmind.com/de/cli/browser.md): [CLI] Headless browser written from scratch in Zig for AI agents and automation, using less memory and running faster than headless Chrome in official benchmarks. fetch turns pages into Markdown, and it can serve CDP or MCP. Telemetry is on by default (an env var disables it); Windows needs WSL.
- [Vault](https://hebbmind.com/de/cli/vault.md): [CLI] HashiCorp's secrets management system: the vault CLI reads and writes secrets, issues dynamic database and cloud credentials on demand, encrypts and decrypts data, and manages leases and revocation. Needs a reachable Vault server.
- [jq](https://hebbmind.com/de/cli/jq.md): [CLI] Lightweight command-line JSON processor that slices, filters, maps and transforms JSON with concise expressions and no runtime dependencies. A staple for agents parsing API responses and logs.
- [Anthropic Cybersecurity Skills](https://hebbmind.com/de/skill/anthropic-cybersecurity-skills.md): [Skill] Community-maintained cybersecurity skill library: 800+ skills across 34 domains including threat hunting, incident forensics, penetration testing and cloud security, mapped to MITRE ATT&CK and NIST CSF. Not by Anthropic; offensive skills are for authorized testing only.
- [Nuclei](https://hebbmind.com/de/cli/nuclei.md): [CLI] Fast vulnerability scanner driven by YAML templates: uses a community template library to detect known vulnerabilities over HTTP, DNS, TCP, SSL and more, supports custom templates and plugs into CI/CD. Use only on targets you're authorized to test.
- [Gitleaks](https://hebbmind.com/de/cli/gitleaks.md): [CLI] Detects hardcoded passwords, API keys and tokens in Git repos, files and stdin, and can run as a pre-commit hook or GitHub Action to block leaks. Now feature-frozen with security fixes only, as the author has moved on to Betterleaks.
- [Compliance Tracking](https://hebbmind.com/de/skill/compliance-tracking.md): [Skill] Compliance skill from Anthropic's official operations plugin: maps controls, owners and evidence for SOC 2, ISO 27001, GDPR, HIPAA and PCI DSS, schedules audits, runs gap analyses, and outputs audit-readiness checklists and evidence collection plans. Have legal or compliance experts review.
- [Data](https://hebbmind.com/de/plugin/data.md): [Plugin] Data analysis plugin: writes queries in each SQL dialect, explores datasets, runs statistical tests, charts with Python and builds interactive HTML dashboards, then reviews methods and conclusions before sharing. Connects to Snowflake, BigQuery and other warehouses. Official from Anthropic.
- [SQL Queries](https://hebbmind.com/de/skill/sql-queries.md): [Skill] Anthropic's official data skill that guides agents to write, translate and optimize SQL across Snowflake, BigQuery, Databricks, PostgreSQL and other warehouse dialects, including CTEs, window functions and analytical aggregations.
- [TruffleHog](https://hebbmind.com/de/cli/trufflehog.md): [CLI] Finds leaked credentials in Git, GitHub, S3, filesystems and more, recognizing 800+ secret types and checking with each service whether a key is still live to cut false positives.
- [promptfoo](https://hebbmind.com/de/cli/promptfoo.md): [CLI] CLI and library for evaluating and red-teaming LLM apps: compare prompts and model outputs in bulk, scan for security vulnerabilities and plug into CI/CD, with evals running locally. Now part of OpenAI and still open source under MIT.
- [radare2](https://hebbmind.com/de/cli/radare2.md): [CLI] Open-source reverse engineering framework and CLI: disassemble, debug, emulate and patch binaries across many architectures and file formats, scriptable through r2pipe or built-in JavaScript.
- [SOPS](https://hebbmind.com/de/cli/sops.md): [CLI] Encrypts secret values in YAML, JSON, ENV and INI config files using AWS, GCP or Azure KMS, age or PGP, so secrets can be safely committed to Git alongside code. A CNCF sandbox project.
- [BigQuery Basics](https://hebbmind.com/de/skill/bigquery-basics.md): [Skill] Manages BigQuery datasets, tables and jobs with the bq and gcloud CLIs, runs SQL queries and loads data, with references for client libraries, MCP and Terraform. Google's official skill; requires a Google Cloud project.
- [Google Agent Skills](https://hebbmind.com/de/skill/google-google-skills.md): [Skill] Google's official skill library, focused on Google Cloud: 100+ skills for gcloud, Cloud Run, GKE, BigQuery, IAM, monitoring and logging, and the Well-Architected Framework, plus Ads and Analytics.
- [Google Skills](https://hebbmind.com/de/plugin/google-skills.md): [Plugin] Google's official skill library and plugin marketplace: nearly 150 skills focused on Google Cloud (GKE, BigQuery, Cloud Run, IAM and more), plus 17 product plugins pairing skills with MCP for Cloud SQL, Spanner, AlloyDB, BigQuery, GCS and others.
- [olmOCR](https://hebbmind.com/de/cli/olmocr.md): [CLI] AI2's tool for converting PDFs and scans to Markdown with a vision LLM, handling equations, tables, handwriting and multi-column layouts, suited to bulk digitizing papers and archives. Local runs need an NVIDIA GPU with 12GB+ VRAM; otherwise use a paid OpenAI-compatible remote endpoint.
- [DataX](https://hebbmind.com/de/cli/datax.md): [CLI] Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit.
- [Semgrep](https://hebbmind.com/de/cli/semgrep.md): [CLI] Semantic multi-language static analysis: find vulnerabilities and bugs with rules that look like source code, across 30+ languages with custom rules. Scans locally by default without uploading code; cross-file analysis and Pro rules require sign-in.
- [Semgrep MCP](https://hebbmind.com/de/mcp/semgrep-mcp.md): [MCP] Semgrep's official MCP server, now part of the main semgrep repo and started with semgrep mcp: lets agents run static security scans, find issues with custom rules and inspect syntax trees. Requires the Semgrep CLI; connecting to the AppSec platform needs SEMGREP_APP_TOKEN.
- [DVC](https://hebbmind.com/de/cli/dvc.md): [CLI] Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change.
- [monolith](https://hebbmind.com/de/cli/monolith.md): [CLI] Bundles a whole web page with its CSS, images, fonts and scripts into a single HTML file that opens offline exactly as it looked, good for archiving pages or handing them to an agent for offline analysis. It does not run JavaScript, so pre-render dynamic pages with a headless browser.

Next page: https://hebbmind.com/de/tools.md?page=2&profession=data-engineering%2Csecurity
