# Tools > Every listed resource, editors’ picks first. The filters below can be combined. - Search: append `?q=` to the URL. Separate several keywords with spaces; all of them must match. Matches name, repository, tags, professions, description and README. - Filter by type: append `?type=` to the URL. - Filter by profession: append `?profession=` to the URL. Separate several ids with commas; a resource matches when it suits any of them. Ids are listed at https://hebbmind.com/api/v1/professions - Filter by tag: append `?tag=` to the URL. Separate several tags with commas; a resource must carry all of them. Tags are listed at https://hebbmind.com/api/v1/tags Resources for Full-stack / Indie or DevOps / SRE or ML / AI, Tagged `data-pipelines`: 10 items. > - Full-stack / Indie: General software work: coding-agent workflows, code review, debugging and Git collaboration. > - DevOps / SRE: Deployment, monitoring, cloud resources and reliability. > - ML / AI: Model training, evaluation and LLM application development. - [Crawl4AI](https://hebbmind.com/cli/crawl4ai.md): [CLI] Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host. - [jq](https://hebbmind.com/cli/jq.md): [CLI] Lightweight command-line JSON processor that slices, filters, maps and transforms JSON with concise expressions and no runtime dependencies. A staple for agents parsing API responses and logs. - [DVC](https://hebbmind.com/cli/dvc.md): [CLI] Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change. - [Apify MCP Server](https://hebbmind.com/mcp/apify-mcp-server.md): [MCP] Lets agents call thousands of ready-made scrapers and automation Actors from Apify Store to pull data from social media, search engines, maps, e-commerce sites and more. Maintained by Apify; needs an Apify account (OAuth) or API token. - [Miller](https://hebbmind.com/cli/miller.md): [CLI] Processes CSV, TSV, JSON and other structured data like awk, sed, cut, join and sort, but by field name, for cleaning, aggregation, format conversion and pretty-printing. The command is mlr; written in Go with no runtime dependencies. - [dasel](https://hebbmind.com/cli/dasel.md): [CLI] Query, modify and convert JSON, YAML, TOML, XML, CSV, HCL, INI and more with one selector syntax, editing config files in place or converting between formats, handy for agents handling structured data in scripts. A single dependency-free binary that works much like jq or yq. - [Trafilatura](https://hebbmind.com/cli/trafilatura.md): [CLI] Python library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline. - [Astronomer Data Agents](https://hebbmind.com/plugin/astronomer-agents.md): [Plugin] Astronomer's official data engineering plugin: write Airflow DAGs to best practices, debug pipeline failures, trace data lineage, profile warehouse tables and migrate from Airflow 2 to 3, with a built-in Airflow MCP server and session hooks. - [Databricks Agent Skills](https://hebbmind.com/skill/databricks-agent-skills.md): [Skill] Official Databricks skills guiding agents to build Lakeflow pipelines and jobs, Apps, Lakebase, Vector Search, Model Serving and AI/BI dashboards on the lakehouse. Needs the Databricks CLI. - [Databricks Agent Skills](https://hebbmind.com/plugin/databricks-agent-skills.md): [Plugin] Official Databricks plugin with skills for the CLI and auth, Genie data queries, Apps, Lakebase, Lakeflow jobs and pipelines, Model Serving and DABs deployment, plus hooks for prompt routing, session context and auth failure hints. Needs a Databricks account.