Инструменты
Все Skills, MCP-серверы, CLI и плагины каталога. Фильтруйте по типу, профессии или тегу либо ищите по ключевому слову.
Профессия: ML / AI +1
Можно выбрать несколько: показываются ресурсы, подходящие хотя бы для одной из них.
Теги: data-pipelines
Можно выбрать несколько: показываются только ресурсы со всеми выбранными тегами.
6 ресурсов

Crawl4AI
CLIOpen-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.
unclecode/crawl4ai87.6k
Apify MCP Server
MCPLets agents call thousands of ready-made scrapers and automation Actors from Apify Store to pull data from social media, search engines, maps, e-commerce sites and more. Maintained by Apify; needs an Apify account (OAuth) or API token.
apify/apify-mcp-server17.2k
DVC
CLIVersion datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change.
treeverse/dvc16k
Trafilatura
CLIPython library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline.
adbar/trafilatura7.2k
Databricks Agent Skills
SkillOfficial Databricks skills guiding agents to build Lakeflow pipelines and jobs, Apps, Lakebase, Vector Search, Model Serving and AI/BI dashboards on the lakehouse. Needs the Databricks CLI.
databricks/databricks-agent-skills408
Databricks Agent Skills
PluginOfficial Databricks plugin with skills for the CLI and auth, Genie data queries, Apps, Lakebase, Lakeflow jobs and pipelines, Model Serving and DABs deployment, plus hooks for prompt routing, session context and auth failure hints. Needs a Databricks account.
databricks/databricks-agent-skills408