Инструменты

Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use.

Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.

Turns 18 kinds of sources, including doc sites, GitHub repos, PDFs and videos, into skill packages for Claude and other platforms, or exports RAG chunks and vector store data. Optional MCP server, and it can call a local agent like Claude Code to enrich content. Needs Python 3.10+.

LangChain's official skill collection: framework selection, quickstarts, middleware, persistence, human-in-the-loop approval, RAG and eval design across LangChain, LangGraph and Deep Agents, in Python and TypeScript. Also installable as a Claude Code plugin. Still in early development.

The Docling project's official MCP: converts PDF, Word, PowerPoint and more into structured documents with layout and table detection and OCR for scans, and lets agents build new documents paragraph by paragraph and export Markdown. Local mode needs Python and uv, or use your own Docling Serve.