Tag: rag

Converts PDF, Word, Excel, PowerPoint, HTML, images, audio and more into Markdown that keeps headings, lists and tables, ready for LLMs to read and analyze. Maintained by Microsoft; requires Python 3.10+.

Baidu PaddlePaddle's official OCR and document parsing tool: the paddleocr command reads text from images and parses PDFs and scans into Markdown or JSON, supporting 100+ languages with models that run locally.

Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use.

Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host.

Document parser from OpenDataLab that turns PDFs, images and Office files into Markdown or JSON, handling tables, formulas and complex layouts well, with page-by-page reading and citation anchors for agents. Parses locally by default; needs Python 3.10+.

Parses PDF, DOCX, PPTX, XLSX, HTML, images and audio, recovering layout, reading order, tables and formulas, and exports Markdown, HTML or lossless JSON. Started by IBM Research, now hosted by the LF AI & Data Foundation; runs fully locally.

Personalized tutoring system from HKU's HKUDS: build a knowledge base from textbooks for Q&A, step-by-step solutions and quizzes, for teachers and self-learners. The deeptutor command outputs JSON for agents like Claude Code. Needs Python 3.11+, Node.js 20+ and an LLM API key.

Plugin for building LLM apps: LangGraph agents with memory and tool use, hybrid-search RAG, vector index tuning, prompt optimization and LLM evaluation. Includes 3 subagents and 8 skills.

Converts PDFs, images, PPTX, DOCX, XLSX, EPUB and more into Markdown, JSON or HTML, preserving tables, formulas and layout, with optional LLM help for higher accuracy. Needs Python 3.10+ and PyTorch; large-scale commercial use of the model weights needs a paid license.

Official CLI for Tencent's open-source knowledge base platform WeKnora: upload documents, manage knowledge bases, run hybrid search and answer questions from them, or serve as a read-only MCP. Needs your own WeKnora deployment and a source build with Go 1.26+.

Runs the cognee memory engine as an MCP server whose remember, recall and forget tools write documents and conversations into a knowledge graph and vector store for cross-session retrieval. Start it with Docker or uv first; needs an LLM API key by default, or connect to Cognee Cloud.

Writes conversations and business data into Graphiti's temporal knowledge graph so agents can retrieve long-term memory by entity, fact and time. Open source from Zep; start FalkorDB or Neo4j and the server with Docker first, and configure an LLM API key.

AI2's tool for converting PDFs and scans to Markdown with a vision LLM, handling equations, tables, handwriting and multi-column layouts, suited to bulk digitizing papers and archives. Local runs need an NVIDIA GPU with 12GB+ VRAM; otherwise use a paid OpenAI-compatible remote endpoint.

Turns 18 kinds of sources, including doc sites, GitHub repos, PDFs and videos, into skill packages for Claude and other platforms, or exports RAG chunks and vector store data. Optional MCP server, and it can call a local agent like Claude Code to enrich content. Needs Python 3.10+.

Nearly 100 skills spanning the AI research workflow: ideation and literature review, fine-tuning and post-training, distributed training, inference serving, evaluation, interpretability and paper writing, tied together by an autoresearch orchestration skill.

From Zilliz: indexes your codebase as vectors in Milvus or Zilliz Cloud so coding agents find relevant code by semantic search, cutting context costs in large repos. Needs an embedding model (OpenAI, VoyageAI, Ollama and others) and a vector database.

High-accuracy retrieval-augmented Q&A over paper PDFs, text and Office documents, filling in citation metadata, checking retractions and attaching traceable sources to answers. Provides the pqa CLI and a Python library. Needs an LLM API key by default; local models can be configured.

NVIDIA's official, verified catalog of hundreds of skills covering CUDA-X libraries, NeMo training, NIM and Dynamo inference, RAG blueprints, Jetson, Omniverse and robotics simulation. The install adds only nvidia-skill-finder, which recommends other skills and installs them once you confirm.

Uses the Qdrant vector database as a semantic memory layer for agents: store information and retrieve it by meaning, connecting to a remote instance or a local path, with FastEmbed generating embeddings by default. Maintained by Qdrant.

LangChain's official skill collection: framework selection, quickstarts, middleware, persistence, human-in-the-loop approval, RAG and eval design across LangChain, LangGraph and Deep Agents, in Python and TypeScript. Also installable as a Claude Code plugin. Still in early development.

Jina AI's official remote MCP: converts web pages and PDFs to Markdown, searches the web, arXiv, SSRN and images, and offers screenshots, reranking and semantic dedup. Reading tools work without a key (rate-limited); search and rerank need a Jina API key.

The Docling project's official MCP: converts PDF, Word, PowerPoint and more into structured documents with layout and table detection and OCR for scans, and lets agents build new documents paragraph by paragraph and export Markdown. Local mode needs Python and uv, or use your own Docling Serve.

Chroma's official MCP: lets agents create and manage collections, add documents, and retrieve them with vector search, full-text search and metadata filters. Connects to in-memory or local persistent stores, self-hosted instances or Chroma Cloud.

Free remote MCP for Taiwan law (no sign-up or key): semantic search over 22M+ court rulings and administrative interpretations, exact statute lookup, and rulings linked across court levels with a citation whitelist to catch fake cites. Browser authorization on first use; have a lawyer review.