Tools

Official MCP reference server that fetches web pages and converts them to Markdown for the model, reading long pages in chunks from a given offset. Zero config, but it can reach internal network addresses, so use it with care.

Bundles a whole web page with its CSS, images, fonts and scripts into a single HTML file that opens offline exactly as it looked, good for archiving pages or handing them to an agent for offline analysis. It does not run JavaScript, so pre-render dynamic pages with a headless browser.

Extracts the main content of a web page, stripping comments, sidebars, headers and footers, and outputs clean HTML or Markdown with metadata like title, author and publish date, saving tokens when agents read the web. Built for Obsidian Web Clipper by kepano; still in development.

Python library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline.

One command extracts or summarizes web pages, PDFs, YouTube videos, podcasts and media files, with JSON output. Summaries can use many model APIs, local models or a logged-in Codex or Claude CLI; plain extraction needs no key. Also has a browser sidebar extension.

Gives agents Exa web search and page content fetching, with an optional multi-step research agent and advanced filtered search. Maintained by Exa; the hosted service works anonymously with limits, and signing in or adding an API key raises them.

Converts PDF, Word, Excel, PowerPoint, images, audio, web pages and YouTube transcripts into Markdown that agents can read and cite. Built on Microsoft MarkItDown; the Docker image lacks audio transcription and image recognition, so build locally for full features.

Four tools for real-time web search, page content extraction, site mapping and full-site crawling, available as a remote server or run locally. Maintained by Tavily; needs an API key or OAuth sign-in, and a free account is available.

Multi-engine web search MCP with no API key, supporting Bing, DuckDuckGo, Brave, Baidu, Sogou, CSDN, Juejin and more; also fetches page content, CSDN articles and GitHub READMEs. Ships a CLI and a local server too.

Web search through DuckDuckGo plus fetching and parsing page content, with built-in rate limiting and LLM-friendly result formatting. No API key needed; runs with a single uvx command.

A plugin marketplace with dozens of plugins: an enhanced skill-creator, scrapers for Bilibili, Douban and Feishu docs, China A-share news and US stock fundamentals, WeCom notifications, deep research and fact-checking, with docs in English and Chinese.

Web search and page reading for agents through a self-hosted or trusted SearXNG metasearch instance, with no paid search API key. Requires a SearXNG instance with JSON output enabled.

Jina AI's official remote MCP: converts web pages and PDFs to Markdown, searches the web, arXiv, SSRN and images, and offers screenshots, reranking and semantic dedup. Reading tools work without a key (rate-limited); search and rerank need a Jina API key.

Official Firecrawl skill: drives the Firecrawl CLI to search, scrape, map site URLs, batch-crawl, interact with pages and monitor changes, returning LLM-ready Markdown. Search and scrape have a rate-limited free tier; crawling and monitoring need an account or self-hosted instance.

Turns web pages, long PDFs, Word files, images or code into tutor-style study notes: Markdown notes plus searchable HTML knowledge cards with concept breakdowns and mind maps. Needs Python 3.8+, plus Chrome for some sites; the optional tutor chat needs an OpenAI-compatible API key.

Give it a YouTube video, web article or PDF link and it extracts the transcript or text, then builds a five-round Ship-Learn-Next action plan saved as Markdown, for self-study. Needs CLI tools such as yt-dlp and pdftotext; videos default to English subtitles.

Official Tavily skills: let agents search the web, extract page content, discover site URLs, crawl in bulk and run cited deep research through the Tavily CLI (tvly). Install the CLI first; search and extract have a limited no-login tier, other features need sign-in or an API key.

Firecrawl's official plugin: brings the Firecrawl CLI in as skills so Claude Code can search the web, scrape pages to Markdown, map site links or crawl whole sites. Install firecrawl-cli and set an API key first; self-hosting supported.

16 official Firecrawl skills that turn web scraping into deliverables: competitor pricing and feature tracking, market and industry reports, pre-meeting account research, lead lists, SEO audits and literature reviews. Needs a Firecrawl API key plus its CLI or MCP.