WebReaper MCP server
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
148 stars
Reviews
Write oneNobody has reviewed WebReaper yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
WebReaper tools
No tool declarations could be read from the package source. They show once the server is installed.
Public scan report
scanner v0.1.9 · 2026-09-26 · same rubric, same numbers if you re-run it
- –Code scanpackage could not be scannedn/a
- –Live reliabilityno gateway calls yet and no remote to proben/a
- –Tool poisoningtools not inspected (local package is not executed); not countedn/a
- Auth qualitylocal package, no credentials required12/15
- Maintenancelast push 0 days ago15/15
- Maintainer identityregistry namespace matches repository owner; GitHub account older than a year8/10
What the publisher says
From the WebReaper repository's README, as published. We do not edit it. Read it on GitHub
WebReaper
AI-native web scraper. Single binary with a bundled Claude Code skill.
Built by HighCraft.io.
Install
macOS / Linux (Homebrew):
brew install alex-on-ai/webreaper/webreaperAny POSIX shell (install.sh):
curl -fsSL https://raw.githubusercontent.com/alex-on-ai/WebReaper/master/scripts/install.sh | sh.NET library:
dotnet add package WebReaperWindows binaries are on the GitHub Releases page; winget and Scoop are on the v10.1 roadmap.
Updating: brew upgrade webreaper (Homebrew), or re-run the install.sh line with --upgrade appended (| sh -s -- --upgrade), or dotnet add package WebReaper (library). When a newer release exists, scrape / crawl / map print a one-line upgrade hint on stderr (interactive terminals only, never in a pipe or CI); disable that check with WEBREAPERNOUPDATE_CHECK=1.
30-second demo
$ webreaper scrape https://news.ycombinator.com
# Hacker News
- [Show HN: ...](https://news.ycombinator.com/item?id=...)
- [Ask HN: ...](https://news.ycombinator.com/item?id=...)
...
$ webreaper init
Wrote WebReaper Agent Skill to .claude/skills/webreaper/SKILL.md
Try it out:
webreaper scrape https://example.com
webreaper map https://example.comAfter webreaper init, the next Claude Code session picks up the skill and routes scraping intents ("give me the markdown of X", "what blog posts are on Y", "scrape the top 5 articles") to webreaper automatically.
Table of contents
- Why WebReaper
- Quick start
- Bot protection that just works
- Power your agent
- AI features
- Use cases
- Packages
- Compared to Firecrawl, Crawl4AI, and Crawlee
- API overview
- Architecture and interfaces
- Repository structure
- License
Why WebReaper
🪶 Drop on PATH, run.No Docker, no Postgres, no signup. ~12 MB binary. 🤖 AI-native by composition.Markdown by default. Schema extraction, LLM fallback, self-healing selectors, autonomous agent. Stack with .With…(). 🔌 Bring any LLM.OpenAI, Anthropic, Ollama, Azure OpenAI, llamafile, via Microsoft.Extensions.AI. 🛡 Bot-checks handled automatically.A blocked page climbs HTTP → browser → stealth on its own, per page and host-sticky. Challenge pages are dropped, never returned as data. No flag needed for the browser fallback. 📡 Distributed when needed.Swap scheduler, tracker, sink to Redis, MongoDB, SQLite, Azure Service Bus, Cosmos. Same code. 📜 MIT, not AGPL.Embed in commercial software, fork, modify, redistribute. Firecrawl's AGPL requires open-sourcing your service or paying for a commercial license.
Quick start
CLI
# One page as Markdown
webreaper scrape https://example.com
# Save Markdown to a file
webreaper scrape https://example.com --output page.mdShortened. The full README is on GitHub.
Nothing above is checked by us. What we check is on the safety report.
Install directly
The registry entry has no remote endpoint or installable package.
WebReaper: common questions
- Is WebReaper MCP server safe?
- Yes, by our scan: it is graded A (88/100). Read the WebReaper safety report
- Does WebReaper need an API key?
- Not as far as the registry entry and our scan can tell: no credentials are declared or required.
- Is WebReaper maintained?
- The last commit was in the last day (2026-09-26). The latest release is v11.3.2.
- What can I use instead of WebReaper?
- Servers from other publishers that do the same job: fastCRW MCP server, PyreCrawl MCP server and Crawlberg MCP server. Compare all WebReaper alternatives.
Alternatives to WebReaper
Same job from other publishers: the closest match first, then the best rated.
- fastCRWScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.not reviewedEstablishedA
- PyreCrawlWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.not reviewedGrowingA
- CrawlbergScrape, crawl, and map websites to Markdown or JSON via local CLI.not reviewedGrowingA
- KreuzcrawlScrape, crawl, and map websites to Markdown or JSON via local CLI.not reviewedGrowingA
- NovadaSearch, extract, crawl, map, research, scrape 16 platforms, browser automation, proxy — one API key.not reviewedGrowingA
