CrawlEyes MCP Server
io.github.waiky-github/CrawlEyes·v0.2.0·2 starsWeb scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.
2 stars20 downloads/wk
Reviews
Write oneNobody has reviewed CrawlEyes MCP Server yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
CrawlEyes MCP Server tools (4)
write = sends, deletes, buys or postsRead from the package source without running it. The installed server may list more.
deep_research深度调研:把主题拆成子问题→搜索→抓取→合成带引用的报告。 Uses SearXNG → Tavily keyless (no API key). Optional LLM synthesis via CRAWLEYES_LLM_* env vars; without them returns an evidence-aggregate report. Returns JSON with report (Markdown) + sources.
extract抓取网页正文为 Markdown。自动去噪(过滤导航/广告),失败自动重试。 返回前会剥离隐藏文字 + 标记可疑注入,防止 prompt-injection 劫持 Agent。 respect_robots=True 时先检查目标站 robots.txt (RFC 9309),被 Disallow 则拒绝。 format: markdown(默认) | fit | raw | markdown_with_citations。 Returns JSON with title/markdown/length.
search搜索网页。SearXNG 优先,失败自动 fallback Tavily keyless(无需 API key)。 带统一限流 + 指数退避重试(最多 3 次)。 limit 会被 clamp 到 [1, 20],防止传超大值打爆下游。 Returns JSON with title/url/description for each result.
sitemap发现站点 URL 地图。解析 {origin}/sitemap.xml(支持 index/gzip), 缺失时回退 robots.txt 的 Sitemap 声明。返回去重后的 URL 列表 JSON。 用于整站抓取 / deep_research 扩 URL 源。带统一限流。
Public scan report
scanner v0.1.10 · 2026-10-29 · same rubric, same numbers if you re-run it
- Code scan12 source files scanned25/25
- –Live reliabilityno gateway calls yet and no remote to proben/a
- –Tool poisoningtools not inspected (local package is not executed); not countedn/a
- Auth qualitystatic API keys via environment variables6/15
- Maintenancelast push 7 days ago15/15
- Maintainer identityregistry namespace matches repository owner; GitHub account older than a year8/10
How CrawlEyes MCP Server compares
Against every graded Scraping and browsing MCP server, from our own scans and uptime checks. Updated after each scan run.
- Safety score
- 83/100
- higher than 60% of 867 Scraping and browsing servers
- Tools
- 4
- the typical Scraping and browsing server has 6
- Tools that change things
- 0%
- typical: 0%. Fewer write tools means less an agent can break
- GitHub stars
- 2
- more than 65% of 584 Scraping and browsing servers
- Downloads a week
- 20
- more than 4% of 312 Scraping and browsing servers with a package
What its tools let an agent do: 4 read
Install CrawlEyes MCP Server in Claude Code, Cursor or VS Code
claude mcp add CrawlEyes -- uvx crawleyes
What the publisher says
From the CrawlEyes MCP Server repository's README, as published. We do not edit it. Read it on GitHub
CrawlEyes — Web Scraping & Search Toolkit for AI Agents
<!-- MCP Registry metadata: associates this PyPI package with the MCP registry entry. Name must match the mcpName in the registry listing. --> <!-- mcp-name: io.github.waiky-github/CrawlEyes -->
CrawlEyes gives AI agents reliable full-text extraction (webextract) and robust search (websearch) backends — the "eyes" that let agents see and read the web. Built and tested against Hermes Agent.
Also ships as a standard MCP server, so any MCP client (Claude Desktop, Cursor, other agents) can reuse the same search + extraction capabilities.
Why CrawlEyes?
Most agent toolkits cover one slice of the pipeline. CrawlEyes is the rare all-in-one that you can actually run behind the Great Firewall without external accounts.
Zero API keys. Zero external accounts. One command. CrawlEyes is the only toolkit in this space that combines search + extraction + semantic reranking + MCP in a single, China-friendly, self-hosted package.
Features
Shortened. The full README is on GitHub.
Nothing above is checked by us. What we check is on the safety report.
CrawlEyes MCP Server: common questions
- Is CrawlEyes MCP Server safe?
- Mostly: it is graded B (83/100). Read the CrawlEyes MCP Server safety report
- How do I install CrawlEyes MCP Server?
- It runs on your machine. Copy the Claude Code, Cursor, VS Code or Claude Desktop config from the install section.
- Does CrawlEyes MCP Server need an API key?
- Yes. The registry entry asks for
TAVILY_API_KEY. - Is CrawlEyes MCP Server maintained?
- The last commit was 15 days ago (2026-10-22). The latest release is v0.2.0.
- What can I use instead of CrawlEyes MCP Server?
- Servers from other publishers that do the same job: SeleniumBase MCP server, Brightdata MCP server and Browser Use MCP server. Compare all CrawlEyes MCP Server alternatives.
- How does CrawlEyes MCP Server compare with other Scraping and browsing MCP servers?
- safety score 83/100 (higher than 60% of 867 Scraping and browsing servers); tools 4 (the typical Scraping and browsing server has 6); tools that change things 0% (typical: 0%. Fewer write tools means less an agent can break). Full comparison.
Alternatives to CrawlEyes MCP Server
Same job from other publishers: the closest match first, then the best rated.
- SeleniumBase MCPStealthy browser automation, testing, and web-scraping via CDP Mode.not reviewedWidely usedA
- BrightdataBright Data's Web MCP server enabling AI agents to search, extract & navigate the webnot reviewedEstablishedB
- Browser UseBrowser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.not reviewedEstablishedA
- ScrapelessWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.not reviewedEstablishedA
- Pinkpixel Dev Web ScoutSearch the web and extract clean, readable text from webpages. Process multiple URLs at once to sp…not reviewedGrowingA