Crawlie MCP server
online · 100% uptimeapp.crawlie/crawlie·v0.1.0·119 starsTechnical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
119 stars
Reviews
Write oneNobody has reviewed Crawlie yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
Crawlie tools
Tool list not cached yet. `describe` through the gateway fetches it live.
Public scan report
scanner v0.1.10 · 2026-11-08 · same rubric, same numbers if you re-run it
- –Code scanremote-only server, no package to scann/a
- Live reliabilityremote reachable in 1050ms (auth required)20/20
- –Tool poisoningtools not inspected (endpoint requires auth); not countedn/a
- Auth qualityOAuth resource metadata advertised on 40115/15
- Maintenancelast push 12 days ago15/15
- Maintainer identityendpoint served from the registry-verified namespace domain8/10
How Crawlie compares
Against every graded SEO MCP server, from our own scans and uptime checks. Updated after each scan run.
- Safety score
- 97/100
- higher than 95% of 769 SEO servers
- Uptime
- 100%
- of our recent checks; the typical remote SEO server answers 100%
- Response time
- 760 ms
- faster than 16% of 541 SEO servers
- GitHub stars
- 119
- more than 95% of 408 SEO servers
Install Crawlie in Claude Code, Cursor or VS Code
claude mcp add --transport http crawlie https://crawlie.app/mcp
What the publisher says
From the Crawlie repository's README, as published. We do not edit it. Read it on GitHub
crawlie
The fast, free, open-source technical SEO + GEO crawler — built for humans and agents.
Crawl any site for broken links, redirects, missing metadata, and 40+ SEO & Generative-Engine checks — with plain-English guidance on every fix. Runs locally, ships a CLI and an MCP server, and costs nothing.
Setup · CLI · MCP & agents · Changelog · Use cases · Why I built this · Desktop app · Checks · Compare · Architecture
Read the docs → crawlie.dev
💡Share feedback & suggestions here
.png)
Setup
The easy way — npm (installs the crawlie CLI and the crawlie-mcp server):
npm i -g crawlieThe macOS app — grab the signed .dmg from Releases.
From source — needs Rust (engine/CLI/MCP) and, for the desktop app, pnpm + Node:
git clone https://github.com/spronta/crawlie
cd crawlie
cargo build --release
# → target/release/crawlie and target/release/crawlie-mcp
# or install onto your PATH:
cargo install --path crates/crawlie-cli # installs `crawlie`
cargo install --path crates/crawlie-mcp # installs `crawlie-mcp`How it ships: the CLI + MCP come only through npm — the right native binary installs automatically as a platform package (nothing to download or unblock). The desktop app is the only direct download: a signed, notarized .dmg on Releases.
How to use (CLI)
# Crawl a whole site (respects robots.txt, seeds from sitemap.xml)
crawlie crawl https://example.com --format pretty
# Audit a single page, or a specific set of pages
crawlie audit https://example.com/pricing
crawlie audit https://example.com/a https://example.com/b
# Save a shareable, self-contained HTML report
crawlie crawl https://example.com --format html -o report.html
# Clean JSON on stdout (perfect for piping / scripting / agents)
crawlie crawl https://example.com --format json -o report.json
# Learn why any finding matters and how to fix it
crawlie explain geo-not-answerableOutput formats: pretty (terminal), json (machine-readable, the default), csv (issues), html (shareable file).
Common flags:
Shortened. The full README is on GitHub.
Nothing above is checked by us. What we check is on the safety report.
Crawlie: common questions
- Is Crawlie MCP server safe?
- Yes, by our scan: it is graded A (97/100). Read the Crawlie safety report
- How do I install Crawlie?
- It runs remotely at crawlie.app. Add it to Claude Code, Cursor, VS Code or Claude Desktop with the snippets above, or call it through the mcp.market gateway without installing anything.
- Does Crawlie need an API key?
- No key to paste: it signs you in with OAuth when your client connects.
- Is Crawlie maintained?
- The last commit was 20 days ago (2026-10-26). The latest release is v0.1.0.
- Is Crawlie up?
- 100% of our last 28 checks got an answer. We check remote servers about four times a day.
- What can I use instead of Crawlie?
- Servers from other publishers that do the same job: SEO Audit Console MCP server, RankCLI MCP server and Scrawly MCP Server. Compare all Crawlie alternatives.
- How does Crawlie compare with other SEO MCP servers?
- safety score 97/100 (higher than 95% of 769 SEO servers); uptime 100% (of our recent checks; the typical remote SEO server answers 100%); response time 760 ms (faster than 16% of 541 SEO servers). Full comparison.
Alternatives to Crawlie
Same job from other publishers: the closest match first, then the best rated.
- SEO Audit ConsoleTechnical SEO in Claude: GSC + crawl + DataForSEO - audit, portfolio, market sizing, content recon.not reviewedEstablishedA
RankCLIFree, local SEO + GEO audits for AI assistants - no signup, nothing leaves your machine.not reviewedGrowingA- Scrawly MCP ServerMCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.not reviewedGrowingA
- pseolintPenalty-risk audit for programmatic SEO sites: verdict, risk score, and a fix manifest.not reviewedGrowingB
Open SEO CrawlerSelf-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.not reviewedGrowingA