MCP.Market

Web Crawler MCP by InsightfulPipe MCP server

online · 100% uptime
by insightfulpipe.com·com.insightfulpipe/crawler·v1.0.0
No reviews yet

Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.

A93/100grade A
Write a reviewRun it
What users say
No reviews yet
Be the first
Safety scan
A93/100

full report

Adoption
Growing

0 stars

Reviews

Write one

Nobody has reviewed Web Crawler MCP by InsightfulPipe yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

Web Crawler MCP by InsightfulPipe tools

Tool list not cached yet. `describe` through the gateway fetches it live.

Public scan report

scanner v0.1.10 · 2026-10-26 · same rubric, same numbers if you re-run it

no findings
  • –Code scanremote-only server, no package to scann/a
  • Live reliabilityremote reachable in 205ms (auth required)20/20
  • –Tool poisoningtools not inspected (endpoint requires auth); not countedn/a
  • Auth qualityOAuth resource metadata advertised on 40115/15
  • Maintenancelast push 17 days ago15/15
  • Maintainer identitynamespace and repository owner differ; website matches verified namespace6/10
Overall 93/100. Components that don't apply are left out of the denominator. Any critical finding is an F.RubricAppeal a findingJSON

How Web Crawler MCP by InsightfulPipe compares

Against every graded MCP server, from our own scans and uptime checks. Updated after each scan run.

Safety score
93/100
higher than 96% of 48,291 servers
Uptime
100%
of our recent checks; the typical remote server answers 100%
Response time
166 ms
faster than 68% of 30,038 servers

Install Web Crawler MCP by InsightfulPipe in Claude Code, Cursor or VS Code

claude mcp add --transport http crawler https://crawler.insightfulmcp.com/
Add to Cursor

What the publisher says

From the Web Crawler MCP by InsightfulPipe repository's README, as published. We do not edit it. Read it on GitHub

Web Crawler MCP Server (SEO Crawler) by Insightful Pipe

Comprehensive SEO auditing and web crawling through AI with MCP.

Part of the Insightful Pipe MCP Server Collection — The Web Crawler MCP server enables Claude, ChatGPT, Cursor, and other AI assistants to perform SEO audits, extract data, and analyze websites. Run 25+ specialized SEO checks, generate sitemaps, and extract brand information.

MCP Server URL

https://crawler.insightfulmcp.com/

What is Web Crawler MCP?

Web Crawler MCP is a remote Model Context Protocol server that provides AI assistants with comprehensive SEO auditing and web crawling capabilities. This integration allows you to:

  • Run 25+ specialized SEO checkers on any URL
  • Generate XML sitemaps and robots.txt files
  • Extract brand design elements from websites
  • Audit technical SEO, content quality, and security
  • Analyze mobile responsiveness and page speed

Installation

Claude

  1. Copy the MCP Server URL: https://crawler.insightfulmcp.com/
  2. Open Claude Connectors Settings
  3. Scroll to the bottom and click Add custom connector
  4. Paste the URL and click Add
  5. Click Connect and sign in to InsightfulPipe if asked. Claude then lists the connector as connected.

ChatGPT

Custom MCP servers are added through ChatGPT's Developer mode. Availability depends on your ChatGPT plan, and workspace admins may need to allow it.

  1. Turn on Developer mode in ChatGPT settings
  2. Create a new app for a remote MCP server and paste the URL: https://crawler.insightfulmcp.com/
  3. Sign in to InsightfulPipe if asked. The connection finishes as soon as you are signed in.

See OpenAI's guide: Developer mode and MCP apps in ChatGPT

Claude Code

claude mcp add --transport http crawler https://crawler.insightfulmcp.com/

Cursor

Add the server to ~/.cursor/mcp.json (all projects) or .cursor/mcp.json (one project):

{
  "mcpServers": {
    "crawler": {
      "url": "https://crawler.insightfulmcp.com/"
    }
  }
}

When Cursor shows Needs authentication, click Connect and sign in to InsightfulPipe if asked.

Available Actions

33 actions: 33 read, 0 write.

Read Actions (33)

Show all 33 read actions

Shortened. The full README is on GitHub.

Nothing above is checked by us. What we check is on the safety report.

Web Crawler MCP by InsightfulPipe: common questions

Is Web Crawler MCP by InsightfulPipe MCP server safe?
Yes, by our scan: it is graded A (93/100). Read the Web Crawler MCP by InsightfulPipe safety report
How do I install Web Crawler MCP by InsightfulPipe?
It runs remotely at crawler.insightfulmcp.com. Add it to Claude Code, Cursor, VS Code or Claude Desktop with the snippets above, or call it through the mcp.market gateway without installing anything.
Does Web Crawler MCP by InsightfulPipe need an API key?
No key to paste: it signs you in with OAuth when your client connects.
Is Web Crawler MCP by InsightfulPipe maintained?
The last commit was 22 days ago (2026-10-10). The latest release is v1.0.0.
Is Web Crawler MCP by InsightfulPipe up?
100% of our last 21 checks got an answer. We check remote servers about four times a day.
How does Web Crawler MCP by InsightfulPipe compare with other MCP servers?
safety score 93/100 (higher than 96% of 48,291 servers); uptime 100% (of our recent checks; the typical remote server answers 100%); response time 166 ms (faster than 68% of 30,038 servers). Full comparison.

More from insightfulpipe.com →