Robotstxt AI MCP server

by sharozdawa·io.github.sharozdawa/robotstxt-ai·v1.0.1·1 stars

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

B75/100grade B

What users say

No reviews yet

Safety scan

B75/100

Adoption

New

1 stars

Reviews

Nobody has reviewed Robotstxt AI yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

write = sends, deletes, buys or posts

Read from the package source without running it. The installed server may list more.

analyze_robots
Analyze pasted robots.txt content. Returns which AI bots are blocked or allowed based on the rules.
check_bot_status
Check if a specific bot is blocked or allowed on a given website by fetching and analyzing its robots.txt.
fetch_robots
Fetch and analyze a robots.txt file from a URL. Returns which AI bots are blocked or allowed.
generate_robots
Generate a robots.txt file with specified blocked bots, sitemap URLs, and custom rules.
list_ai_bots
List all known AI bots with their user-agents, companies, and descriptions. Useful for deciding which bots to block.

scanner v0.1.10 · 2026-09-27 · same rubric, same numbers if you re-run it

no findings

Code scan5 source files scanned25/25
–Live reliabilityno gateway calls yet and no remote to proben/a
–Tool poisoningtools not inspected (local package is not executed); not countedn/a
Auth qualitylocal package, no credentials required12/15
Maintenancelast push 190 days ago4/15
Maintainer identityregistry namespace matches repository owner; GitHub account older than a year8/10

Overall 75/100. Components that don't apply are left out of the denominator. Any critical finding is an F.Rubric Appeal a finding JSON

Against every graded MCP server, from our own scans and uptime checks. Updated after each scan run.

Safety score: 75/100; higher than 45% of 48,273 servers
Tools: 5; the typical server has 7
Tools that change things: 0%; typical: 0%. Fewer write tools means less an agent can break
GitHub stars: 1; more than 65% of 28,534 servers

What its tools let an agent do: 4 read · 1 create

Runs npx -y robotstxt-ai-mcp on your machine. Read the scan report first; the gateway never runs local packages.

claude mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp

Is Robotstxt AI MCP server safe?: Mostly: it is graded B (75/100). Read the Robotstxt AI safety report
How do I install Robotstxt AI?: It runs on your machine. Copy the Claude Code, Cursor, VS Code or Claude Desktop config from the install section.
Does Robotstxt AI need an API key?: Not as far as the registry entry and our scan can tell: no credentials are declared or required.
Is Robotstxt AI maintained?: The last commit was 225 days ago (2026-03-22). The latest release is v1.0.1.
How does Robotstxt AI compare with other MCP servers?: safety score 75/100 (higher than 45% of 48,273 servers); tools 5 (the typical server has 7); tools that change things 0% (typical: 0%. Fewer write tools means less an agent can break). Full comparison.