agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP server

online · 100% uptime

by foomworks·io.github.foomworks/agent-web·v0.2.1

No reviews yet

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

B79/100grade B

Write a review Run it

What users say

No reviews yet

Be the first

Safety scan

B79/100

full report

Adoption

New

0 stars

Reviews

Write one

Nobody has reviewed agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) yet.

If you have run it, two minutes of your experience saves the next person an afternoon.

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) tools (5)

write = sends, deletes, buys or posts

read_urlFree
Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.
read_url_previewFree
Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.
render_pdfFree
PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
render_previewFree
Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
render_screenshotFree
PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

Public scan report

scanner v0.1.9 · 2026-09-26 · same rubric, same numbers if you re-run it

no findings

–Code scanremote-only server, no package to scann/a
Live reliabilityremote reachable in 283ms20/20
Tool poisoning5 tool descriptions checked15/15
Auth qualityopen endpoint, read-only tools10/15
Maintenancelast push 95 days ago8/15
Maintainer identityregistry namespace matches repository owner6/10

Overall 79/100. Components that don't apply are left out of the denominator. Any critical finding is an F.Rubric Appeal a finding JSON

How agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) compares

Against every graded AI and agents MCP server, from our own scans and uptime checks. Updated after each scan run.

Safety score: 79/100; higher than 58% of 4,460 AI and agents servers
Tools: 5; the typical AI and agents server has 6
Tools that change things: 0%; typical: 0%. Fewer write tools means less an agent can break
Uptime: 100%; of our recent checks; the typical remote AI and agents server answers 100%
Response time: 129 ms; faster than 81% of 2,331 AI and agents servers

What its tools let an agent do: 5 read

Install agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) in Claude Code, Cursor or VS Code

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Add to Cursor

What the publisher says

From the agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) repository's README, as published. We do not edit it. Read it on GitHub

agent-web

URL → LLM-ready markdown. A charter-clean, polite, robots-respecting web reader for AI agents — honors robots.txt, identifies honestly, and never bypasses anti-bot/CAPTCHA or paywalls. No account, no API key — free per-call access.

🌐 Live: https://agent-web.foomworks.workers.dev · 🔌 MCP: https://agent-web.foomworks.workers.dev/mcp

What it gives an agent

Give it one publicly reachable URL; get back the page as clean, LLM-ready markdown — title, word count, and the text — without parsing raw HTML yourself. Server-rendered (static) HTML pages. Ideal for summarizing an article, extracting docs, or feeding a page into an LLM.

Connect as an MCP server (recommended)

Streamable HTTP, JSON-RPC 2.0:

https://agent-web.foomworks.workers.dev/mcp

Or call it over HTTP

BASE=https://agent-web.foomworks.workers.dev
curl -s "$BASE/read?url=https://example.com/&ref=readme"          # full markdown
curl -s "$BASE/read/preview?url=https://example.com/&ref=readme"  # first ~600 chars

Discovery: /.well-known/mcp.json (MCP) · /.well-known/agent-card.json (A2A) · /openapi.json · /policy (Acceptable-Use Policy)

Charter-clean by design (the bright line)

This is a polite reader, not a scraper:

Honors the origin's robots.txt for our user-agent — a disallowed path is refused without fetching; an unconfirmable robots.txt (5xx/error) is treated conservatively as disallowed.
Identifies honestly with a descriptive user-agent — never spoofs a browser.
Read-only GET of the single URL you supply — no crawl, no proxy rotation.
Never bypasses anti-bot/CAPTCHA, paywalls, or login walls.
SSRF-guarded: private/loopback/link-local/internal hosts are blocked and every redirect hop is re-validated.

You are responsible for your right to fetch the URL you submit.

Limits

Static HTML only for now — JavaScript-rendered pages, screenshots, and PDF are a later increment.
Body cap ~2 MB, fetch timeout ~12 s.
The service holds no keys and never initiates payments.

Install the AgentSkill

SKILL.md is a portable AgentSkill (ClawHub / skills.sh / Claude Skills).

About

agent-web is operated by FOOM — an AI-operated, human-supervised autonomous service. License: MIT.

Nothing above is checked by us. What we check is on the safety report.

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free): common questions

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP server safe?: Mostly: it is graded B (79/100). Read the agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) safety report
How do I install agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?: It runs remotely at agent-web.foomworks.workers.dev. Add it to Claude Code, Cursor, VS Code or Claude Desktop with the snippets above, or call it through the mcp.market gateway without installing anything.
Does agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) need an API key?: Not as far as the registry entry and our scan can tell: no credentials are declared or required.
Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) maintained?: The last commit was 134 days ago (2026-06-23). The latest release is v0.2.1.
Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) up?: 100% of our last 28 checks got an answer. We check remote servers about four times a day.
What can I use instead of agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?: Servers from other publishers that do the same job: Robin: AI-Powered Dark Web OSINT MCP server, DataSinking MCP server and Charlotte MCP server.
How does agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) compare with other AI and agents MCP servers?: safety score 79/100 (higher than 58% of 4,460 AI and agents servers); tools 5 (the typical AI and agents server has 6); tools that change things 0% (typical: 0%. Fewer write tools means less an agent can break). Full comparison.

Alternatives to agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

Same job from other publishers: the closest match first, then the best rated.

Robin: AI-Powered Dark Web OSINT
Dark web OSINT over Tor: search onion engines, scrape pages, report with your own model.
not reviewed
Established
A
DataSinking
Full-text financial reports (US, China, Japan, Korea, Taiwan, UK) as clean Markdown for RAG agents.
not reviewed
Established
A
Charlotte
Renders web pages into structured, agent-readable representations using headless Chromium.
not reviewed
Established
A
agent-device
Open source device layer for AI agents: control mobile, web, TV, and desktop apps over MCP
not reviewed
Widely used
A
Basic Memory
Local-first knowledge management with bi-directional LLM sync via Markdown files.
not reviewed
Widely used
B

Run it through the gateway

With the gateway added, ask your agent for it by name:

agent prompt

call io.github.foomworks/agent-web → read_url

Free per call. Metered, capped by your key, logged for reliability.

Add the gateway (gw.mcp.market)

Rating: —
Safety grade: B · 79/100
Stars: 0
Downloads/wk: –
Price: Free
Licence: MIT
Transport: Remote
Uptime: 100% · 28/28 checks
Version: 0.2.1
Category: AI and agents
Last release: 2026-06-23

Endpoint

https://agent-web.foomworks.workers.dev/mcp

streamable-http

Own this server?

Claim it to keep the listing current and reply to reviews. Claiming never changes the grade or hides a review.

Claim listing

Badge for your README

Shows the safety grade and links back to this page. It updates itself after every scan and review.

[![mcp.market](https://mcp.market/badge/foomworks-agent-web.svg)](https://mcp.market/server/foomworks-agent-web)

How the badge works