Web Fetch MCP server

@pipeworx/web-fetch

Fetch the exact contents of one public URL, live from its origin server, and get back the bytes (or text decoded from them) with a SHA-256 hash of exactly what the origin sent, plus the redirect chain and the response headers.

Part of Pipeworx — an MCP gateway connecting AI agents to 1855+ live data sources. This is an independent, unofficial integration — not affiliated with, endorsed by, or published by the upstream provider.

Tools

http(s) URL. Returns status, urlfinal, redirects (present only when the URL redirected), headers (content-type, content-length, last-modified, etag, content-language, date), contentfamily (text | pdf | archive | binary), bytes_total, sha256 over the complete body, and a window of the body:

• fetchurl(url, format?, maxbytes?, offset?) — one GET of one public

for everything else.

• format: "auto" (default) — readable text for HTML and PDF, the raw body

binary (zip, xlsx, gzip, PDF). sha256_returned hashes exactly the bytes in the window.

• format: "raw" — the body itself: decoded text for text types, base64 for

none | failed). PDF extraction warnings are passed through in warnings.

• format: "text" — extracted text (text_extraction: html | pdf |

base64) and offset page through a large body; follow next_offset.

• max_bytes (default 100,000; at most 1,000,000 for text, 512,000 for

Text is decoded from the bytes, never guessed: the charset comes from a BOM, then the Content-Type header, then the page's own or XML declaration, then UTF-8 if the bytes are valid UTF-8, else windows-1252. charsetsource says which rule decided and decodereplacements counts any characters lost in decoding (0 means none).

Checking "verbatim" yourself

sha256 is taken over the entity body after transfer compression is removed — the same bytes curl --compressed -s | shasum -a 256 writes. Two caveats: a dynamic page can legitimately hash differently a second later, and some sites serve different content by location, so the answer is verbatim as served to this fetch (colo, when known, names the edge location).

Refusals — always loud, never an empty body

Limits

Shortened. The full README is on GitHub.