mcpcost

io.github.mark1russell7/polite-crawler

polite-crawler

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

needs env probed 2026-10-15

MCP error -32000: Connection closed
polite-crawler: POLITE_CRAWLER_ALLOW_PRIVATE is 1 or 0, not "mcp-pulse-placeholder" (polite-crawler --help lists the command
Run it
npx -y polite-crawler@0.1.0 (stdio, probed in a container with the network off)
Host
npmjs.com
Repository
https://github.com/mark1russell7/crawler
Website
https://mark1russell7.github.io/crawler/
Registry
active, updated 2026-10-13 · registry entry
Reachable
0 of the last 1 probe

Badge and feed

mcpcost: needs env

[![mcpcost](https://mcpcost.ulehla.dev/badge/io.github.mark1russell7/polite-crawler.svg)](https://mcpcost.ulehla.dev/s/io.github.mark1russell7/polite-crawler)

An entry for every probe that changed the result, the tool count or the token cost: Atom feed. Add it to a feed reader or a Slack RSS app to hear when the server stops answering or its tool set grows.