dev.workers.quietworklabs.robots-check/robots-check
Robots.txt & AI Crawler Checker
Is the Robots.txt & AI Crawler Checker MCP server down? No. It answered initialize and tools/list in the probe of 2026-10-26.
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
alive probed 2026-11-15 · unchanged since 2026-10-26 · HTTP 200
- Endpoint
- https://robots-check.quietworklabs.workers.dev/mcp (streamable-http)
- Host
- robots-check.quietworklabs.workers.dev
- Protocol
- 2025-11-25
- Reports itself as
- dev.workers.quietworklabs.robots-check/robots-check 1.0.0
- Capabilities
- tools
- Instructions
- 801 characters
- Of a 1M window
- <0.1 % of a 1M context window
- Count
- 919 tokens in Claude, exact, measured 2026-10-25. With the Claude Code prefix mcp__…__ on each tool name: 946. The o200k_base estimate is 547. Counted again when the tool definitions change. Method.
- Website
- https://robots-check.quietworklabs.workers.dev/
- Registry
- active, updated 2026-10-18 · registry entry
- Changes
- 2 recorded, reachable in 2 of them. A row is added when the result, the tool count or the cost changes.
Most expensive tools
The Claude column scales the o200k estimate of each tool by this server's ratio of exact to estimate, 1.68×.
| Tool | ≈ Claude tokens | o200k estimate | Share of this server |
|---|---|---|---|
| robots_check | 336 | 200 | 37 % |
| ai_crawler_access | 316 | 188 | 34 % |
| sitemap_check | 267 | 159 | 29 % |
Compare this server with others.
More servers
Servers that mention robots.
- BotInfo — Advanced Robot Market Data ai.botinfo/robot-market-data · alive
- RoboHub Robot Catalog app.robohub/robohub · alive
- AI Visibility Audit — Can AI crawlers read and cite your site? app.rowb.ai-visibility/audit · alive
- ActableSite AI Crawler Monitor com.actablesite/ai-crawler-robots-monitor · alive
- ActableSite AI Crawler Monitor com.actablesite/readiness · not found
- AiGramX com.aigramx/aigramx · timeout
- Wodan Posture com.goedvps.app.wodan-posture/wodan-posture · not found
- com.handsofflinks/link-followability · alive
History
We add a row when the result changes. A server with no change keeps its last row.
| Probed | Result | Init | Tools | Claude | o200k |
|---|---|---|---|---|---|
| 2026-10-25 20:51 | alive | 246 ms | 3 | 919 | 547 |
| 2026-10-18 08:37 | alive | 372 ms | 3 | 547 |
Badge for the README
The result of the latest probe, the tool count and the token cost. The feed has an entry for every probe that changed them.
A mail when this server changes
Stops answering, comes back, tool set or cost changes. One confirmation mail first, a stop link in every mail.
For the publisher
- The server answers initialize and tools/list. Nothing to fix.
Fixed something? Probe it now, with the same steps as the daily run. This page updates with the next daily run.