io.github.sharozdawa/robotstxt-ai
robotstxt-ai
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
alive probed 2026-10-14
5tools
997tokens in Claude Opus 5.5
1.1ktokens in Claude Code
0.5 %of a 200k context window
544o200k_base estimate
211 msto initialize
8 msto list tools
- Run it
- npx -y robotstxt-ai-mcp@1.0.1 (stdio, probed in a container with the network off)
- Host
- npmjs.com
- Reports itself as
- robotstxt-ai 1.0.0
- Capabilities
- tools
- Instructions
- none
- Claude count
- Claude Opus 5.5, measured 2026-10-14. Counted again when the tool definitions change. Method.
- Repository
- https://github.com/sharozdawa/robotstxt-ai
- Registry
- active, updated 2026-03-21 · registry entry
- Reachable
- 1 of the last 1 probe
Most expensive tools
| Tool | Tokens (o200k) | Share of this server |
|---|---|---|
| generate_robots | 194 | 36 % |
| check_bot_status | 129 | 24 % |
| fetch_robots | 88 | 16 % |
| analyze_robots | 73 | 13 % |
| list_ai_bots | 60 | 11 % |
Badge and feed
[](https://mcpcost.ulehla.dev/s/io.github.sharozdawa/robotstxt-ai)
An entry for every probe that changed the result, the tool count or the token cost: Atom feed. Add it to a feed reader or a Slack RSS app to hear when the server stops answering or its tool set grows.