io.github.MetriLLM/metrillm
metrillm
Is the io.github.MetriLLM/metrillm MCP server down? No. It answered initialize and tools/list in the probe of 2026-10-30.
Benchmark local LLM models — speed, quality & hardware fitness verdict from any MCP client
alive probed 2026-11-14 · unchanged since 2026-10-30
- Run it
- npx -y metrillm-mcp@0.2.6 (stdio, probed in a container with the network off)
- Host
- npmjs.com
- Reports itself as
- metrillm 0.2.1
- Capabilities
- tools
- Instructions
- none
- Of a 1M window
- 0.1 % of a 1M context window
- Count
- 1.0k tokens in Claude Opus 5.5, exact, measured 2026-10-16. With the Claude Code prefix mcp__…__ on each tool name: 1.0k. The o200k_base estimate is 575. Counted again when the tool definitions change. Method.
- Repository
- https://github.com/MetriLLM/metrillm
- Registry
- active, updated 2026-03-16 · registry entry
Most expensive tools
The Claude column scales the o200k estimate of each tool by this server's ratio of exact to estimate, 1.76×.
| Tool | ≈ Claude tokens | o200k estimate | Share of this server |
|---|---|---|---|
| run_benchmark | 375 | 213 | 37 % |
| share_result | 236 | 134 | 23 % |
| get_results | 213 | 121 | 21 % |
| list_models | 189 | 107 | 19 % |
Compare this server with others.
More servers
Other registry entries on npmjs.com, the ones next to this name; all of them.
- io.github.MetaBrain-Labs/comfyui-mcp-server · no executable
- Obscura MCP io.github.Metadrama/obscura-mcp · needs network
- io.github.MetaLift-AI/metalift · alive
- Cartographer MCP io.github.Metatronsdoob369/cartographer-mcp · crashed on start
- Groundrule io.github.Metricall-AI-Lab/groundrule · alive
- Samsung Notes io.github.Mhemd139/samsung-notes · alive
- io.github.Mickdownunder/safeinstall · crashed on start
- io.github.Mihkel00/tokven-mcp · crashed on start
Servers that mention benchmark or hardware.
- ai.actwise/ideation · needs auth
- CounterScript - Drug Price Benchmarks ai.agentlookups/counterscript · alive
- Cerebrium Docs ai.cerebrium/docs · alive
- EOSL.ai — Hardware End-of-Life Database ai.eosl/eosl · alive
- Entity Enricher ai.entityenricher/enricher · alive
- SKUit BOM Builder ai.skuit/bom-builder · needs auth
- ScoreIA La Forge ai.scoreia/forge · alive
- ai.tellas.bip/tellas-bip · needs auth
Badge for the README
The result of the latest probe, the tool count and the token cost. The feed has an entry for every probe that changed them.
A mail when this server changes
Stops answering, comes back, tool set or cost changes. One confirmation mail first, a stop link in every mail.
For the publisher
- The server answers initialize and tools/list. Nothing to fix.