io.github.tjacquesson/llmtest-mcp
llmtest
Is the io.github.tjacquesson/llmtest-mcp MCP server down? No. It answered initialize and tools/list in the probe of 2026-11-01.
Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
alive probed 2026-11-14 · unchanged since 2026-11-01
- Run it
- npx -y llmtest-mcp@0.6.1 (stdio, probed in a container with the network off)
- Host
- npmjs.com
- Reports itself as
- llmtest 0.6.0
- Capabilities
- tools
- Instructions
- none
- Of a 1M window
- 0.4 % of a 1M context window
- Count
- 3.9k tokens in Claude, exact, measured 2026-10-25. With the Claude Code prefix mcp__…__ on each tool name: 4.1k. The o200k_base estimate is 2.3k. Counted again when the tool definitions change. Method.
- Repository
- https://github.com/tjacquesson/llmtest-mcp
- Website
- https://llmtest.io
- Registry
- active, updated 2026-05-22 · registry entry
- Changes
- 2 recorded, reachable in 2 of them. A row is added when the result, the tool count or the cost changes.
Most expensive tools
The Claude column scales the o200k estimate of each tool by this server's ratio of exact to estimate, 1.73×.
| Tool | ≈ Claude tokens | o200k estimate | Share of this server |
|---|---|---|---|
| run_benchmark | 674 | 389 | 17 % |
| optimize_prompt | 582 | 336 | 15 % |
| seed_samples | 522 | 301 | 13 % |
| leave_feedback | 447 | 258 | 11 % |
| get_autopilot_status | 423 | 244 | 11 % |
Compare this server with others.
More servers
Other registry entries on npmjs.com, the ones next to this name; all of them.
- Rupa3D io.github.tiranyx/rupa3d · needs env
- agentdocs io.github.titov-d/agentdocs · alive
- io.github.tixuz/openemis · alive
- io.github.tixuz/openemis-pro · alive
- io.github.tjclaude88/bling-bag · alive
- io.github.tjp2021/mcp-thinkgate · alive
- pkg io.github.tneemo/pkg · alive
- Paperless-ngx io.github.tobee89/mcp-paperless-ngx · crashed on start
Servers that mention alternatives or benchmark.
- ai.actwise/ideation · needs auth
- CounterScript - Drug Price Benchmarks ai.agentlookups/counterscript · alive
- Entity Enricher ai.entityenricher/enricher · alive
- Infrabase ai.infrabase/directory · alive
- ScoreIA La Forge ai.scoreia/forge · alive
- ai.tellas.bip/tellas-bip · needs auth
- The Aggregate — LLM benchmark aggregate ai.theaggregate/the-aggregate · alive
- AI Tool Directory ai.tooldirectory/catalog · alive
History
We add a row when the result changes. A server with no change keeps its last row.
| Probed | Result | Init | Tools | Claude | o200k |
|---|---|---|---|---|---|
| 2026-10-25 06:57 | alive | 405 ms | 16 | 3.9k | 2.3k |
| 2026-10-18 06:44 | alive | 382 ms | 16 | 2.3k |
Badge for the README
The result of the latest probe, the tool count and the token cost. The feed has an entry for every probe that changed them.
A mail when this server changes
Stops answering, comes back, tool set or cost changes. One confirmation mail first, a stop link in every mail.
For the publisher
- The server answers initialize and tools/list. Nothing to fix.