mcpcost

io.github.OtherVibes/mcp-as-a-judge

MCP-as-a-Judge

Is the io.github.OtherVibes/mcp-as-a-judge MCP server down? No. Installed with mcp<2, it started and listed its tools on 2026-11-06.

MCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations

needs mcp<2 probed 2026-11-14 · unchanged since 2026-11-06

8tools, with mcp<2
51ktokens in Claude Opus 5.5
25.7 %of Claude's 200k window

A plain install of the package stops at the import below. These tool definitions are from a second install with mcp<2, started in a container with the network off, on 2026-11-06.

MCP error -32000: Connection closed
ModuleNotFoundError: No module named 'mcp.server.fastmcp'. This is mcp 2.x, where FastMCP was renamed to MCPServer (from mcp
Run it
uvx --with 'mcp<2' mcp-as-a-judge@0.3.20 (stdio, probed in a container with the network off)
Host
pypi.org
Reports itself as
MCP-as-a-Judge 1.30.0
Capabilities
experimental, prompts, resources, tools
Repository
https://github.com/OtherVibes/mcp-as-a-judge
Registry
active, updated 2025-09-20 · registry entry
Changes
2 recorded, reachable in 0 of them. A row is added when the result, the tool count or the cost changes.

Most expensive tools

Estimates with the o200k_base tokenizer.

Toolo200k estimateShare of this server
judge_coding_plan6 26020 %
judge_code_change6 12720 %
set_coding_task6 09420 %
judge_testing_implementation6 08820 %
judge_coding_task_completion5 56718 %

Compare this server with others.

More servers

Other registry entries on pypi.org, the ones next to this name; all of them.

Servers that mention judge.

History

We add a row when the result changes. A server with no change keeps its last row.

ProbedResultInitToolsClaudeo200k
2026-11-06 08:40needs mcp<27.7 s851k31k
2026-10-16 06:27crashed on start

Badge for the README

mcpcost: needs mcp<2

The result of the latest probe, the tool count and the token cost. The feed has an entry for every probe that changed them.

Atom feed

A mail when this server changes

Stops answering, comes back, tool set or cost changes. One confirmation mail first, a stop link in every mail.

For the publisher

The cause and the fix, with the code before and after: ModuleNotFoundError: No module named 'mcp.server.fastmcp'