Community

io.github.cyanheads/evals-mcp-server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Install

Add the config to your client settings. Replace values in <angle brackets> with your own.

claude_desktop_config.json

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server@0.1.6"
      ],
      "env": {
        "EVALS_DATA_DIR": "./evals-data",
        "EVALS_REQUIRE_CONFIRMATION": "false",
        "EVALS_DEFAULT_LICENSE": "<EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "info"
      }
    }
  }
}

Details

Name: io.github.cyanheads/evals-mcp-server
Version: 0.1.6
Updated: Oct 13, 2026
Source: Official MCP Registry
Repository: https://github.com/cyanheads/evals-mcp-server