Community

Inference AIops

io.github.AIops-tools/inference-aiops

Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

Install

Add the config to your client settings. Replace values in <angle brackets> with your own.

claude_desktop_config.json

{
  "mcpServers": {
    "inference-aiops": {
      "command": "uvx",
      "args": [
        "inference-aiops==0.12.0"
      ]
    }
  }
}