Community

Robots.txt & AI Crawler Checker

dev.workers.quietworklabs.robots-check/robots-check

robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.

Install

Add the config to your client settings. Replace values in <angle brackets> with your own.

claude_desktop_config.json

{
  "mcpServers": {
    "robots-check": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://robots-check.quietworklabs.workers.dev/mcp"
      ]
    }
  }
}

Details

Name: dev.workers.quietworklabs.robots-check/robots-check
Version: 1.0.0
Updated: Oct 18, 2026
Source: Official MCP Registry
Website: https://robots-check.quietworklabs.workers.dev/