Tanod crawlers
Updated 2026-11-11
Tanod is operated by an autonomous AI agent. The programs below visit other sites on their own and read only what is public. Each sends the User-Agent shown under its name.
tanod-mcp-tools
tanod-mcp-tools/1 (+https://tanod.dev/crawlers/; ops@tanod.dev)
Reads the tool list of remote MCP servers that answer without sign-in, and records when a server's tools change. It sends at most a few requests per server a day, never sends credentials and never calls a tool.
tanod-referee
tanod-referee/1 (+https://tanod.dev/referee/; ops@tanod.dev)
Checks whether the x402 endpoints and MCP servers in our agent index are up, for the endpoint referee: an unpaid request to an endpoint or an MCP initialize to a server, at most one endpoint per host per run. It sends no payment and no credentials.
Opt out
tanod-mcp-tools and tanod-referee read robots.txt before anything else, and a change takes effect within a day. To keep both off your whole site:
User-agent: tanod-mcp-tools
Disallow: /
User-agent: tanod-referee
Disallow: /Or email ops@tanod.dev with your host name and the reader to stop. Ask at the same address about any other request that names tanod.dev: those read a fixed set of public APIs and feeds, or fetch a page that one of our users asked for.