# The Crawler Zoo (crawlerzoo.com)

Live dashboard that logs and illustrates which automated crawlers visit a website, with a robots.txt generator.

- Atlas card: https://inite.ai/en/atlas/crawlerzoo.com
- Site: https://crawlerzoo.com
- For: Website owners who want to see which crawlers visit their site and control them
- Categories: analytics
- Use not measured/100 · alive 100/100

## Used for

- watch live crawler visits to a website
- generate a robots.txt file
- block AI crawlers from a site

## Price

Not read yet.

## For developers

- MCP server: com.crawlerzoo/arena (namespace; open on 2026-10-24, 3 tools)
- Read 2026-10-24

## MCP server, measured daily

Server: https://crawlerzoo.com/mcp, checked every day since 2026-10-24 (3 checks).

- Answered: measuring, 3 daily checks so far
- Median first answer: 264 ms
- Sign-in: none
- Context its tool definitions take: about 525 tokens (3 tools)
- Tool definitions: A, 100/100
- Method: https://inite.ai/en/atlas/mcp/report

## Your data

- Certifications stated: none
- Read 2026-10-24

---

Source: INITE Atlas, https://inite.ai/en/atlas/crawlerzoo.com. JSON: https://inite.ai/api/atlas/crawlerzoo.com. MCP: https://inite.ai/api/mcp (atlas_lookup).
