The Crawler Zoo
Actively maintained
≈ 1visits/mo
Use not read yet · estimate, read Oct 24, 2026
- For
- Website owners who want to see which crawlers visit their site and control them
- Activity
- Actively maintainedsite updated 2 days ago
- Used for
- watch live crawler visits to a website
- generate a robots.txt file
- block AI crawlers from a site
- Has an MCP server (1 in the registry)public registry →
- Publishes llms.txt, a file written for AI assistantscrawlerzoo.com ↗
- MCP servercom.crawlerzoo/arenaverified in the MCP registry
- Stateanswers, 3 toolschecked 2026-10-24
- Address to connectcrawlerzoo.com/mcp
This card as JSON, for your agent →
Each line is something a program found when it went looking: the registry entry, the server's own answer, a spec that parses. A missing line means we did not find it, not that it does not exist.
Figure and bar: visits/mo, estimate · year: online since
- #1
Evidence
Builds reports and dashboards from SQL queries and Markdown files kept in version control, deployed as a static data website.
4.8kActiveFrom $2,500/mo - #2
Inspectlet
Records visitor sessions and heatmaps on websites to show where users click, scroll and drop off.
3.5kMaintainedFrom $39/mo - #3
OnyxMetricMCP · sign-in
Cookieless website analytics script that records clicks, session replays, funnels and Core Web Vitals in one dashboard.
58ActiveFrom $990/yr - #4
CipheraMCP · sign-in
Cookieless web analytics, a bot-blocking captcha and transactional email relay, all built so the operator cannot read the data users send.
26Active2024 - #5
DailyLogDeskMCP · open
Builds incident reports, risk assessments, construction quotes and daily logs for small contractors, keeping site records and completion certificates.
10ActiveFrom $29/mo - #6
OpenRevenueMCP · sign-in
Cookieless web analytics that tracks live visitors, visitor journeys, revenue attribution and Core Web Vitals on your site.
5ActiveFrom $9/mo
Not it? Say what you need
betaThree tools from the Atlas for the job you describe, each with what fits and what does not.
No notes yet. What do you use The Crawler Zoo for?
Sign in to leave a noteWhat is The Crawler Zoo?
Live dashboard that logs and illustrates which automated crawlers visit a website, with a robots.txt generator. It is listed in the Atlas under Analytics.
Who is The Crawler Zoo for?
Website owners who want to see which crawlers visit their site and control them
Is The Crawler Zoo still maintained?
Actively maintained: site updated 2 days ago.
What are alternatives to The Crawler Zoo?
In Analytics, by use: Evidence, Inspectlet, OnyxMetric, Ciphera, DailyLogDesk, OpenRevenue.
How we read a tool
No votes, no reviews, no vendor claims. Every week a crawler reads each tool's own site and a few public registries, and the words on the card are bands over what it read.
- Use: visits to the site (estimated), installs from npm and PyPI, presence in Chrome's usage report.
- Activity: the newest release on GitHub, npm or PyPI; the newest dated page on the site; open roles on a public jobs board.
- Price: the vendor's own pricing page, read with the date. A figure is printed only when it is on that page.
- The line and the use cases are written by us from the homepage, one tool at a time, and refused when they repeat the vendor's marketing.
How AI assistants read each site — the reading vendors ask us about — is on each tool's own visibility page.
How we read every tool → · By INITE Atlas Desk
Cookies
Before we count this visit
Analytics and ad measurement tell us which pages and which of our ads do their job: Google Analytics and Google Ads, the Meta pixel, Yandex Metrica, and one first-party id of our own. Nothing is stored until you answer, and declining changes nothing about the site.