Crawl Readiness
Free plan · From $29/moActively maintained
27 linking domains
Emerging
- For
- Website owners and marketers checking whether AI assistants can read and cite their site
- Price
- Free plan · From $29/mopricing page, read Oct 22, 2026
- Activity
- Actively maintainedsite updated 3 weeks ago
- Runs as
- Browser extension
- Used for
- Check which AI crawlers your robots.txt allows or blocks
- Generate llms.txt and robots.txt files for a site
- Track which sites AI answers cite for buyer questions
- Publishes llms.txt, a file written for AI assistantscrawlreadiness.com ↗
- Launched on Product Hunt on Sep 22, 2026Product Hunt ↗
Free plan · From $29/mo
- Domain since2026domain registered
- HeadquartersOntario, Canadaper their About page
- MCP docscrawlreadiness.com/mcpthe vendor's page ↗
This card as JSON, for your agent →
Each line is something a program found when it went looking: the registry entry, the server's own answer, a spec that parses. A missing line means we did not find it, not that it does not exist.
Figure and bar: visits/mo, estimate · year: online since
- #1
ScrapelessMCP · sign-in
Provides cloud browsers and APIs for autonomous agents to scrape web data, solve captchas, and automate browser tasks at scale.
9.2kActiveFree plan - #2
SEOcrawl AIMCP · sign-in
Crawls websites for SEO audits and tracks how ChatGPT, Claude, Gemini, Perplexity and Copilot mention your brand.
2.3kActiveFrom ≈ $55/mo - #3
JsmonMCP · sign-in
Crawls a domain's URLs and analyses their JavaScript for exposed credentials, vulnerable endpoints and third-party risk, alerting via Jira, Slack or email.
529ActiveFrom $15/mo - #4
Searcher OSMCP · sign-in
Scrapes business-for-sale broker sites against buyer criteria, then tracks acquisition deals through CIM analysis, DSCR modelling and broker outreach.
376From $79/mo2025 - #5
Salience
Reads server and CDN logs to show which crawler and bot requests hit a site, their responses, and whether identities are genuine.
157From $19/mo2026 - #6
DeepSEOAnalysisMCP · sign-in
Crawls a URL and scores technical SEO, Core Web Vitals, schema, internal links and AI citation readiness in one report.
144ActiveFrom $24/mo
Not it? Say what you need
betaThree tools from the Atlas for the job you describe, each with what fits and what does not.
No notes yet. What do you use Crawl Readiness for?
Sign in to leave a noteWhat is Crawl Readiness?
Checks whether AI crawlers can fetch a site, then generates robots.txt, llms.txt and JSON-LD fixes and monitors AI search citations. It is listed in the Atlas under Data.
Who is Crawl Readiness for?
Website owners and marketers checking whether AI assistants can read and cite their site
How much does Crawl Readiness cost?
Crawl Readiness has a free plan; paid plans start at $29/mo, per its pricing page on 2026-10-22.
Is Crawl Readiness free?
Yes, Crawl Readiness has a free plan, per its pricing page on 2026-10-22.
Do people use Crawl Readiness?
Emerging.
Is Crawl Readiness still maintained?
Actively maintained: site updated 3 weeks ago.
How do I cancel Crawl Readiness?
In its own words (terms of service, 2026-10-22): “You can cancel at any time from your dashboard; access continues until the end of the current billing period.”
Does Crawl Readiness give refunds?
In its own words (terms of service, 2026-10-22): “Refunds are handled case-by-case — email us within 14 days of a charge if something is wrong.”
What are alternatives to Crawl Readiness?
In Data, by use: Scrapeless, SEOcrawl AI, Jsmon, Searcher OS, Salience, DeepSEOAnalysis.
How we read a tool
No votes, no reviews, no vendor claims. Every week a crawler reads each tool's own site and a few public registries, and the words on the card are bands over what it read.
- Use: visits to the site (estimated), installs from npm and PyPI, presence in Chrome's usage report.
- Activity: the newest release on GitHub, npm or PyPI; the newest dated page on the site; open roles on a public jobs board.
- Price: the vendor's own pricing page, read with the date. A figure is printed only when it is on that page.
- The line and the use cases are written by us from the homepage, one tool at a time, and refused when they repeat the vendor's marketing.
How AI assistants read each site — the reading vendors ask us about — is on each tool's own visibility page.
How we read every tool → · By INITE Atlas Desk
Cookies
Before we count this visit
Analytics and ad measurement tell us which pages and which of our ads do their job: Google Analytics and Google Ads, the Meta pixel, Yandex Metrica, and one first-party id of our own. Nothing is stored until you answer, and declining changes nothing about the site.