Data9 companies
9 companies, 9 swept. The median identity score is 90 of 100. Rows are ordered by readiness; rows not yet rated sit last.
9 companies · 9 swept · last sweep 2026-09-16
90/100
median
Ranked by readiness
- #1
Apify
apify.comMarketplace of web scraping and data extraction tools for AI agents and applications.
bots in✓ llms.txt86/100
#1 of 9 in Data - #2
Diffbot
diffbot.comExtracts structured data from web pages and crawls entire sites into datasets without hallucinations.
bots in✓ llms.txt83/100
#2 of 9 in Data - #3
Bright Data
brightdata.comProvides web scraping APIs, proxy infrastructure, and datasets for extracting structured data from websites at scale.
bots partly✓ llms.txt82/100
#3 of 9 in Data - #4
Browserbase
browserbase.comProvides browser automation and web interaction APIs for agents to navigate, extract data, and complete tasks on websites.
bots in✓ llms.txt74/100
#4 of 9 in Data - #5
Zyte
zyte.comProvides web scraping APIs and managed data extraction services with proxy rotation and ban handling.
bots partly✓ llms.txt69/100
#5 of 9 in Data - #6
Tavily
tavily.comProvides real-time web search and content extraction API for AI agents to access and reason over live web data.
bots partly✓ llms.txt67/100
#6 of 9 in Data - #7
SerpApi
serpapi.comProvides structured data from search engines and shopping sites via API.
bots partly✓ llms.txt66/100
#7 of 9 in Data - #8
Exa
exa.aiProvides web search API and data indexing for AI agents with real-time web crawling and structured data extraction.
bots partly✓ llms.txt61/100
#8 of 9 in Data - #9
Firecrawl
firecrawl.devSearches, scrapes, and interacts with websites to provide clean data for AI agents.
bots partly✓ llms.txt47/100
#9 of 9 in Data
How to read a row
- swept
- Read by a crawler: HTTP and parsing, no model call. Every row, every week.
- measured
- The full analyzer run, asked of four engines. Shown only where the company agreed to show it.
Can a retrieval engine find, resolve and quote this site? Four parts, each read by the sweep, each shown beside the total.
Entity 25 · Machine-readable 35 · Retrieval access 20 · Footprint 20
A part that was never read is left out and the total is rescaled to what was. It is never counted as zero.