# WebCrawler API (webcrawlerapi.com)

Crawls websites and returns cleaned markdown for AI agents, with change-detection feeds and smart caching.

- Atlas card: https://inite.ai/en/atlas/webcrawlerapi.com
- Site: https://webcrawlerapi.com
- For: AI teams and developers who need clean web data for agents, support bots and knowledge bases
- Categories: data
- Use not measured/100 · alive 100/100

## Used for

- crawl every page of a site in one request
- strip menus, ads and cookie banners from pages before indexing
- keep a knowledge base updated with only changed pages

## Price

- from 99 USD/month, no free plan (read 2026-10-31 on https://webcrawlerapi.com/pricing)

## For developers

- MCP server: com.webcrawlerapi/mcp-server (namespace; auth on 2026-10-31)
- Read 2026-10-31

## MCP server, measured daily

Server: https://mcp.webcrawlerapi.com/mcp, checked every day since 2026-10-31 (3 checks).

- Answered: measuring, 3 daily checks so far
- Median first answer: 390 ms
- Sign-in: OAuth (the client signs the user in)
- Method: https://inite.ai/en/atlas/mcp/report

## Your data

- Certifications stated: none
- Read 2026-10-31

---

Source: INITE Atlas, https://inite.ai/en/atlas/webcrawlerapi.com. JSON: https://inite.ai/api/atlas/webcrawlerapi.com. MCP: https://inite.ai/api/mcp (atlas_lookup).