# Content Signals Policy — https://contentsignals.org # # The Content-Signal directive below states what this site permits, per # purpose, for the crawlers in the group it appears under: # # search — building a search index and returning links and short excerpts. # ai-input — using the content to ground or cite in a generated answer. # ai-train — training or fine-tuning a model. # # "yes" permits the purpose; "no" reserves it. Absence expresses no # preference and is not permission. Groups without a Content-Signal line # below are Disallow: / — the access rule already answers the question. User-Agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: GPTBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: ClaudeBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: bingbot-Extended Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: OAI-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: OAI-AdsBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: ChatGPT-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Claude-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Claude-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: PerplexityBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Google-Extended Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Applebot-Extended Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: MistralAI-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Kagibot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: Brave-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: xAI-Bot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: YouBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: /api/ai-data Allow: /api/og Allow: /api/atlas Allow: /api/mcp Allow: /api/a2a Disallow: /api/ Disallow: /data/ Disallow: /admin Disallow: /onboarding Disallow: /login Disallow: /register Disallow: /profile Disallow: /en/admin Disallow: /en/onboarding Disallow: /en/login Disallow: /en/register Disallow: /en/profile Disallow: /ru/admin Disallow: /ru/onboarding Disallow: /ru/login Disallow: /ru/register Disallow: /ru/profile Disallow: /pt/admin Disallow: /pt/onboarding Disallow: /pt/login Disallow: /pt/register Disallow: /pt/profile Disallow: /es/admin Disallow: /es/onboarding Disallow: /es/login Disallow: /es/register Disallow: /es/profile Disallow: /*?_rsc= Disallow: /*&_rsc= Disallow: /*/atlas/*/claim User-Agent: anthropic-ai Disallow: / User-Agent: Bytespider Disallow: / User-Agent: Meta-ExternalAgent Disallow: / User-Agent: FacebookBot Disallow: / User-Agent: Amazonbot Disallow: / User-Agent: cohere-ai Disallow: / User-Agent: Diffbot Disallow: / User-Agent: Omgilibot Disallow: / User-Agent: Webzio-Extended Disallow: / User-Agent: AhrefsBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Crawl-delay: 10 User-Agent: MJ12bot Disallow: / Host: https://inite.ai Sitemap: https://inite.ai/sitemap.xml Sitemap: https://inite.ai/news-sitemap.xml Sitemap: https://inite.ai/news-feed.xml Sitemap: https://inite.ai/news-feed-ru.xml Sitemap: https://inite.ai/news-feed-pt.xml Sitemap: https://inite.ai/news-feed-es.xml Sitemap: https://inite.ai/atlas-feed.xml Sitemap: https://inite.ai/atlas-feed-ru.xml Sitemap: https://inite.ai/atlas-feed-pt.xml Sitemap: https://inite.ai/atlas-feed-es.xml