# Every crawler, including every AI retrieval and training bot, is allowed everywhere. # Deliberately a single wildcard group: under RFC 9309 a crawler obeys only the most # specific matching group, so adding named User-agent blocks would make those bots stop # reading these rules. Pages that must stay out of indexes carry a robots meta tag. User-agent: * Allow: / Sitemap: https://www.intangible.ai/sitemap.xml