# Search engines may index this site. User-agent: * Allow: / # AI training crawlers: the writing here is not licensed for model training # (see /terms, "Text and data mining"). Compliance is voluntary for crawlers. User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: meta-externalagent Disallow: /