# Block OpenAI's GPTBot User-agent: GPTBot Disallow: / # Block Google's AI crawler User-agent: Google-Extended Disallow: / # Block Anthropic's ClaudeBot User-agent: ClaudeBot Disallow: / # Block Apple's AI crawler User-agent: Applebot-Extended Disallow: / # Block Perplexity AI's crawler User-agent: PerplexityCrawler Disallow: / # Allow all other user agents (including traditional search engines) User-agent: * Disallow: