Tag

robots.txt

1 article

Block AI Crawlers: robots.txt for GPTBot, Claude & CCBot

Copy-paste robots.txt rules to block GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot, plus Cloudflare's one-click block and WordPress options.

Other tags