Skip to content

AI visibility · WordPress

How to let ChatGPT and Claude crawl my site in WordPress

Answer engines can only cite pages their retrieval crawlers are allowed to fetch. Blocking GPTBot, ClaudeBot or PerplexityBot in robots.txt removes you from the answers they generate, and the block is usually copied from a template rather than chosen.

The fix for WordPress

13x detects your framework from the response and hands you this version rather than the generic one — below 50% confidence it hedges and gives you the generic one instead.

Blocked crawlers: .

Most SEO plugins added these. In Yoast → Tools → File editor or Rank Math → General Settings → Edit robots.txt, remove the AI-crawler Disallow blocks and add:

Configuration
User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

Some security plugins (Wordfence, All-in-One WP Security) block these at the firewall too — check there if the robots.txt change alone does not help.

On a different stack? The general version of this fix explains what 13x checks and why it matters, without assuming a framework.

Check your WordPress site

113 deterministic checks against your live URL, in about 30 seconds. Framework detected from the response, so every fix comes back in the form your stack actually uses.

No signup. Results in 30 seconds.

The same fix, other stacks