Decide your policy for AI crawlers on WordPress
Why it matters
This is a summary of which AI crawlers your robots.txt allows or blocks, not a fault. Whether to allow them is your choice, because asking training crawlers to stay away is a request that well-behaved ones honour, while blocking AI search crawlers can reduce how often you are cited in AI answers.
The fix
- Edit robots.txt with your SEO plugin's file editor, or upload a physical robots.txt to the web root, and add the groups from the generic tab. Some SEO and security plugins also have a built-in switch for AI crawlers; check their settings.
Related
- Reported by the AI crawler access rules check
Scan your domain to see whether this applies to you.