webzod
account

Resolve the noindex that robots.txt hides on WordPress

seo.indexability.robots_noindex_conflict · effort: minutes

Why it matters

The homepage has a noindex instruction, but robots.txt blocks crawlers from reading the page, so they never see it. Search engines can still list the address, without a description.

Staged change. Do this in stages and check each one before the next, so a mistake does not break your site or your mail.

The fix

  1. Decide whether the site should be in search. If yes, open Settings, Reading and clear Discourage search engines from indexing this site, and remove the Disallow rule in your SEO plugin's robots.txt editor or in a physical robots.txt.
  2. If no, leave the setting on and remove only the robots.txt Disallow, so crawlers can read the noindex.

Read the documentation (opens in a new tab)

Scan your domain to see whether this applies to you.