IndexerNow

WordPress

Why isn't my WordPress site showing up in AI answers?

Short answer

WordPress gives you full control, which means the blockers are usually self-inflicted: a robots.txt rule that disallows AI user-agents, a caching or firewall plugin that serves them a challenge page, or content that never states an answer plainly. Fix access first, then structure, then get into Bing's index.

What WordPress lets you control

AI visibility is mostly decided by what the platform will and won't let you change. Here's where WordPress stands.

Sitemap
https://yourdomain.com/sitemap.xml or /sitemap_index.xml — WordPress core ships a sitemap at /wp-sitemap.xml; Yoast and Rank Math replace it with /sitemap_index.xml.
robots.txt
You can edit it. You control robots.txt fully — either as a real file or through your SEO plugin's editor.
Rendering
Classic WordPress renders on the server. Headless setups with a JavaScript front end need checking separately.
Hiding a page
Per post: your SEO plugin's advanced tab. Sitewide: Settings → Reading → "Discourage search engines", which should be off on a live site.
Custom head code
Any SEO plugin, a snippets plugin, or wp_head() in your theme. WordPress is the least restricted platform here.
llms.txt
You can serve a real /llms.txt — upload it to the web root or generate it from a plugin route.

What stops a WordPress site being cited

  • Security and firewall plugins (Wordfence, Cloudflare bot rules) frequently block AI crawlers as "bad bots" before robots.txt is even consulted. Check your firewall logs, not just robots.txt.
  • Many SEO plugins ship an "AI crawler blocking" toggle that is on by default. Blocking OAI-SearchBot removes you from ChatGPT Search answers, not just training.
  • Page builders (Elementor, Divi) wrap text in deeply nested divs. It's readable, but the answer gets buried under layout markup — headings matter more here, not less.
  • Your SEO plugin's automatic FAQ schema only fires if you use its FAQ block. Hand-written questions in a paragraph produce no schema at all.
  • Cached HTML served to bots can be weeks stale. If you updated a page and the assistant still quotes the old claim, purge the cache and resubmit.

How to make your WordPress site quotable by AI assistants

  1. 1Open yourdomain.com/robots.txt and confirm GPTBot, OAI-SearchBot, ClaudeBot, and PerplexityBot are not disallowed.
  2. 2Check your firewall or CDN bot rules — allow the AI user-agents explicitly if the ruleset blocks unknown bots.
  3. 3Restructure your top pages answer-first: H2 as the question, first sentence as the answer, supporting detail underneath.
  4. 4Add FAQ schema with your SEO plugin's FAQ block, or hand-written JSON-LD, on your highest-intent pages.
  5. 5Publish an /llms.txt listing your best URLs, then push updates through IndexNow so Bing — and therefore ChatGPT Search — sees them the same day.

Check what ChatGPT, Claude, and Perplexity actually see when they fetch your page — crawler access, extractable answers, structured data — then fix the gaps we find.

Check if AI can find your site

WordPress and AI search: common questions

Should I block AI crawlers on WordPress?

Separate the two jobs. Blocking GPTBot opts you out of model training. Blocking OAI-SearchBot, ClaudeBot, or PerplexityBot removes you from answer-time citations, which is where the referral traffic comes from. Most sites want training blocked at most, never answer-time.

Does an llms.txt help WordPress sites?

It gives assistants a curated map of your best content instead of making them infer it from a 4,000-URL sitemap. It's not a ranking factor, it's a discovery shortcut — worth the ten minutes on a content-heavy site.

Why does ChatGPT quote an old version of my page?

Either your cache is serving stale HTML to crawlers, or the assistant is reading an index snapshot taken before your edit. Purge the cache, then push the URL through IndexNow to force a re-fetch.

Getting WordPress into Google is a different job

AI assistants and Google use different indexes and reward different things. The companion guide covers sitemaps, indexing settings, and crawl speed for WordPress.

WordPress indexing guide

Other platforms

27 platform guides · see them all