Website LLMs.txt

About this plugin

Questions

Why is my llms.txt smaller after updating to 8.5.4?

The plugin now leaves out anything an anonymous visitor cannot read on your site. If you use a membership or access control plugin, your posts and pages are left out by default, because there is no reliable way to tell from the database which of them a visitor can read. The “Excluded content” summary on the settings screen shows what was left out, and you can include individual posts and pages from the editor.

If your file was generated before this update it may have listed content that is not publicly visible, including titles and links. The file is rebuilt when you update. If you have shared or submitted a copy of it anywhere, it is worth replacing that copy.

What is llms.txt?

llms.txt is a plain-text or Markdown file placed at the root of your domain (for example https://example.com/llms.txt) that lists your site’s most important public URLs. It helps large language models (LLMs) like ChatGPT, Claude, and Perplexity better understand your site’s structure and priority content.

How does the Website LLMs.txt plugin work?

The plugin automatically generates and maintains your llms.txt file based on published content. It pulls titles and descriptions from your site, respects SEO plugin settings (Yoast SEO, Rank Math, SEOPress, and AIOSEO), and excludes anything marked as noindex or nofollow. The file is then served from your site root, ready for AI crawlers to read.

How often is llms.txt updated?

You can set the update frequency in the plugin settings: immediate, daily, or weekly. You can also click “Generate Now” in the admin panel to rebuild the file at any time.

Does this guarantee visibility in ChatGPT, Claude, or Perplexity?

No. There’s no guarantee that any AI model will immediately use llms.txt, but it’s clear that several systems, including GPTBot, ClaudeBot, and PerplexityBot, are already crawling these files. Using llms.txt positions your site ahead of the curve as AI indexing becomes more structured.

What if my host doesn’t allow writing to the root directory?

The plugin also writes a copy of the file into your uploads folder, and on hosting where the root directory cannot be written, such as WordPress VIP, that copy is the only one. WordPress serves it at https://example.com/llms.txt through a rewrite rule the plugin registers. Rewrite rules are stored and are not rebuilt on their own, so if /llms.txt returns a 404 on a site that has already generated the file, use “Clear caches” on the plugin settings screen, or re-save your permalinks under Settings → Permalinks.

Does it work with SEO plugins like Yoast or Rank Math?

Yes. It automatically integrates with Yoast SEO, Rank Math, SEOPress, and AIOSEO. Pages marked as noindex or nofollow in any of those plugins will be excluded from your llms.txt file automatically.

Will it conflict with sitemap.xml or robots.txt?

No. llms.txt complements your sitemap and robots file. Sitemaps tell search engines what to crawl; llms.txt helps AI systems understand what’s most valuable. They work together without overlap or conflict.