What Is llms.txt and Does Your Website Need One in 2026?

llms.txt is a plain Markdown file placed at yourdomain.com/llms.txt that gives AI tools a short summary of a website and links to its most useful pages. Jeremy Howard proposed it in September 2024. Google Search does not use it, and no major AI company has confirmed its crawlers rely on it, so it is optional.

That does not make it useless. It costs little to add, Shopify now creates one for every store, and it can help AI agents and coding assistants that read documentation. But it is not a ranking factor, and it will not get your business into ChatGPT or Google’s AI Overviews on its own.

What is llms.txt?

The proposal was published at llmstxt.org by Jeremy Howard, co-founder of the AI research company Answer.AI, on 3 September 2024. The page was revised again in August 2026.

The idea is simple. Large language models work with limited context, and ordinary web pages are full of menus, scripts, cookie banners and adverts. A small Markdown file at the root of a site can point a model straight to the pages that matter, written in a format that is easy for both people and machines to read.

The proposal also suggests that sites offer clean Markdown copies of their pages at the same address with “.md” added, for example /pricing.md. This part is much less common in practice.

What does an llms.txt file look like?

The format follows a fixed order. Only the first heading is required; everything else is optional.

Part	Required?	What it contains
H1 heading (# Name)	Yes	The name of the site or project
Blockquote (> text)	No	A one or two sentence summary
Notes	No	Short paragraphs or lists with key details, but no headings
H2 sections (## Title)	No	Lists of links, each written as [name](url) with an optional note after a colon
## Optional	No	Secondary links an AI tool can skip if it needs less context

A simple example for a fictional furniture shop would contain these lines, in this order:

• # Oakline Furniture
• > Oakline Furniture makes solid wood dining tables and chairs in Leeds and ships across the UK.
• All prices include VAT. Delivery takes 4 to 6 weeks for made-to-order items.
• ## Products
• – [Dining tables](https://example.com/tables): Sizes, wood types and prices
• – [Chairs](https://example.com/chairs): Styles and fabric options
• ## Help
• – [Delivery and returns](https://example.com/delivery): Costs, timelines and the 30-day returns policy
• ## Optional
• – [Our story](https://example.com/about): Company history

Keep it short. A file of 20 to 50 carefully chosen links is more useful than a dump of every URL on the site, which is what your XML sitemap is for.

How is llms.txt different from robots.txt and a sitemap?

File	Purpose	Who reads it	Controls access?
robots.txt	Tells crawlers what they may and may not fetch	Search engine and AI crawlers, widely supported	Yes, for crawlers that respect it
sitemap.xml	Lists URLs you want indexed	Search engines	No
llms.txt	Summarises the site and points to key pages	Some AI tools and agents; not Google Search	No

The key point: llms.txt cannot block anything. If you want to keep your content out of AI training, you still need robots.txt rules for crawlers such as GPTBot (OpenAI) and the Google-Extended token.

Which AI companies say they use llms.txt?

This is where most of the confusion lies. Based on official statements and documentation checked in October 2026, the picture is as follows.

• Google Search: does not use it. Google’s Gary Illyes said in July 2025 that Google does not support llms.txt and was not planning to. Google’s AI optimisation guide, last updated in July 2026, states that Google Search itself does not use these files, and that creating one will neither help nor hurt your visibility in Search.
• Google Chrome: checks for it. Search Engine Journal reported in May 2026 that Chrome’s Lighthouse 13.3 added an experimental agentic browsing audit that includes llms.txt. This is about helping browser agents understand a site, not about rankings or citations.
• OpenAI, Anthropic and Perplexity: no confirmation. Their crawler documentation tells site owners to manage access through robots.txt and does not say their crawlers read llms.txt. OpenAI and Anthropic do publish llms.txt files for their own developer documentation.
• Shopify: serves one by default. Shopify’s developer changelog of 28 May 2026 confirms every store now has an agents.md file, with /llms.txt and /llms-full.txt showing the same content unless the merchant customises them.

Independent data points the same way. A server log study by Ahrefs, reported by PPC Land in July 2026, covered 137,000 domains and found that 97% of llms.txt files received no requests at all in May 2026. Adoption is growing, though: Originality.ai counted 36,120 sites with an llms.txt file in May 2026, up from 4,088 in June 2025.

Pros and cons of adding llms.txt

Pros

• Low cost. On WordPress or Shopify it takes minutes with tools you probably already have.
• Useful for documentation-heavy sites, such as software, APIs and SaaS help centres, where developers point AI coding assistants at docs.
• Gives you a tidy, human-readable summary of your most important pages, which is a useful content audit in itself.
• Ready for AI agents if adoption grows. Chrome’s Lighthouse audit suggests some teams expect it to.

Cons

• No effect on Google rankings or AI Overviews, by Google’s own statement.
• No major AI search platform has confirmed it uses the file.
• Another file to keep up to date. Outdated prices or dead links in it can do more harm than having no file.
• It cannot block crawlers or protect content. Only robots.txt and server rules do that.

Does your website need an llms.txt file?

For most small business websites, the honest answer is no, but it does no harm if your SEO plugin creates one in a few clicks. Treat it as a minor extra, not a project.

It is more worthwhile if you run developer documentation, a software product, or a large knowledge base. Avoid paying a large fee for “llms.txt optimisation”. Spending the same money on crawlability, original content and genuine reviews, the basics covered in good search engine optimisation, will do far more for AI visibility.

How to add llms.txt on WordPress

The two most popular SEO plugins both include an llms.txt option. Use only one method, so you do not end up with two competing files.

With Yoast SEO

1. In your WordPress dashboard, open Yoast SEO and go to Settings, then Site features.
2. Under AI tools, find the llms.txt card and switch it on.
3. Save your changes. To control which pages are listed, choose the manual page selection option.
4. Visit yourdomain.com/llms.txt to check the file loads.

Yoast notes that the feature is not available on multisite installs, and that a “couldn’t be auto-generated” message usually points to file permission settings on the server.

With Rank Math

1. Go to Rank Math SEO, then Dashboard, and turn on the LLMS Txt module. If it is missing, update the plugin.
2. Open Rank Math SEO, then General Settings, then Edit llms.txt.
3. Choose the post types and taxonomies to include and set a limit (the default is 100 items). Noindexed posts are left out.
4. Add any extra links or notes, save, and use the preview link to check the file.

Manually

Write the file in a plain text editor, save it as llms.txt and upload it to your site’s root folder (the same folder as wp-config.php) using your host’s file manager or SFTP. If a caching or security plugin blocks .txt files, add an exception.

How to add or edit llms.txt on Shopify

Shopify stores already have one. Visit yourstore.com/llms.txt to see it. By default it mirrors the store’s agents.md file, which Shopify generates with store details and links for AI agents.

To customise it:

1. In Shopify admin, go to Online Store, then Themes.
2. Click the three dots next to your live theme and choose Edit code.
3. Right-click the Templates folder, choose New file and name it llms.txt.liquid.
4. Write your content in Markdown and save. To change /agents.md, /llms.txt and /llms-full.txt together, create agents.md.liquid instead.

Shopify’s documentation notes some limits. These templates use a restricted Liquid context, so global objects such as shop and collections are not available. The file is served only on your primary domain with no localised versions, and once you add a custom template you must keep it updated yourself. If you use a headless setup, ask your Shopify developer to confirm the file is served correctly.

How to check your llms.txt is working

• Open yourdomain.com/llms.txt in a private browser window. It should load as plain text, not a 404 page or your homepage.
• Check every link works and uses the full URL.
• Remove anything private, such as staging links or internal tools.
• Review it whenever you change prices, products or key pages.

If you would like an outside view on what will actually move your AI and search visibility, Squarebase offers a free growth audit.

Frequently asked questions