Isolated disc on the left, connected by a faint line to a distant group, almost never reached.
Oct 29, 2026·7 min·GEO & AI

Does llms.txt work? What the data shows

Does llms.txt work? See what studies with thousands of domains show, Google's official position on the file, and when it is actually worth implementing.

highlights

  • Five independent studies show near-zero use of llms.txt, with real access rates close to zero across most domains.
  • Google confirmed that Search does not use the file and has no plans to start.
  • Implementing it takes minutes and has no downside, but the expected return for AI citation is low.
  • Technical documentation and developer-facing products are the cases where the file still makes sense.

No, in practice it does not work to increase AI citation or Google ranking, at least based on what the data shows so far. Google has publicly confirmed it does not use the file, no major LLM has declared official support, and the few large-scale studies that measured actual access to the file found almost no use. That said, implementing it takes minutes and has no known downside, so the "is it worth it" answer depends less on effectiveness and more on your type of site.

―――

What it is and what it promised to solve

llms.txt is a plain-text Markdown file, published at the root of the domain (yoursite.com/llms.txt), proposed in 2024 by Jeremy Howard as a way to list, in a structured format, the most important pages for a language model to read. The idea was to work as a sitemap written for AI instead of for traditional search engines.

―――

What Google says

In July 2025, Gary Illyes, from Google's Search team, confirmed that Search does not use llms.txt and that there are no plans to start. John Mueller reinforced the position by comparing the file to the old keywords meta tag, a standard any site could declare about itself with no verification, which is why it could never be trusted as a ranking signal. Mueller repeated that position in June 2026, so this is not an isolated or outdated comment (seohappyhour.com).

―――

What large-scale studies show

StudySampleFinding
Ahrefs, Jun 2026137,000 domains with valid llms.txt97% never received a single request to the file
SE Ranking, Nov 2025~300,000 domainsNo correlation between having llms.txt and appearing in AI citations; only 10.13% of domains had the file
Limy, May 2026515 million events / 500 million visitsAbout 400 direct accesses to the file
OtterlyAI62,000 bot visits in 90 days84 accesses to llms.txt (about 0.1%)
Dejan, Jul-Aug 2026Logs from 1 domain, 20 days4 accesses to llms.txt vs. 1,150 to robots.txt

(Sources: oxigenweb.com.br and usecontentor.com)

Five independent studies, different periods, different methodologies, and all of them converge on the same pattern: the file exists on a small fraction of sites, and even when it exists, almost no one reads it. Five sources pointing in the same direction is a sign of consistency, not an isolated sample.

In practice: if your goal is AI citation in the short term, llms.txt is not the place to invest time. The expected return, based on this data, is close to zero.

―――

Why the question keeps coming back

It is worth noting: this question keeps coming back in SEO forums with unusual frequency for a technical feature with such limited impact. "Has anyone used llms.txt?", "where are we with this?", "is it worth it" show up again every few months, usually with no clear resolution in the thread. There is a simple explanation: implementation is cheap, and the marketing discourse around GEO keeps pushing the file as "essential," so professionals keep testing it individually without sharing results, and the cycle of doubt starts over.

―――

llms.txt and llms-full.txt are not the same thing

Part of the recurring confusion comes from two files with different purposes being treated as synonyms. llms.txt is meant as a lean index, with links and short descriptions, closer to a table of contents. llms-full.txt is a separate proposal that tries to embed the full content of the listed pages inside the file itself, meant to reduce the need for the agent to follow each link individually. None of the studies cited above measured adoption or reading of llms-full.txt separately, so there is no specific data on it here. In my assessment, there is no reason to expect a different result from the lean llms.txt: if the problem is that the short file already goes unread, a heavier file to keep in sync tends to cost more work for the same return. If you are going to implement one, start with the lean llms.txt.

―――

When it is worth implementing anyway

There are narrower use cases where the file makes sense, independent of search citation:

  • Technical documentation and developer products. The most cited real implementations come from companies like Cloudflare, Mintlify, and Anthropic, precisely in this profile, where AI coding tools (assistants inside IDEs) can consume the file directly during development, outside the search context.
  • Products with a stable structure, where keeping a second list of pages updated does not turn into duplicate work with every publication.
  • Low opportunity cost. If your CMS or SEO plugin already generates the file automatically (some WordPress plugins do this), there is no strong reason not to have it, even with no expectation of results.

Where the effort does not pay off: content blogs chasing citation in AI answers, e-commerce with a large catalog (keeping the list in sync turns into constant manual work), and any site that changes structure frequently.

Site typeWorth implementing?Why
Technical documentation and developer productsYesAI coding tools can consume the file directly, outside the search context
Product with a stable structureYesKeeping the list updated does not turn into duplicate work with every publication
CMS or plugin that already generates the fileYesLow opportunity cost, even with no expectation of results
Content blog chasing AI citationNoStudies show almost no use of the file
E-commerce with a large catalogNoKeeping the list in sync turns into constant manual work
Site that changes structure frequentlyNoThe list goes stale too fast to be worth it
―――

How to create one, if you decide it is worth it

Recommended minimal structure, in Markdown:

# Company Name

> One sentence describing what the company does.

## Main pages

- [Page name](https://yoursite.com/page): short description of what is there
- [Another page](https://yoursite.com/other): short description

## Documentation

- [Getting started guide](https://yoursite.com/docs/getting-started): short description

After publishing, check your logs to see if anything beyond your own test is actually accessing the file:

grep "llms.txt" access.log | wc -l

If the number after a few weeks is close to zero, that confirms the pattern from the studies above for your specific site, and it is a good reason not to invest more time in this than the minimum necessary.

// real case: in none of the cases I have tracked did llms.txt prove effective. It still looks like a weak hypothesis, but a cheap one to test.

―――

Frequently asked questions

No. They are files with different functions: robots.txt controls access (what the bot can or cannot access), llms.txt tries to guide reading priority. See the full guide on AI bots and robots.txt.

If you already published an llms.txt, the logs over the next few weeks will show whether anyone reads it, and you can compare them with the studies above. If you have not, it can wait: what matters more is making sure the content itself is accessible, as the technical checklist for AI crawlers shows. This article is part of the pillar GEO in practice: how to get crawled, understood, and cited by AI search engines.

―――author
Lucas Cassapula

Lucas Cassapula

Partner & Head of SEO at Wesearch and Co-founder of Mentionflow

I am a partner at Wesearch and co-founder of Mentionflow. I have worked with SEO for almost 10 years. I am a data-driven geek who is always testing hypotheses, looking for patterns and turning ideas into products. I share studies, experiments and automations focused on SEO and GEO.