llms.txt is a simple text file you place in your website’s root directory. It summarizes what your site does and where its most important pages are, in a plain Markdown format that AI-powered chatbots and search assistants can easily read. It’s not required, but it’s cheap to add and, for now, a step with little competition.
What exactly does llms.txt do?
A web page is designed for humans: menus, ads, images, and JavaScript code all tangle together. When an AI tool tries to read that page, it has to sort through all this clutter before reaching the actual information. According to the original proposal on llmstxt.org, llms.txt skips this clutter and provides a single file with direct summary information and key links.
The file’s structure is quite simple:
- A title (your site’s or project’s name)
- A short description (as a blockquote)
- A few explanatory paragraphs if needed
- Lists of links to the most important pages, grouped under headings
The same proposal also recommends having a plain Markdown version of each page — that is, both a regular HTML version of a page and a plain-text .md version without any styling. This way, when an AI tool visits your page, it can reach the content directly instead of the menu and ads.
How is it different from robots.txt and a sitemap?
These three do different jobs:
| File | Purpose |
|---|---|
| robots.txt | Tells which bots can and can’t access the site |
| sitemap.xml | Lists all the pages on the site |
| llms.txt | Picks out the most important pages and summarizes them for AI |
As Semrush explains, llms.txt isn’t a permissions file; it’s more like a guide that says, “look here, this is my most valuable content.” Google’s Lighthouse tool now checks for the presence of an llms.txt file during site audits; if the file is missing, it’s flagged as “not valid,” meaning it’s not a strict requirement for now (Chrome Developers).
Does it affect search rankings?
No, it’s not a ranking signal in the classic SEO sense. Google has stated it doesn’t use this for search rankings (a dev.to article). So adding llms.txt won’t push you higher in Google search.
But it’s useful for something else: when a customer asks ChatGPT or Google’s AI overview something like “what does this business sell, how long does shipping take,” the model pulls its answer from somewhere. llms.txt and the clean-text version of your pages help show the model accurate, up-to-date information, reducing the chance it guesses (and gives a wrong answer). This field is often called GEO (generative engine optimization) — essentially, SEO adapted for AI-generated answers. We cover this topic in more depth in our article on AI SEO.
No major AI platform (ChatGPT, Google AI Overviews, Claude) has officially confirmed that it reads or takes llms.txt seriously. But companies like Anthropic use the file on their own sites, which at least shows they’re not closed off to the idea.
Who should bother, and who can skip it?
There’s a simple test: do your customers ask AI tools about you? If you offer software documentation, or have an API and developer content, llms.txt pays off more. The file is mostly used by sites offering software documentation, platforms like Vercel and Stripe.
But if you’re a small business — a boutique, a restaurant, a hair salon — the situation is a bit different. If you don’t have documentation and no one is asking an AI for detailed information about you by name, the payoff stays limited. Still, putting the file together is cheap: it won’t hurt, and it might help a little.
What should you watch out for when setting up the file correctly?
- The file name should be lowercase
llms.txt, placed in the site’s root directory (e.g.yoursite.com/llms.txt). - The content should be clean Markdown made up of an H1 heading, a short description, and lists of links.
- All the links need to work. An llms.txt file with the right format but broken (404) links does the opposite of building trust.
- Don’t write it once and forget it — keep it updated as your site changes.
- This file doesn’t replace other fundamentals like a clean robots.txt, an accurate sitemap, and structured data (schema.org) — it should be thought of alongside them.
If your technical setup (your website, your online store) isn’t ready to host this kind of file, it might be more of a priority to shore up your website or e-commerce infrastructure first.
In short
llms.txt is a small, optional file that summarizes your site for AI tools. It doesn’t affect your Google ranking, but it can increase the odds of showing up accurately and up to date in AI answers. For businesses with documentation, or those who think their customers are asking AI about them, it’s a low-cost step worth trying. If you’re curious how accurately AI tools read your site, you can start with a free check-up or our AI visibility service.