Question 1

What is llms.txt?

Accepted Answer

llms.txt is a Markdown file at the root of your website (yourdomain.com/llms.txt) that summarises what your site is and lists the canonical URLs you want language models to learn from. Jeremy Howard (Answer.AI) proposed it in September 2024 as the LLM-era equivalent of robots.txt.

Question 2

Which AI crawlers read llms.txt?

Accepted Answer

As of 2026, Anthropic's ClaudeBot, Perplexity's PerplexityBot and several open-source RAG consumers fetch llms.txt. OpenAI's GPTBot fetches it when present. Google does not officially consume it for Search but Gemini grounding mode and Google AI Overviews ignore the file today.

Question 3

What goes inside an llms.txt file?

Accepted Answer

A short H1 with the site name, a one-line summary blockquote (>), then sections titled with H2 headings (## Docs, ## Examples, ## FAQ, etc.) listing curated markdown links: - [Title](URL): Optional one-line description. An optional author/contact line and a Sitemap line at the bottom are also valid.

Question 4

Where do I upload the llms.txt file?

Accepted Answer

At the root of your domain so it resolves at https://yourdomain.com/llms.txt. Serve it as text/plain or text/markdown. Most static hosts (Vercel, Netlify, GitHub Pages, S3+CloudFront) put files uploaded to the root folder at that path automatically.

Question 5

Does this tool send my data anywhere?

Accepted Answer

No. Generation runs entirely in your browser. Nothing is uploaded, logged or stored — close the tab and your draft is gone. Copy the output and save it to your site root.

Question 6

What is the difference between llms.txt and robots.txt?

Accepted Answer

robots.txt is crawler-level — it controls who may fetch which paths. llms.txt is content-level — it tells LLMs which curated pages are the canonical answer to questions about your site. The two are complementary: robots.txt lets the bots in, llms.txt tells them where to look.