llms.txt
llms.txt exposes a structured, machine-readable index of your documentation, helping large language models discover and understand your content efficiently. And the best part: Theneo generates it automatically.
What is llms.txt?
llms.txt is a plain-text file that provides a structured summary of your documentation, including:
- The title and description of each section
- Direct links to the corresponding Markdown (
.md) source files - A hierarchical overview of your content structure
This lets AI tools, developer assistants, and LLM-powered integrations index your docs accurately, without crawling or parsing your full rendered HTML site.
How it works
Theneo generates your llms.txt automatically from the SEO management data you’ve already configured for each page. No extra setup is needed for pages that already have SEO fields filled in.
The file is built from these existing fields:
- Title: the section title used in search-engine metadata
- Description: the SEO meta description for the page
- Slug: the URL path segment used to build the page link
Each entry maps one documentation page to its title, a short description, and a direct link to its Markdown source.
File format
The generated llms.txt follows this standard structure:
# <Site Title>
> <Site-level description>
## <Section Name>
- [<Page Title>](<link-to-.md-file>): <Page description>
- [<Page Title>](<link-to-.md-file>): <Page description>
## <Section Name>
- [<Page Title>](<link-to-.md-file>): <Page description>
Improve coverage with SEO data
Because llms.txt is generated from your SEO fields, its quality depends on how thoroughly they’re filled in:
- Title: keep titles concise and specific (e.g. “Authentication Overview” rather than “Overview”).
- Description: summarize the page in one or two sentences; this is what LLMs use to understand its purpose.
- Slug: use clean, readable slugs that reflect the hierarchy (e.g.
/guides/authentication).
To review or update SEO data: from the project dashboard, go to SEO Management, edit the Title, Description, and Slug fields, and click Save Changes.
Verify your llms.txt
Confirm the file is live and well-formed by visiting it directly or using curl:
curl https://app.theneo.io/theneo/quickstart/llms.txt
Check that all major sections are represented, each entry has a title, a valid .md link, and a description, and the file is reachable without authentication (it must be public to be useful to external LLM systems).
FAQ
Which pages are included?
Which pages are included?
All published pages with SEO metadata (title, description, and slug). Draft and unpublished pages are excluded automatically.
How often is the file updated?
How often is the file updated?
It regenerates every time you publish a change, no manual refresh needed.
What if a page is missing a description?
What if a page is missing a description?
The page still appears, but with a blank description. Fill in descriptions for all pages to maximize usefulness to LLM consumers.
Are header sections excluded?
Are header sections excluded?
Yes. Header sections (labels or groupings without content of their own) are automatically excluded from the generated llms.txt.
On this page
- llms.txt