llms.txt File: A New Standard for AI Models

Like robots.txt for search engines, llms.txt is for AI models. Learn how to create and use it to improve your site's AI visibility.

What is llms.txt?

llms.txt is a new standard (since September 2024) that provides AI models with a structured overview of your site.

Location: https://kodulehehaldus.com/llms.txt

The idea was initiated by Jeremy Howard (Answer.AI).

Difference from robots.txt

Aspect	robots.txt	llms.txt
Target Audience	Search engine crawlers	AI/LLM models
Purpose	What can be indexed	What to offer to AI
Content	Allowed / blocked URLs	Content summary + links
Standard	Established, universally followed	New, emerging

llms.txt Structure

# Kodulehe Haldus

> Estonia's professional website management and development service. 20+ years of experience, 200+ clients.

Services - [Website Management](https://kodulehehaldus.com/kodulehe-haldus): WordPress management, security, updates starting from €50/month - [Website Development](https://kodulehehaldus.com/kodulehe-tegemine): Modern design and development - [Website Optimisation](https://kodulehehaldus.com/kodulehe-optimeerimine): Core Web Vitals, speed, SEO - [Website Security](https://kodulehehaldus.com/kodulehe-turvalisus): Audits, malware removal, WAF

Blog (Top Articles) - [Technical SEO Audit](https://kodulehehaldus.com/blogi/tehniline-seo-audit): 30-point checklist - [Core Web Vitals Guide](https://kodulehehaldus.com/blogi/core-web-vitals-taielik-juhend) - [GDPR Compliance](https://kodulehehaldus.com/blogi/gdpr-vastavus-kodulehel)

Contact - Email: info@kodulehehaldus.com - Phone: +372 5699 0777 - Location: Tallinn, Estonia ```

llms-full.txt

The full version (all articles in markdown format in one file) allows the AI to get the entire context.

Hosts: - https://kodulehehaldus.com/llms.txt – Overview - https://kodulehehaldus.com/llms-full.txt – Full content

Who is using it?

Adoption 2026: - Anthropic Claude – Officially supported - Perplexity – Uses as a signal - ChatGPT – Via plug-ins - You.com – Actively - Phind – Yes

Google Gemini has not officially confirmed, but tests show an impact.

Benefits

1. Better AI Understanding No need for the AI to figure out what your site does on its own.

2. Correct Links in AI Answers If llms.txt mentions "Price: €50/month", the AI will report it correctly.

3. Brand Control You determine which pages are important to the AI.

4. Fewer Tokens The AI doesn't have to scrape the entire site – llms.txt is sufficient.

Steps to Create

1. Basic Info - Site name - 1-sentence description - Main categories

2. Top URLs - Primary service pages - 10–20 best blog articles - Contact information

3. Markdown Formatting ```markdown # Site name

> Description

Section - [Link name](URL): description ```

4. Hosting - Upload to the root directory: `/llms.txt` - Nothing else required

5. Generating the Full Version A plugin or script that takes all blog articles in markdown and puts them into `llms-full.txt`.

Tools

llmstxt.org – Official standard
llms-txt generator – Auto-generation
WordPress plugin – For WordPress

What NOT to include in llms.txt

Private information
Internal URLs (admin, staging)
Advertisements
Outdated content
Everything automatically (choose the best content)

Verification

Test if llms.txt is working: - Published URL: https://yourdomain.com/llms.txt - Content-Type: text/plain (or text/markdown) - Normal cache headers - File size under 100 KB (recommended)

llms.txt + AI SEO Strategy

llms.txt complements other AI optimisations: - AI Overviews Optimisation - ChatGPT & Perplexity Mentions - Schema Markup

Is it worth doing?

Yes, because: - Investment is only 1–2 hours - Adoption is growing rapidly - Zero risk - Benefits grow with the share of AI-driven traffic

The Future

2027 forecast: - llms.txt = New standard (like robots.txt today) - Google officially supports it - WordPress installs it by default - SEO tools (Ahrefs, Semrush) tracking implementation

Summary

llms.txt is a simple, proactive measure for the AI era. A 2-hour job that pays off over the next 5 years. Our SEO service includes llms.txt configuration – we have already implemented it on our own site. Request a quote.