LLMs-full.txt
LLMs-full.txt is a proposed extension to LLMs.txt that includes the full text of content publishers want included in LLM training datasets, allowing direct provision of training data to AI systems.
Definition
LLMs-full.txt extends the LLMs.txt protocol by providing actual content rather than policy directives. A publisher might use this file to supply curated content, documentation, or training examples directly to LLM systems. This approach allows publishers to control exactly which content is accessible for training and synthesis, avoiding the risk of incorrect content being retrieved or paraphrased.
Adoption of LLMs-full.txt is nascent and limited. The approach requires significant infrastructure investment and assumes LLM providers will parse and ingest such files. Some organizations view direct content provision as a way to improve accuracy in citations and ensure brand voice and content control. Whether this becomes standard practice depends on whether AI providers see value in ingesting publisher-curated training data.
Why it matters for AI visibility
Direct content provision through LLMs-full.txt ensures your content is used accurately and in appropriate context. Rather than allowing LLM systems to extract content through general crawling, you provide clean, approved content explicitly. This reduces risk of misquoting or misrepresenting your brand while giving you control over which content is accessible.
Related terms
LLMs.txt
LLMs.txt is a proposed convention: a plain markdown file served at the root of a website that gives large language models a curated summary of the site's most important content. It helps AI systems find, understand, and use the right pages at answer time instead of parsing cluttered HTML.
GEOAGENTS.md
AGENTS.md is an open convention: a markdown file placed in a code repository that gives AI coding agents project-specific instructions, such as how to build, test, and navigate the codebase and which conventions to follow. It works like a README written for machine collaborators instead of human ones.
GEOAI Web Crawlers
AI Web Crawlers are automated systems deployed by LLM providers and AI companies to index and retrieve web content for LLM training, inference retrieval, or answer synthesis processes.
GEOAI Indexing
AI Indexing is the process by which LLM providers and AI systems crawl, parse, and store web content for use in LLM training, retrieval-augmented generation, or answer synthesis processes.