$ man llms-txt

llms.txt

A machine-readable file at your site root that helps LLMs and AI assistants discover and understand your content structure, like robots.txt but designed for AI comprehension.

by Shawn Tenam

robots.txt tells crawlers what they can access. llms.txt tells AI assistants what your site actually contains and how it's organized. It's a content map written for machines — site description, content types, feed URLs, key topics. When an AI assistant encounters your domain, llms.txt gives it instant context about what kind of information lives here. It's a small file with outsized impact on AI discoverability.

Each of the three sites has an llms.txt in the public directory. shawnos.ai/llms.txt maps the blog, knowledge base, how-to wiki, daily logs, content wiki, and context wiki. thegtmos.ai/llms.txt maps the GTM knowledge base and Clay wiki. thecontentos.ai/llms.txt maps the content wiki. Each file lists feed URLs and key topics.