A proposed standard file (placed at /llms.txt in a website’s root) that websites can use to provide explicit guidance to AI crawlers about which content should be included in AI training or responses. Similar to robots.txt, llms.txt would let you exclude certain pages, set crawl rules, and specify how AI systems should cite your content. The standard is still emerging and adoption is early, but some AI companies are exploring it as a way to respect publisher preferences. Whether to implement llms.txt is a strategic choice — blocking crawlers may reduce AI visibility but protects proprietary content. Read the llms.txt guide.
Part of the Plain Intelligence glossary. See all terms.