Proposed by Jeremy Howard in September 2024, it starts with your name, a one-line summary, then lists of links to your most useful pages. It is a community proposal, not an official standard.
Google says you don't need AI text files to appear in its AI features. The file is cheap to add and can help AI tools and agents that do look for it, but it won't fix a site that assistants can't read.
Sources
- The /llms.txt file(opens in a new tab) · llmstxt.org
- AI features and your website(opens in a new tab) · Google Search Central