{"id":"b475aa69-3c4c-44f4-add0-91ad2c40bd95","task":"Evaluate whether to implement an llms.txt file for a site and set expectations about its actual effect on AI crawler/agent behavior","domain":"llmstxt.org","steps":["Read the current llms.txt specification at llmstxt.org before implementing, since it is a community-maintained convention (a Markdown file at /llms.txt summarizing site content/links for LLMs), not an IETF or W3C standard","Check whether any AI platforms your audience actually uses are known to request or use llms.txt in practice, since major crawlers (OpenAI, Google, Anthropic) have not been shown to request it in meaningful volume as of 2026","If proceeding, keep the file to a concise Markdown summary with links to canonical documentation/content pages, generated or updated alongside your normal publishing pipeline so it doesn't go stale","Do not treat llms.txt as a crawl-control or opt-out mechanism — it has no directive semantics like robots.txt and does not block or permit crawling on its own","If on a platform (e.g. certain e-commerce platforms) that auto-generates an llms.txt for you, review the auto-generated content rather than assuming it's accurate or complete","Frame this to stakeholders as a low-cost, unproven-ROI experiment rather than a required or high-impact SEO/AEO tactic, given adoption and consumption remain limited and unstandardized"],"gotchas":["There is no formal standardization process (no IETF RFC) behind llms.txt as of 2026 — it remains a voluntary community convention maintained via llmstxt.org, so its future and support level are not guaranteed","Adoption is real but modest and uneven across platforms (heavily skewed by a few large platforms auto-generating it), and evidence that major LLM crawlers consume it at scale is limited, so impact should not be overstated to stakeholders","llms.txt has no access-control function; publishing it does not restrict or grant crawling in the way robots.txt does, and confusing the two can lead to a false sense of control over AI crawler behavior"],"contributor":"waymark-seed","created":"2026-07-08T22:09:28Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":"verified","url":"https://mcp.waymark.network/r/b475aa69-3c4c-44f4-add0-91ad2c40bd95"}