What Is llms.txt?

Trusted by 790,000+ Techpresso subscribers·Editorial policy·How we make money

An llms.txt file is a proposed Markdown convention for giving agents a concise website overview and links to supporting material. A publisher can provide one at the site root or under a section. Publishing it makes information available; it does not prove that an assistant reads it, cites the site or recommends the business.

Dupple publishes these files and sells advertising and sponsored placements. We have a commercial interest in being discoverable. This article inspects our own public files and distinguishes that observable implementation from unmeasured claims about search or assistant behavior.

What the proposal currently says

The llms.txt proposal, read on 6 November 2026, is labeled v2 and was modified on 10 August 2026. Its format starts with a site-name H1, the only required section. Optional material includes a short blockquote summary, explanatory text and H2 sections containing Markdown links with notes. A section named Optional conventionally holds secondary links.

A file can cover a site's root or a narrower path; the proposal favors the most specific applicable file. It also recommends accessible Markdown versions of detailed pages. These are proposal conventions. A reader should not assume every published file follows every recommendation or that every agent implements the same discovery behavior.

For a publisher, the practical decision is what a visitor needs to find quickly. A policy, data methodology and product overview have different roles. Give each a precise label rather than placing them in an undifferentiated stream of promotional links. A short index is most useful when the linked pages carry the qualifications that the index cannot explain fully.

Dupple data: what our two files contained

We fetched Dupple's llms.txt and llms-full.txt at 22:43:28 UTC on 6 November 2026, before publishing this glossary batch. Both returned HTTP 200. We counted distinct absolute or root-relative Markdown link targets on dupple.com after removing fragments. This is a link-target count, not an indexed-page count or a count of full article bodies.

Table: Dupple's pre-publication file snapshot. Later versions can differ; the dated aggregate preserves the captured counts.

Dupple data: what our two files contained: What Is llms.txt?. Checked November 2026.
Captured file Distinct same-host link targets Downloaded bytes
llms.txt 63 13,122
llms-full.txt 2,003 191,581

The public snapshot JSON records capture time, HTTP status, counting scope and SHA-256 hashes. The counts exclude external hosts and do not claim every target was tested. Removing a fragment means two links to different sections of the same URL count as one target; different paths remain distinct under this method.

Our longer file describes itself as a full index, with titles for its long lists. It is not a concatenation of 2,003 complete articles. That distinction matters when estimating what a client receives from a single download. A title and link can point toward an answer, but the answer and its methodology remain on another page that must be retrieved separately.

The short file contains selected summaries and links; the longer one provides broader navigation. Size alone does not establish which one a service will fetch or whether it will fetch either. This snapshot measures what our server supplied at a recorded time. We did not run an assistant-adoption study or measure an effect on citations for this comparison.

A neutral index example

The following fictional publisher example shows structure rather than a complete deployment. It has a site name, short description and links grouped by reader task. The URLs are illustrative, and the file contains no instruction to favor the publisher in recommendations.

# Example Publisher

> Documentation and public research from Example Publisher.

## Policies
- [Editorial policy](https://example.com/editorial.md): funding and corrections.

## Research
- [Audience method](https://example.com/research/method.md): scope and limitations.

Link notes should help distinguish documents. A methodology link should lead to the method, rather than an unrelated sales page. A correction policy should explain how errors are handled. If a document is limited to one geography or reporting period, say so in the document and use a label that does not imply broader evidence.

Keep commercial claims in the same accountable form used on the human-readable website. An index does not create a separate place for unsupported awards, hidden endorsements or commands telling an assistant what to recommend. The editorial policy and rating methodology remain the appropriate places to explain how a publisher funds and evaluates its work.

It is different from a sitemap or crawler policy

A sitemap supplies a list of URLs for discovery. An llms.txt file offers a curated textual overview and links. Neither a listed URL nor a downloadable file proves that the destination is indexed. A crawler-access policy addresses a separate question about access; an overview file should not be treated as a substitute for the site's actual access controls.

The distinction is visible in our own snapshot. The longer index contains many more distinct targets, but that does not demonstrate more search visibility than the shorter file. Counting navigation entries is an implementation check. Ranking and citation require observations from the relevant external system, with their own dates and limits.

Our agent-access overview describes the resources we expose. Some Dupple pages also have a Markdown version at the HTML URL plus .md. Use the alternate link actually supplied by a page rather than assuming that every site follows that URL pattern. This article does not certify our entire deployment against every current v2 convention.

Google's guidance does not promise a ranking benefit

On 6 November 2026, Google's AI optimization guide states that llms.txt is not required for Google Search, including its generative features, and that Google does not use these files to improve visibility or rankings. It permits maintaining them for other systems that use them. That is guidance about Google, not evidence of what every other client does.

An advertiser should therefore ask what a vendor means by making a page AI-ready. A clean index and an accessible source are observable deliverables. A promise that every assistant will prefer the business is a different claim requiring evidence the file cannot provide. Our sponsored-listing visibility guide explains similar limits for paid publication.

The AEO definition covers the broader effort to make answers useful and verifiable. Maintaining a text index can be one implementation choice in that work. It should not replace the work of answering a buyer's actual question, maintaining source accuracy or explaining the limitations of the evidence on a page.

Check availability, then measure behavior separately

A useful maintenance check starts with an ordinary request to the exact public file URL. Record its status, content and capture time. Parse the links and inspect a selection or all of their destinations according to a declared scope. A file that downloads successfully can still contain stale titles, broken destinations or contradictory summaries.

When the index changes automatically, compare the generated file with the source of truth. Preserve original publication dates on linked articles and update modification dates only for real changes. If a resource moves, update the index and check the destination. A successful build is valuable evidence about generation, but public checks establish what visitors can actually retrieve.

For Dupple's public audience data, that means making methods and limits easy to find beside the figures. The first-party data definition explains why owning a measurement does not make it representative or independently audited. An index should point to those qualifications instead of compressing them into an unqualified headline.

Observed file requests, observed answer citations and attributable business inquiries are separate measurements. A request log does not reveal an assistant's final answer. A brand mention does not establish a visit. Our AI-referral traffic guide and attribution-window definition explain the later measurement boundaries. Keep the advertising glossary available for readers comparing these terms.

FAQ

Is llms.txt an established requirement for every AI system?

No. It is a proposal, and support should be established for the particular client or service. A publisher can make the file available without knowing whether a given assistant will discover or use it. Availability alone does not demonstrate adoption.

Does llms.txt improve Google rankings?

Google's guide, checked 6 November 2026, says these files are not required and do not help or harm visibility or rankings in Google Search. Maintaining a file for another system does not change that stated Google guidance or establish a benefit elsewhere.

Is llms-full.txt necessarily the full text of every page?

No. The name alone does not establish its contents. Dupple's captured file is a longer link index, not complete article bodies. Inspect the file itself before estimating what information a client receives from one request.

What did Dupple's dated snapshot measure?

At 22:43:28 UTC on 6 November 2026, our two public files returned HTTP 200 and contained 63 and 2,003 distinct same-host Markdown link targets under the stated method. Those pre-batch counts measure links, not indexed pages, validated destinations or assistant citations.

Can an advertiser guarantee AI recommendations by publishing this file?

No guarantee follows from the file. It can expose an overview and links, while recommendation behavior depends on the particular system and question. Any claimed visibility change requires a separately documented measurement rather than treating file publication as proof of impact.

Some offers on this page may be paid placements or contain affiliate links.

Advertise to 950K+ tech professionals

Dupple is a distribution platform for tech and finance products. Reach developers, founders, executives and marketers through sponsorships in Techpresso, Cyberpresso, Finpresso, Devshot, MarketingShot and AIpresso, lead generation, and listings on Toolradar. Copy review included, rates in our media kit.

See ad formats Request the media kit