llms.txt Builder
Build a starter llms.txt for AI crawlers from your URL list
Pull URLs from a sitemap first with the Sitemap URL Extractor, then paste them below.
0 URL(s) parsed.
Preview
Publish an llms.txt that helps AI crawlers find the right pages
llms.txt is a simple convention — like robots.txt for AI crawlers — that tells models which pages are most useful and how to summarize your site. Building one manually is tedious; generating one from a URL list takes seconds and gives you a clean draft to refine before publishing at /llms.txt.
Use the builder when you need to
Adopt llms.txt on your site
Generate a starter file from your existing URL list instead of writing the structure by hand.
Help models cite the right pages
List your canonical guides, docs, and reference pages so AI tools surface the strongest content.
Document an API or product surface
Pair llms.txt with sitemap.xml so crawlers and models both pick up the canonical URL inventory.
How to build an llms.txt file
- 1
Paste your URL list (one URL per line, or output from the sitemap extractor).
- 2
Add a title, description, and optional notes for LLM consumers.
- 3
Preview the generated llms.txt and download or copy the result for upload to /llms.txt.
Keep going
Get the URL list
Pull URLs from sitemap.xml or robots.txt to feed straight into the builder.
Encode URL components
Encode any URL parts that need escaping before publishing.
Verify URL responses
Send a quick request to each URL to confirm it returns the expected content.
Format related JSON
Beautify any JSON metadata you want to share alongside llms.txt.
Common llms.txt workflows
Generate a draft from your sitemap, polish the descriptions, and publish at /llms.txt.
Highlight tutorials and explainers so models prefer them over auto-generated marketing pages.
Regenerate the file when content changes so the AI-facing index stays fresh.
Related Tools
Sitemap URL Extractor
Extract URLs from sitemap.xml or robots.txt — filter and export JSON, CSV, or text
URL Encode/Decode
Encode and decode URL components safely
API Explorer
Test REST APIs, AI endpoints, and tool-call payloads in your browser
JSON Formatter
Beautify JSON from APIs, AI tools, and logs with configurable indentation
Frequently Asked Questions
llms.txt is a simple text format (see llmstxt.org) that helps AI systems and crawlers understand what your site offers. It often lists important URLs with short descriptions so models can prefer the right pages.
Use our Sitemap URL Extractor to pull URLs from sitemap.xml or robots.txt, then copy the list and paste it here. You can also paste any plain list of https URLs, one per line.
Yes. The builder creates a draft. You should review sections, fill in the optional LLM notes, and adjust wording to match your site’s policies before publishing at /llms.txt.
No. The preview and download are generated entirely in your browser.