llms.txt 构建
从 URL 列表生成 AI 爬虫用 llms.txt
请先用 站点地图 URL 提取 从站点地图获取 URL，然后在下方粘贴。
已解析 0 个 URL.
预览
Publish an llms.txt that helps AI crawlers find the right pages
llms.txt is a simple convention — like robots.txt for AI crawlers — that tells models which pages are most useful and how to summarize your site. Building one manually is tedious; generating one from a URL list takes seconds and gives you a clean draft to refine before publishing at /llms.txt.
Use the builder when you need to
Adopt llms.txt on your site
Generate a starter file from your existing URL list instead of writing the structure by hand.
Help models cite the right pages
List your canonical guides, docs, and reference pages so AI tools surface the strongest content.
Document an API or product surface
Pair llms.txt with sitemap.xml so crawlers and models both pick up the canonical URL inventory.
How to build an llms.txt file
- 1
Paste your URL list (one URL per line, or output from the sitemap extractor).
- 2
Add a title, description, and optional notes for LLM consumers.
- 3
Preview the generated llms.txt and download or copy the result for upload to /llms.txt.
Keep going
Get the URL list
Pull URLs from sitemap.xml or robots.txt to feed straight into the builder.
Encode URL components
Encode any URL parts that need escaping before publishing.
Verify URL responses
Send a quick request to each URL to confirm it returns the expected content.
Format related JSON
Beautify any JSON metadata you want to share alongside llms.txt.
Common llms.txt workflows
Generate a draft from your sitemap, polish the descriptions, and publish at /llms.txt.
Highlight tutorials and explainers so models prefer them over auto-generated marketing pages.
Regenerate the file when content changes so the AI-facing index stays fresh.
相关工具
常见问题
llms.txt 是一种简单的文本格式（见 llmstxt.org），用于帮助 AI 系统和爬虫理解你的网站提供什么内容。通常会列出重要 URL 并配上简短说明，让模型更容易优先选择正确页面。
可以用我们的 Sitemap URL Extractor 从 sitemap.xml 或 robots.txt 提取 URL，然后复制列表粘贴到这里。你也可以直接粘贴任意 https URL 的纯文本列表（每行一个）。
需要。Builder 生成的是草稿。发布到 /llms.txt 之前，建议你检查各个 section，补充可选的 LLM notes，并根据站点政策调整措辞。
不会。预览和下载都完全在你的浏览器中生成。