Some sites might want to add a llms.txt file to aid the LLMs to be able to crawl the site better. Here’s an example how how the file should look.
You can simply do the following to achieve this functionality:
- Create your txt file and upload it to a topic in the Staff or any other private category so that people can’t see it.
- Copy the file’s URL by right-clicking →
Copy link address
- Visit the
https://yoursite.com/admin/config/permalinks
- Create a new permalink by choosing the
Type
asExternal or Relative URL
. - Add
llms.txt
in URL and paste the copied link in theExternal or Relative URL
box and hitSave
.
Now when you visit https://yoursite.com/llms.txt
, you’ll see the file you uploaded.