This has been what I need to do every time since adding a link to the index with a static name in the prescribed format:
* A Link Text: https://meta.discourse.org/t/an-example-link/
Otherwise the category sidebar links don’t parse into their titles and remain as full urls. This is on the latest Discourse (2025.12.0-latest as of commit 5817b6c).