Yup, I think you’re bang on with your suspicion. Discourse was not designed to handle thousands of categories, for lots of reasons. We have been doing some work on category loading so that may change in the future.
3 likes