Thanks for clarifying.
Would you consider at least making CategoryList::CATEGORIES_PER_PAGE or CategoryList::MAX_UNOPTIMIZED_CATEGORIES configurable in some manner? even a hidden site setting would work for my case.
Writing plugin code to replace these is somewhat ugly as I can’t find any other way than monkey patching CategoryList which feel extremely fragile.