You are wrong. It will be a mess for users. Do a mockup where you have 100+ categories in any order in the sidebar. It is just unusable. But that’s why we have a page for cahtegories.
Sidebar instead, it is for few really important categories choosen by an user, not by admin.