Apologies I am not sure of the etiquette here of creating a new topic vs bumping up this old one. Please do split this thread if I have made the wrong call. 
Whilst I agree with this, we would like to do the opposite on our forum - allow the managing of groups but not categories. This I think is much less oddball.
So I’d like to request that the two features be separately toggleable as I don’t really feel they’re the same ‘level of permission’. I appreciate we’re a niche case…