Group Based Category Moderation

Isn’t the category moderator exactly what you need? The Group set here only has moderator permissions within that category.