Trust level groups cannot be used for category moderation?

They can, but they would also be category moderators. So they can review flags and topics BUT they would also be able to close topics