How to setup moderators with just access to remove or update topic categories

If all you need to for those users to move topics between categories trust level 3 is enough.