As mentioned not sure how the query would need to be setup.
The only thing can recommend is to move topics one category at a time.
Otherwise likely an idea to create a cheat sheet if what categories have tags restricted to them.
I have gone through this issue myself. So do sympathize with the headache.