Make category's post only to be readable by the author / admins and noone else

This is precisely what PMs are for.

Create a group for the users who will be reviewing appeals and have banned users message that group so that they are separated out from any mod mail.