Limit post replies in a category?

No. There’s no per-topic permissions. If you don’t want everyone to be able to reply to the original post, but want people to be able to see the final response, you can use the above “group inbox” solution and the move them to a category once you’ve got a solution you want public.

OR you can teach people in your community not to be helpful.