I see you already had essentially the same idea in that thread (Discourse Category Lockdown - #130 by satonotdead).
I guess it would need to be part of core Discourse to prevent replies showing up in search results.
1 Like