Yeah, this is easily done with the category settings.
Depending on your use case, you might also find the topic timer feature useful, and in particular the “delete replies after N days” option. That makes it so people can give feedback but that doesn’t stay around forever. You can move the more useful replies to a new topic to preserve them.