Restrict answers to trust levels

What if we actually do want to hide the answers not just the restrict permission to reply? The ‘see’ column is grayed out.