Making it so other users can't "invite" you to a topic

What if one user wants to disable them altogether, while another user wants to allow them from all trust levels?