There is the Only allow specific users to send me personal messages or chat direct messages on your Preferences/Users page if that’s any help in the short term?
I think it has been suggested that this could be extended to allow/disallow groups/trust levels, which may work better for your use case.