After some discussion, we’ve decided to fix this issue by making it more clear that the existing section does in fact apply to direct messages as well.
We’ll keep listening if folks think there’s a need to have separate settings for public channels vs. direct messages, but for now this seems like a safer route to start with.