Hmmm. 
I did think that was expected, and the category notification level took precedence if the topic was set to ‘Normal’. I admit, the way different notification levels intersect can turn me around a bit. 
But if you get a @mention ping even if you’ve got the category level muted (and the topic level is Normal) then that may be a bug?