This happens when you are tracking a group, if you want individual notifications for every reply watch the group instead.
Tracking a group is a softer level of notifications that helps you keep track of how many “non-archived” messages the group has.