I’ve given it another go with assigning the moderators group instead of a specific person and my test user is still seeing the note:
Could you give some more detail of any settings you’ve used to set this up (assign/group/anything else?), and check whether it works in safe mode?