I can reproduce the issue on desktop as well.
I’m not sure that this should be classified as a bug, but it does need to get fixed. Note that there’s a duplicate of this topic in the ux category: Description of notification level isn't refreshed after change. That category would be more appropriate for this issue, but I’ll leave this topic open for now.