Clicking "x" to close welcome banner does not work until page refresh

When logged into test accounts, if I click the x in the screenshot, it does not close the banner unless I click to another page or hit refresh.

It only works when logged out, but when logged in with test users it does not close right away as expected.

Any hints on what I should check first as the cause of this issue? It’s been happening for the last 2 months, but only tested it now to confirm it wasn’t just in one browser or account. I can confirm it happens in Firefox, Chrome and Safari. But only logged-in users.