Difficulty understanding the enable welcome banner setting

Seems like it’s behaving correctly on your theme on your hosted site ATM. This is interesting though:

Maybe we just keep an eye out and see if it keeps happening? Also feel free to start a PM with me if you’d like to discuss the hosted site specifics further.