Here’s the fix:
https://github.com/discourse/discourse/commit/cfd0a04965fc058012b02d40da05384f61f951a7
This issue was because the wizard last step was not saving changes and that is why the banner was not disappearing. Completing the last wizard step (step 6) again should make the banner go away.
Thanks everyone for reporting this issue and helping with debugging! 