How did you customize the header? The problem is that your header customization depends on the theme selected, but the dark/light toggle only changes the color palette. The result is the same if you select the dark palette in combination with the light theme in your preferences.
The Versatile Banner uses different background images and colors depending on whether a light or dark color palette is active. You could do something similar for your header.