Just to re-iterate what was said to @zogstrip via PM:
I have this problem in admin too.
Directly visiting /admin includes the Header section from added via CSS/HTML > Header.
Now that the CSS is not loaded in /admin the custom HTML added via Header is unstyled and looks bad.