That is an intentional thing. 
You should see a similar one here on Meta in the default Light theme too. It’s to show which topic you were last in, and then disappears once you swop pages/enter another topic.
It is likely that it can be hidden with a little CSS, but when I try and inspect it in my browser it disappears too quick for me to identify. 
I’ll see what I can find out.