Correct me if I’m wrong, but this sounds like something that’s been discussed here (see Related, below) which happens because topics are lazy-loaded. When you scroll down from the top, topics pre-load smoothly as you go. But if you’ve jumped to the end, then scroll back up, the earlier topics of various length start loading – and it just looks a bit squirrely as they push everything else down.