Thanks @forkythetoy and @Hooksmith for bringing this to my attention, I confirmed this is a huge query even here on meta. I will write a fix for this today, it should be as simple as only using the topic IDs for the topics that show on the New list for a user, rather than all topics ever. Will post back here when I have the patch.