PostgreSQL runaway IO

[sam (Sam Saffron)]

@codinghorror

Surprising that you are running into this with 17k posts in one topic, I view 20k as the “starting to be a problem” cutoff. But maybe we should set the bar lower cc

I have mentioned this particular issue before… it is totally unrelated to @tgxworld’s work.

Reschedule sidekiq scheduled job

If we give up the requirement for a gemetric mean of read time on every post on large topics, we can make the job much faster and then its a lot less likely to kill his system at 3AM. In theory that code should work, my guess is that it is writing it to the wrong part of redis, you want to be at the default site of the multisite.

I am still not buying that we are getting any value from “geometric mean of all read times for all posts”… a simple… which posts are read most is probably good enough for the “best of” algorithm.

Plus this whole concept is a bit broken imo cause the further you get to the end of a topic the less people read it.

I think a simple fix here, is to stop doing the whole geometric mean read time thing on topics with more than say 1000 posts. Which is oddly the only time we would use it…