Hi Discourse support,
Our Discourse installation recently are running into an issue that lots Jobs::UserEmail keeps getting enqueued way faster than the speed that are getting processed. The jobs will get enqueued every 30mins as the routine scanning process for digest are getting executed. The number of jobs are getting increased in a crazy fast manner so we could easily ended up queuing millions of jobs to be executed within hours then eventually crash the Redis and halt the entire system. Our system only has few hundred K users so apparently there are new jobs for the same user getting enqueued before the previous ones are processed.
We are currently using Discourse 1.7 stable which had just been upgraded from beta. We did not have this issue before the upgrade and kind of lost right now how we could get this issue addressed. The only way for us to stabilize the system is turn off the weekly digest by setting the day to 0. However we do need this feature to work per our marketing requirements.
Could you help?