:18:in `pop'
```
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [March 3, 2025, 7:57am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/5 "2025-03-03T07:57:47Z")
@tgxworld did you have a chance to look at the backtrace?
---
### Author:  [@Isambard](https://meta.discourse.org/u/Isambard)
#### Post date: [March 3, 2025, 9:08am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/7 "2025-03-03T09:08:53Z")
I have been having Sidekiq issues since a forum upgrade a month ago. What command do you use to restart Sidekiq? Just a `sv restart sidekiq`?
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [March 5, 2025, 1:17am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/8 "2025-03-05T01:17:54Z")
Sorry I have not had a chance to take a look yet. Will try and get to it sometime this week.
---
### Author:  [@markschmucker](https://meta.discourse.org/u/markschmucker)
#### Post date: [March 6, 2025, 7:46pm UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/9 "2025-03-06T19:46:52Z")
I’m seeing this in the past few days. Eventually all jobs stop running. Previously I rebooted, but is it safe to delete the critical queue? Is it a redis queue?
I’m up-to-date at 3.5.0.beta1-dev.
Just a wild guess, but sometimes when I’m chatting with the bot it stops responding so I refresh the page or give up. Maybe those cases leave a job hanging?
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [March 6, 2025, 8:21pm UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/10 "2025-03-06T20:21:58Z")
> [@markschmucker](#):
>
> when I’m chatting with the bot it stops responding so I refresh the page or give up. Maybe those cases leave a job hanging?
These jobs are asynchronous so they wouldn’t even know that you did that.
It’s interesting to hear that you are having this on `Jobs::BotInput` as well. We’re seeing this issue on only a small subset of all our servers (a few percent) and it seems to be the instances that use the narrative bot quite heavily.
> [@markschmucker](#):
>
> is it safe to delete the critical queue?
No, you would lose all the other queued jobs as well.
The most easy and safe way is `sv reload unicorn` from within the container.
---
### Author:  [@markschmucker](https://meta.discourse.org/u/markschmucker)
#### Post date: [March 7, 2025, 1:39am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/11 "2025-03-07T01:39:16Z")
> [@RGJ](#):
>
> We’re seeing this issue on only a small subset of all our servers (a few percent) and it seems to be the instances that use the narrative bot quite heavily.
That’s not the case with our forum. AI is only visible to staff and I’ve confirmed no staffers are using it.
I’ve disabled AI for now.
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [March 7, 2025, 8:05am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/12 "2025-03-07T08:05:36Z")
`BotInput` is a job from the Discourse Narrative Bot (aka Discobot), not the AI bot.
---
### Author:  [@markschmucker](https://meta.discourse.org/u/markschmucker)
#### Post date: [March 7, 2025, 10:45am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/13 "2025-03-07T10:45:22Z")
Ah. I have been using the API heavily, as the username discobot.
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [March 10, 2025, 8:36am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/14 "2025-03-10T08:36:34Z")
I had a look at the backtraces and it all points to some problem with the following line:
>
Not exactly sure why that line would cause problems though but it is a line that is not necessary so I’ve dropped it in
[https://github.com/discourse/discourse/pull/31727](https://github.com/discourse/discourse/pull/31727)
@RGJ Do you happen to have `Rails.application.config.eager_load` set to disable for some reason? 🤔
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [March 10, 2025, 8:58am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/16 "2025-03-10T08:58:10Z")
Interesting find, thank you for looking into it.
It’s hard to tell when such an intermittent problem goes away. I have removed that line on the three instances that hung the most often (one of them almost daily). I will check back in here either:
- when one of those instances hangs (we then know that this did not do the trick)
- on Friday if none of them hung (we can then start assuming it was the solution)
> [@tgxworld](#):
>
> Do you happen to have `Rails.application.config.eager_load` set to disable for some reason? 🤔
Nope, didn’t mess with that.
But someone did…
`Rails.autoloaders.main.do_not_eager_load(config.root.join("lib"))`
at [Blaming discourse/config/application.rb at main · discourse/discourse · GitHub](https://github.com/discourse/discourse/blame/main/config/application.rb#L110)
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [March 14, 2025, 1:11am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/17 "2025-03-14T01:11:24Z")
> [@RGJ](#):
>
> Rails.autoloaders.main.do\_not\_eager\_load(config.root.join(“lib”))
@loic Do you recall why we do not eager load the `lib` directory even in production?
---
### Author:  [@RGJ](https://meta.discourse.org/u/RGJ)
#### Post date: [March 14, 2025, 8:30am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/18 "2025-03-14T08:30:54Z")
> [@RGJ](#):
>
> It’s hard to tell when such an intermittent problem goes away. I have removed that line on the three instances that hung the most often (one of them almost daily). I will check back in here either:
>
> - when one of those instances hangs (we then know that this did not do the trick)
> - on Friday if none of them hung (we can then start assuming it was the solution)
While the issues have been occuring this week, they haven’t been happening on the three instances where we removed that `require` line, so I think we can safely assume that this is the culprit 🎉 . Thank you for spotting that @tgxworld , I would have _never_ found that.
Would you be able to backport that fix to stable?
---
### Author:  [@loic](https://meta.discourse.org/u/loic)
#### Post date: [March 14, 2025, 8:50am UTC](https://meta.discourse.org/t/sidekiq-hangs-on-botinput-job/352661/19 "2025-03-14T08:50:41Z")
> [@tgxworld](#):
>
> @loic Do you recall why we do not eager load the `lib` directory even in production?
It’s related to what’s explained here (when we upgraded to Rails 7.1): [Upgrading Ruby on Rails — Ruby on Rails Guides](https://guides.rubyonrails.org/upgrading_ruby_on_rails.html#config-autoload-lib-and-config-autoload-lib-once)
I don’t remember the exact problem, but we actually kept the previous behavior, having to require things from `lib`.