Wat betekent Jobs::Crawltopiclink in Sidekiq (Discourse)?

Unless I’m missing something, TopicLink appears to handle any link that appears in a post. When one is created, it enqueues that crawl_topic_link job which then crawls the URL to retrieve the title.

For example, I could enter exactly the following into a post:

This will be a link: https://github.com/discourse/discourse/blob/main/app/jobs/regular/crawl_topic_link.rb

Initially, that is how it will be baked into the post, displaying the URL as a link. When that job runs, it will crawl the URL to retrieve the title, then the post will be rebaked to display the title as a link in the way it appears in your previous post.

Normally this will happen very quickly so it will be barely noticeable but if you have a lot of those jobs queued up for some reason, you might see URLs for prolonged periods before they are replaced with the titles. I expect that if you delete the jobs, they will remain as URLs instead of titled links.

If you have recently performed an import, so created a lot of new posts in a very short space of time, that may explain a backlog of such jobs. I think you will have the best result by allowing those jobs to finish. I believe this to be a good default position with Sidekiq: just let it get on with what it does. (Unless you are seeing specific problems with some jobs.)