Eric_Cloninger is seeking a way to check for broken links, images, and downloads in user-generated content on their Discourse site. While Discourse automatically handles image linking by downloading hot-linked images locally, external link validation requires a custom solution. Falco confirms that a plugin is needed for links. pfaffman suggests using the API or a data explorer query for hosted users, but notes plugin support depends on the plan. sam explains that hosted enterprise users can use a data explorer query to extract external URLs from posts, which can then be validated externally. Eric_Cloninger finds this approach promising for preventing link rot, especially for internal corporate links.
We just started using Discourse about 2 months ago and so we’re still learning. I’m looking for a way to test all the user-generated content still links to valid locations. I’m mostly interested in links, images, and downloads. Basically, give me a report of outbound 404s.
I’ve looked through meta, the plugins directory, and the API docs and I’m not finding exactly what I’m wanting. I’m not sure that a plugin exists or if I need to cobble something together using the API.
If you’re hosted (and not on Enterprise), then you likely can’t use a plugin. You might be better off cobbling something together with the API. You can start with a data explorer query that returns, say, the post ID and the URL. And then you could do something like have it check the URLs and maybe flag the post if the URL goes south.
We’re hosted by CDCK and on an enterprise plan. But, I’ll look at your suggestion as well.
I try to keep link rot to a minimum in our developer forums without damaging the overall usefulness of posts. Sometimes the underlying technology is deprecated or removed, which can’t be helped.
As a hosted customer you get a bit of special treatment here
What you can do today is use a data explorer query (which is a plugin we support on both business and enterprise) to ask us about the most recent links in posts:
SELECT url, post_id, click
FROM topic_links
WHERE not internal
ORDER BY post_id DESC
LIMIT 100
Will list the last 100 external URLs linked in posts. This can be downloaded as a CSV and you can then run a link validation tool on the result and flag problem posts.
What more we track clicks on links, so you could sort this by click count or exclude stuff that was clicked zero times.
I think that would work. We won’t have a huge volume of traffic, but I don’t want link rot to set in over time. Especially on links back into our corporate site(s).