does discourse have as special user agent for crawling I need it when posting links from my site (angularJs) to serve SEO friendly content to it

Why not use the rss feeds, instead of just crawling the site?

I don’t have rss feeds on my website for now here is what I get if I paste a url from my website because discourse bot is scraping my website when I detect bots I have special prerended pages but here it’s going to the javascript version and it looks like the bot does not render it Check…

[image] Onebox user agent Feature This commit adds a custom User-Agent to discourse oneboxes: https://github.com/discourse/discourse/commit/8bc93c0b018045bf23769b8ecc4ec5b493368667 The User agent looks like this: Discourse Forum Onebox v1.8.0.beta13

Thanks, it would probably solve the issue !!

Did it solved the issue for you? How did you apply the change after modifying the .rb file?

What is the Discourse User Agent for Onebox?

Support

Falco (Falco) March 21, 2019, 6:55pm 4

Unable to onebox Amazon.co.uk (but amazon.com works)

Topic		Replies	Views
Javascript Embedding Discourse Comments - User Agent Support	4	703	September 13, 2019
Onebox user agent Feature	17	2626	May 24, 2017
Inline-onebox doesn't use SiteSetting.onebox_user_agent Feature onebox , pr-welcome	6	231	January 28, 2026
Menu, title collumn, and a lot a stuff are gone Support	14	1167	December 11, 2017
Discourse and Pale Moon browser Support	8	1999	February 15, 2018

What is the Discourse User Agent for Onebox?

Related topics