does discourse have as special user agent for crawling I need it when posting links from my site (angularJs) to serve SEO friendly content to it

Why not use the rss feeds, instead of just crawling the site?

I don’t have rss feeds on my website for now here is what I get if I paste a url from my website because discourse bot is scraping my website when I detect bots I have special prerended pages but here it’s going to the javascript version and it looks like the bot does not render it [imag…

[image] Onebox user agent feature This commit adds a custom User-Agent to discourse oneboxes: https://github.com/discourse/discourse/commit/8bc93c0b018045bf23769b8ecc4ec5b493368667 The User agent looks like this: Discourse Forum Onebox v1.8.0.beta13

Thanks, it would probably solve the issue !!

Did it solved the issue for you? How did you apply the change after modifying the .rb file?

What is the Discourse User Agent for Onebox?

Support

Falco (Falco) March 21, 2019, 6:55pm 4

Unable to onebox Amazon.co.uk (but amazon.com works)

Topic		Replies	Views
Javascript Embedding Discourse Comments - User Agent Support	5	691	October 13, 2019
Onebox user agent Feature	18	2573	August 5, 2017
Inline-onebox doesn't use SiteSetting.onebox_user_agent Feature pr-welcome , onebox	7	187	February 1, 2026
Menu, title collumn, and a lot a stuff are gone Support	15	1137	December 11, 2017
Discourse and Pale Moon browser Support	10	1976	May 28, 2020

What is the Discourse User Agent for Onebox?

Related topics