does discourse have as special user agent for crawling I need it when posting links from my site (angularJs) to serve SEO friendly content to it

Why not use the rss feeds, instead of just crawling the site?

I don’t have rss feeds on my website for now here is what I get if I paste a url from my website because discourse bot is scraping my website when I detect bots I have special prerended pages but here it’s going to the javascript version and it looks like the bot does not render it Check…

[imagem] Onebox user agent Feature This commit adds a custom User-Agent to discourse oneboxes: https://github.com/discourse/discourse/commit/8bc93c0b018045bf23769b8ecc4ec5b493368667 The User agent looks like this: Discourse Forum Onebox v1.8.0.beta13

Thanks, it would probably solve the issue !!

Did it solved the issue for you? How did you apply the change after modifying the .rb file?

Qual é o User Agent do Discourse para Onebox?

Suporte

Falco (Falco) 21 Março , 2019 18:55 4

Unable to onebox Amazon.co.uk (but amazon.com works)

Tópico		Respostas	Vistas
Javascript Embedding Discourse Comments - User Agent Support	4	738	13 Setembro , 2019
Onebox user agent Feature	17	2721	24 Maio , 2017
Inline-onebox doesn't use SiteSetting.onebox_user_agent Feature onebox , pr-welcome	6	310	28 Janeiro , 2026
Menu, title collumn, and a lot a stuff are gone Support	14	1271	11 Dezembro , 2017
Discourse and Pale Moon browser Support	8	2060	15 Fevereiro , 2018

Qual é o User Agent do Discourse para Onebox?

Related topics