does discourse have as special user agent for crawling I need it when posting links from my site (angularJs) to serve SEO friendly content to it
Why not use the rss feeds, instead of just crawling the site?
I don’t have rss feeds on my website for now
here is what I get if I paste a url from my website because discourse bot is scraping my website
Thanks, it would probably solve the issue !!
Did it solved the issue for you?
How did you apply the change after modifying the .rb file?