Hi all,
When I go to http://[domain]/admin/site_settings/category/security there’s an option with ‘enable escaped fragments’. This has the following description: ‘Fall back to Google’s Ajax-Crawling API if no webcrawler is detected. See https://support.google.com/webmasters/answer/174992?hl=en’
The info has moved to https://developers.google.com/webmasters/ajax-crawling/docs/learn-more , but is marked as deprecated.
I think this has to do with other foreign search engines that are considerably less sophisticated than Google.
Since:
https://developers.google.com/search/docs/ajax-crawling/docs/learn-more
I wonder if we should just pull this whole escaped fragment thing.
I think other cruddier, lesser search engines still support it though.
Yeah not too many reqs… we get YandexBot and http://go.mail.ru/help/robots about 43k requests a day to SJC1 I guess we can keep it for now.
link has been fixed
