My search engines are not updating my community e.g its been a week I posted new topics, which are no being shown on google yet. In the webmaster,
robots.txt and sitemap is working fine for the domain. However, its not indexing.
in settings for the field
exclude rel nofollow domains I have only given my domain.org. However, my community is based on a subdomain.
My /robotx.txt file has
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # User-agent: * Disallow: /auth/cas Disallow: /auth/facebook/callback Disallow: /auth/twitter/callback Disallow: /auth/google/callback Disallow: /auth/yahoo/callback Disallow: /auth/github/callback Disallow: /auth/cas/callback Disallow: /assets/browser-update*.js Disallow: /users/ Disallow: /badges/ Disallow: /search Disallow: /search/ Disallow: /tags Disallow: /tags/ Sitemap: https://meta.domain.org/sitemap.xml
Any solution? How can I make SEO better for my discourse?