My board has been linked from my site for a couple of weeks now and I submitted the URL to Google. I had a no index warning but it seems for profile pages, which is good. Yet nothing is appearing in Google yet, is there anything I need to do on the board end, or is it simply a matter of waiting for Google to now crawl it?

Google changed how they process robots.txt in Discourse?

codinghorror (Jeff Atwood) December 22, 2020, 6:02am 21

We should probably backport this.

Topic		Replies	Views
Pages listed in the robots.txt are crawled and indexed by Google Product Support	18	3626	July 30, 2019
Google notification to remove "noindex" statements from robots.txt Product Support	7	2638	July 30, 2019
Google complaining – Indexed, though blocked by robots.txt Product Support	22	2851	December 13, 2019
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site) Product Support	18	435	December 18, 2024
Generic rules in "robots.txt" not picked up by Googlebot Product Support	5	1128	March 3, 2022