I’m not sure if this is a bug, I don’t really think it is, but I searched the forum and couldn’t find a post about it so I’ll put it here just in case.
- If you search the site (this site) using Google, you can find stuff in embedded content (that’s automatically pulled by Discourse from external sites such as Github).
- If you try the same using this forum’s search engine, it won’t work - it seems to ignore external embedded content.
Since external content can change, I think the current behavior is okay, as it lessens the load on the system (which I like), otherwise regular checking and potentially re-scanning of external URLs would have to happen to keep the search index up to date.
IMO the only thing that should probably be highlighted is that by default Discourse doesn’t seem to index those pages, so that people who hope to find such content need to use Google or another search engine.
(If Discourse were to regularly check external content, I’d like to be able to disable that feature, to save resources.)