Onebox and GDPR Consent

AI-generated summary

A user Dizzy721 reports that their UK-hosted Discourse forum displays GDPR consent pages instead of news articles when using oneboxes for US sites like NPR and the Washington Post. This occurs because the sites redirect users from certain IP ranges, likely due to GDPR compliance. Falco notes the issue is not a bug but expected behavior and suggests workarounds: relocating the server, using a proxy like Onebox Assistant, requesting special headers from the sites, or waiting for Brexit-related changes. Dizzy721 confirms that using Onebox Assistant resolves the issue.

I currently run a Discourse forum that is hosted in the UK. When loading certain US news sites such as Washington Post or NPR, the onebox loads the GDPR Consent page rather than news article. These sites are just the examples we’ve run into.

For example, https://www.npr.org/2021/01/05/952883116/objecting-to-electoral-votes-in-congress-recalls-bitter-moments-in-history is converted into https://choice.npr.org/index.html?origin=https:%2F%2Fwww.npr.org%2F2021%2F01%2F05%2F952883116%2Fobjecting-to-electoral-votes-in-congress-recalls-bitter-moments-in-history when the onebox gets processed.

I don’t think this is a bug and it is probably the expected behavior given the setup, but I was wondering if the community had any suggestions to workaround the issue? We can insert the links as hyperlinks but this skips the onebox processing.

Thanks!

It appears to work here:

So the site is deciding to redirect to another page if the IP requesting the page is in a list.

Possible workarounds:

  1. Move the server out of the IP range that has this problem.

  2. Use a proxy for onebox, like “Onebox Assistant”, crawl for those previews reliably!

  3. Contact the websites to see if there is a special header you can send

  4. Wait for the Brexit to take effect ?

Onebox Assistant does the trick. Thank you!