Onebox error code of 403

[SkyLin]

The preview function of Onebox for udemy url got an error as below.

“Sorry, we were unable to generate a preview for this web page, because the web server returned an error code of 403.”

Not sure if it’s due to the discourse updating today or the site itself. Here comes the situation.

1. The udemy site preview works fine before yesterday. Sample url:
   Udemy free coupon code 2021_0502-2 - udemy 限免課程 - StudyCamp 線上學習論壇

2. The Onebox preview doesn’t work today. Sample url:
   Udemy free coupon code 2021_0503 - udemy 限免課程 - StudyCamp 線上學習論壇

I did some further testing.

1. youtube Onebox preview works fine

2. udemy preview on facebook debug tool works fine
   Sharing Debugger - Facebook for Developers

Sample udemy course url for testing: (Weird, the preview works fine here)

Ultimate DevSecOps With Real World Scenarios

Please advice. Thanks a lot!

[SkyLin]

@SkyLin

discourse updating today

The update of docker image before and after.
PS: the onebox plugin should be the same

Comparing 230dec2...93d7c8a · discourse/docker_manager

[SkyLin]

Found a similar issue years ago.

Amazon onebox fails on my site, but works here

I’ve tried adding both amazon.com and www.amazon.com as whitelisted domains. I tried to pasted this link and many others from Amazon into a new topic on my site: http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803 When I do, I get the following in Chrome’s dev tools console: https://www.myforumdomain.com/onebox?url=http%3A%2F%2Fwww.amazon.com%2FThe-Advantage-Organizational-Everything-Business%2Fdp%2F1491510803d&refresh=false Failed to load resource: the serve…

[SkyLin]

The update info. before & after.
PS: After updating, the onebox failed with 403 error

https://github.com/discourse/docker_manager/compare/230dec2...93d7c8a

https://github.com/discourse/discourse/compare/54b7a0d0...f1e74c89

https://github.com/discourse/discourse-calendar/compare/082bb3d...6cc116d

https://github.com/discourse/discourse-chat-integration/compare/ec7cf1e...a1bd603

https://github.com/discourse/discourse-math/compare/c925f7e...afb8e9f

https://github.com/discourse/discourse-reactions/compare/75f9dd9...9238b8c

https://github.com/discourse/discourse-sitemap/compare/9f2e7de...e64f393

[SkyLin]

I did some further testing, none of them solve this bug.

Testing 1. Restore the backup* which before the bug occur. Reboot system then got a 502 error
PS: VPS disk image backup on 4/27, not discourse backup zip file

The new backup file can restore and reboot without problem, only old backup failed. It’s wierd. Theoretically the old backup should work fine as the other backup.

Testing 2. Clone the VPS disk image backup to a new VPS, followed the steps below to setup a new domain. The new site works fine, but this bug still exist. It should be due to rebuilt will load new discourse image which is the same.

Change the domain name or rename your Discourse

This guide is for self-hosted Discourse instances that were installed using our installation guide on GitHub. If you are hosted by Discourse, please see Configure your domain name for hosted Discourse for specific instructions. You may eventually want to change the domain name of your Discourse instance, from say =BEFORE= → =AFTER= Let’s get started. Set the TTL for your DNS low, and in advance You need to let everyone know that the domain is about to change, so change the TTL f…

Testing 3. Follow the steps of web page below to see why 403.

Amazon onebox fails on my site, but works here

Just tried a couple things: From the DO box itself I can curl this URL fine: http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803 If I curl from within the docker container, though, I get a 503: * Connection #0 to host www.google.com left intact root@host:/# curl http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803 -v -o deleteme * Hostname was NOT found in DNS cache % Total % Received % Xferd Average Speed Time …

The image here show the difference of onebox between meta(above) and my site(below).

Testing urls for udemy and amazon. It seems one in 403 and one in 503.
https://www.udemy.com/course/power-bi-2021-proyectos-reales-para-volverte-un-master/

Deep Learning with Python: Chollet, Francois: 9781617294433: Amazon.com: Books

< HTTP/2 403
< date: Fri, 07 May 2021 10:18:28 GMT
< content-type: text/plain; charset=UTF-8
< content-length: 16
< x-frame-options: SAMEORIGIN
< cache-control: private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0
< expires: Thu, 01 Jan 1970 00:00:01 GMT
< set-cookie: __cfduid=dbbbf721820c12aac03e8116c362147d51620382708; expires=Sun, 06-Jun-21 10:18:28 GMT; path=/; domain=.udemy.com; HttpOnly; SameSite=Lax
< cf-request-id: 09e7ef0b3c00000b939211d000000001
< expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
< set-cookie: __cf_bm=f83cbaa075085ed2ae624e9bcfa5badf394f7ddd-1620382708-1800-Af1qbDD41LzYLWJX0XR39JAeFnjBdEmvhZO/0YloMwnBR8urb60m7+bcte18X+L59RfHKhzWeGPELN02cuiV9RA=; path=/; expires=Fri, 07-May-21 10:48:28 GMT; domain=.udemy.com; HttpOnly; Secure; SameSite=None
< x-content-type-options: nosniff
< server: cloudflare
< cf-ray: 64b9b4585d9b0b93-NRT
<
{ [16 bytes data]
100    16  100    16    0     0    290      0 --:--:-- --:--:-- --:--:--   296
* Connection #0 to host www.udemy.com left intact

< HTTP/2 503
< server: Server
< date: Fri, 07 May 2021 10:25:04 GMT
< content-type: text/html
< strict-transport-security: max-age=47474747; includeSubDomains; preload
< x-amz-rid: P43ZS4CBG7V92Z7W4VSC
< vary: Content-Type,Accept-Encoding,X-Amzn-CDN-Cache,X-Amzn-AX-Treatment,User-Agent
< last-modified: Wed, 30 Sep 2020 23:54:00 GMT
< etag: "a6f-5b0909d09d600"
< accept-ranges: bytes
< content-length: 2671
<
{ [1139 bytes data]
100  2671  100  2671    0     0  11871      0 --:--:-- --:--:-- --:--:-- 11871
* Connection #0 to host www.amazon.com left intact