After executing this I can see now `raw` contains a value when viewing the object `preview` (too large to paste here)
This seems to indicate that:
1. the expected HTML response has changed
2. the parsing of the HTML doesn’t correctly catch an error which occurs during the “parsing” of the response.
3. an error is not being surfaced to the Discourse logs
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [27 במרץ, 2016, 7:32pm UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/8 "2016-03-27T19:32:38Z")
Hmm possibly @tgxworld can have a peek
---
### Author:  [@mcwumbly](https://meta.discourse.org/u/mcwumbly)
#### Post date: [27 במרץ, 2016, 7:44pm UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/9 "2016-03-27T19:44:59Z")
Just tried a couple things:
1. From the DO box itself I can curl this URL fine:
`http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803`
2. If I curl from within the docker container, though, I get a 503:
```plaintext
* Connection #0 to host www.google.com left intact
root@host:/# curl http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803 -v -o deleteme
* Hostname was NOT found in DNS cache
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 54.239.17.6...
* Connected to www.amazon.com (54.239.17.6) port 80 (#0)
> GET /The-Advantage-Organizational-Everything-Business/dp/1491510803 HTTP/1.1
> User-Agent: curl/7.35.0
> Host: www.amazon.com
> Accept: */*
>
< HTTP/1.1 503 Service Unavailable
< Date: Sun, 27 Mar 2016 19:41:45 GMT
* Server Server is not blacklisted
< Server: Server
< Vary: Cookie,Accept-Encoding,User-Agent
< Last-Modified: Thu, 05 Nov 2015 22:42:39 GMT
< ETag: "562-523d2d81655c0"
< Accept-Ranges: bytes
< Content-Length: 1378
< Cneonction: close
< Content-Type: text/html
```
response body contains this at the top:
```plaintext
```
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [27 במרץ, 2016, 9:19pm UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/10 "2016-03-27T21:19:06Z")
So Amazon is restricting access from Digital Ocean.
---
### Author:  [@mcwumbly](https://meta.discourse.org/u/mcwumbly)
#### Post date: [27 במרץ, 2016, 9:20pm UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/11 "2016-03-27T21:20:27Z")
Hmm… seems a little more nuanced than that since the call succeeds when made directly from the DO box, but not when made from within the container.
---
### Author:  [@DeanMarkTaylor](https://meta.discourse.org/u/DeanMarkTaylor)
#### Post date: [28 במרץ, 2016, 1:23am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/12 "2016-03-28T01:23:53Z")
Tracing the code a more accurate request for testing is:
```bash
curl http://www.amazon.com/gp/aw/d/1491510803 -v -o deleteme -H "User-Agent: Mozilla/5.0 (iPhone; CPU iPhone OS
5_0_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9A405 Safari/7534.48.3"
```
Note the:
- manipulated URL
- from: `http://www.amazon.com/The-Advantage-Organizational-Everything-Business/dp/1491510803`
- to: `http://www.amazon.com/gp/aw/d/1491510803`
- Specific mobile User Agent.
I’ve now tested on latest:
- whilst the test `curl` request above returns `200 OK`
- I still see a `404 (Not Found)` error in Chrome Dev Tools for `/onebox?url=...`
- I have not seen a `503 (Service Unavailable)` error
- This Discourse instance is on DigitialOcean (LON1)
---
### Author:  [@mcwumbly](https://meta.discourse.org/u/mcwumbly)
#### Post date: [28 במרץ, 2016, 1:26am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/13 "2016-03-28T01:26:58Z")
Are you curling from inside the container (after doing `./auncher enter app`)?
---
### Author:  [@DeanMarkTaylor](https://meta.discourse.org/u/DeanMarkTaylor)
#### Post date: [28 במרץ, 2016, 1:33am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/14 "2016-03-28T01:33:13Z")
It’s the same for me both inside and outside of the container (successful `200 OK`, no HTML comment message at top of page code).
---
### Author:  [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [28 במרץ, 2016, 5:53am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/15 "2016-03-28T05:53:26Z")
It looks like @tgxworld may have fixed something here?
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [28 במרץ, 2016, 5:56am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/16 "2016-03-28T05:56:57Z")
This is a super weird bug…
```plaintext
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-midres-replacement", "onload", "class", "id", "data-a-image-name", "data-a-hires"]
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-hires-replacement", "onload", "data-a-image-name", "class", "id", "data-a-dynamic-image", "style"]
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-hires-replacement", "onload", "data-a-image-name", "class", "id", "data-a-dynamic-image", "style"]
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-hires-replacement", "onload", "data-a-image-name", "class", "id", "data-a-dynamic-image", "style"]
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-hires-replacement", "onload", "data-a-image-name", "class", "id", "data-a-dynamic-image", "style"]
(byebug) Nokogiri::HTML(open(url, {read_timeout: timeout}.merge(http_params)).read).css("#main-image").first.attributes.keys
["alt", "src", "data-fling-asin", "data-fling-refmarker", "data-midres-replacement", "onload", "class", "id", "data-a-image-name", "data-a-hires"]
(byebug)
```
For some reason, the attributes in the image keeps changing. Note how it alternates between `[data-a-hires, data-hires-replacement]`and `[data-a-dynamic-image, data-midres-replacement]`
Why? I’m not sure and I’ve spent too much time trying to figure out why. I did manage to reproduce the different image tag attributes in my browser by loading the same product URL normally and in incognito mode.
I’ll wait a day or two before merging my PR below to see if anyone might know why…
[https://github.com/discourse/onebox/pull/318](https://github.com/discourse/onebox/pull/318)
---
### Author:  [@mcwumbly](https://meta.discourse.org/u/mcwumbly)
#### Post date: [28 במרץ, 2016, 6:00am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/17 "2016-03-28T06:00:10Z")
😌 I was pretty sure I was just going crazy…
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [28 במרץ, 2016, 6:00am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/18 "2016-03-28T06:00:22Z")
O anyway there was another bug fix here… We’re getting a 404 because our code blows up if it can’t retrieve an image. I fixed that for now so even if the image is not found. We’ll still have a nice onebox without the image.
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [29 במרץ, 2016, 2:57am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/19 "2016-03-29T02:57:32Z")
Just updated onebox!
> **[Amazon.com: Dell UltraSharp U2715H 27-Inch Screen LED-Lit Monitor : Electronics](https://www.amazon.com/Dell-UltraSharp-27-Inch-LED-Lit-Monitor/dp/B00P0EQD1Q)**
>
> Superior screen resolution and real estate for a view you can't wait to get your eyes on. Work the way you want. Position your monitor for ultimate comfort with a full range of tilt, pivot, swivel and height adjustments along with easy connections to...
> **[Belkin Extension Lead with USB Slots x 2 (2.4 A Shared), 4 Way/4 Plug Extension,...](https://www.amazon.co.uk/Belkin-BSV401af2M-Protection-Extension-Charging/dp/B00OE43I9S)**
>
> Safeguard your electronics with this 4-outlet power strip featuring 2 USB ports for charging. Surge protection and a 2m cable provide convenient, reliable power.
---
### Author:  [@tgxworld](https://meta.discourse.org/u/tgxworld)
#### Post date: [31 במרץ, 2016, 2:58am UTC](https://meta.discourse.org/t/amazon-onebox-fails-on-my-site-but-works-here/41609/20 "2016-03-31T02:58:03Z")
This topic was automatically closed after 2 days. New replies are no longer allowed.