S3 CDN URL ignored when uploading into posts

[DanielMarquard]

All of our traffic goes through CloudFront, and static content is fetched by CloudFront from one of several S3 buckets.

With uploads being sent to S3, Discourse embeds the content with a generic bucket URL despite our having s3 cdn url set. Once submitted, posts appear to use the correct URL set in s3 cdn url, although this may also be because we have DISCOURSE_CDN_URL set as well (both are set to the same URL).

The post preview window references the standard S3 URL seen in the unbaked post, though. This is a problem because we use a private ACL on files uploaded to our Discourse uploads bucket, as content on this bucket should never be accessed outside of CloudFront. The result is a broken image in the preview window.

[timkelty]

Disappointing this has been reported for so many years with no fix.

@DanielMarquard Did you ever figure out a workaround, or were you forced to make your s3 ACL public?

[Stephen]

I’m not sure it’s fair to suggest this is broken, as much as the more complicated implementation isn’t fully supported.

S3 uploads as documented work and behave correctly.

[timkelty]

@Stephen Certainly up for interpretation…

To me it seems “broken” that it uses the CDN url in one instance and not the other, and it forces an S3 configuration that AWS actually recommends against (public ACL for an s3 bucket).

I’m new to the Discourse project in general, but can certainly work on a PR.

[riking (Kane York)]

This may be worth fixing now - AWS is getting more serious about informing people of public read ACLs.

[sam (Sam Saffron)]

Given our current implementation no longer has an IMG tag eg:

![image|690x298,50%](upload://eGAOR4Xy4aRM2lwPIuTokBf60jS.png)

It should be quite easy to apply a CDN to the above and it saves traffic.

@vinothkannans can you fix this up so preview uses the CDN url

Instead of preview showing:

<img src="//assets-meta-cdck-prod-meta.s3.dualstack.us-west-1.amazonaws.com/original/3X/6/6/66ef078b3ef9da9aa1b3356cb21fe22a0d25eaf0.png" alt="image" class="resizable" width="345" height="149">

We should show the CDN URL which is this:

<img src="https://d11a6trkgmumsb.cloudfront.net/original/3X/6/6/66ef078b3ef9da9aa1b3356cb21fe22a0d25eaf0.png" alt="image" class="resizable" width="345" height="149">

[vinothkannans (Vinoth Kannan)]

Now it’s fixed as per the below commit

FIX: use upload's cdn url in composer preview if available.

[RGJ (Richard - Communiteq)]

Fortsetzung der Diskussion aus S3-CDN-URL wird beim Hochladen in Beiträge ignoriert:

Es scheint, als ob dieses Problem wieder aufgetreten ist. Ich kann es hier auf Meta reproduzieren.

[codinghorror (Jeff Atwood)]

Können wir das überprüfen, @vinothkannans oder @falco?

[vinothkannans (Vinoth Kannan)]

Gemäß der jüngsten Änderung erhalten wir die URL der hochgeladenen Datei nun direkt aus der ursprünglichen Upload-Anfrage. Zuvor haben wir sie über den Endpunkt /uploads/lookup-urls.json bezogen. Dieser Commit sollte das Problem beheben.

FIX: return cdn url for uploads if available.

[Falco]

Es sieht so aus, als würde diese Korrektur keine benutzerdefinierten Emojis in der Vorschau abdecken, zum Beispiel .

[applebee1558 (Alex Liu)]

Auch fehlen Anhänge wie Datenexporte oder beliebige Dateianhänge. Diese stammen weiterhin aus S3.

[nbianca (Bianca)]

Das kann ich beheben!

FIX: Use CDN for custom emojis (#11401)