How to password protect staging environment?

Update for those running into the same issue:

We had to whitelist the Authorization headers in Cloudfront for cdn-origin.

It’s seem I was not prompted for auth for cdn-uploads.

Works now.