Upload assets to S3 after in-browser upgrade

It started happening after I configured s3 settings following this Configure an S3 compatible object storage provider for uploads

That’s why they added the after_assets_precompile hook to upload the updated assets on s3.

How do I fix this. It 404s if I try to access any asset through local server. It have to be through s3. Or I would’ve put an edge routing rule on my cdn pulling asset requests through local domain.