Upload assets to S3 after in-browser upgrade

It started happening after I configured s3 settings following this Using Object Storage for Uploads (S3 Clones)

That’s why they added the after_assets_precompile hook to upload the updated assets on s3.

How do I fix this. It 404s if I try to access any asset through local server. It have to be through s3. Or I would’ve put an edge routing rule on my cdn pulling asset requests through local domain.