If that’s the case then you just need to wait for dns to propagate. Or maybe dns is broken in some way that cloud front is using the old dns.
It’s always dns.
Google “clear browser cache browser name”
If you’re going to get rid of the CDN, you must rebuild so that the assets got precompiled, and to do need to rebake all posts.