Rebuilding a fresh Discourse install pre-Ember 5 (targeting the beta channel), I am presented with an endless loading screen

Indeed. I am going to try doing a fresh install in another environment. It seems beta is broken at the moment. In the past, I could target beta in my .yml. I am guessing that there is a breaking change in the Docker Manager plugin that is not backwards compatible.