force_https is turned on since the beginning.
When I first logged into the new instance I installed yesterday it asked me right away if I want to turn on force_https.
But yes, Apache runs HTTPS and the reverse proxy is using port 8080 http on the Discourse Docker container. But somehow Discourse knows that it is running https anyway.