Multiple Discourses, multiple containers, one server

Do you mean from port 443 (externally on the host OS) to port 80 (in the two web containers)?
Your two web instances in Docker run on HTTP, while the host instance redirects from HTTPS to these two HTTP instances, right?

This sounds like a reasonable choice. I wouldn’t like to complicate things inside of the docker containers and see no need for HTTPS in there. If the host is compromised then it’s all over anyway.