Thanks for the link. Reading that thread and this post made it clear.
The new web container can be build behind the scenes and then switched over. So I would end up with:
cd /var/discourse
git pull
./launcher bootstrap web_only
./launcher destroy web_only
./launcher start web_only
Over
cd /var/discourse
git pull
./launcher rebuild app