Is a rebuild now required when global settings get changed?

It used to be the case that when changing ENV settings like DISCOURSE_S3_ACCESS_KEY_ID in app.yml one could do a ./launcher destroy app; ./launcher start app and the new settings would go into effect. It seems that this is no longer the case.

The first time I thought it was my imagination or some strange setting, but I just changed the above setting and when I entered rails in the container and got the value with SiteSetting.s3_access_key_id it was the old value and not the new one.

Is this intended?