Any way to play with nginx conf values without rebuilding?

Yes, you can go into the contain (e.g., ./launcher enter app) use apt to install an editor, edit the NGINX files and sv restart nginx (reload might work?).