Any way to play with nginx conf values without rebuilding?

Did you run apt update before using apt install? The first time, you need to refresh the source list.