How can I update the nginx config directly in discourse/docker ..?

You are going to have to get creative, I suspect.