How can I update the nginx config directly in discourse/docker ..?

Why not tell us why you need this extra folder? It’s possible that someone else has had a similar need, but that the assumed solution isn’t the only way to achieve it.