Using Docker, stop server from responding to IP address (instead of hostname)

I’m looking for the preferred way to stop access to my docker discourse server when the user is only using the IP address. Glancing at the container’s nginx config, it looks like any request made to http://myipaddress is redirected to https://mydomainname. I would like to return 403 instead.

Maybe I’m misinformed but it feels safer to just drop the connection instead of helping a scanning bot along by redirecting.

Is the best bet to place another nginx config in front? If thats the case, is there a way to change the port of the standard discourse docker?