Any downsides to proxy via port instead of unix domain socket?

After looking into this more, I definitely want to add proxy_set_header "Connection" ""; to disable the default Connection: close header