All users have the same IP (the Servers IP)?

Did you try to disable the nginx running in the container and expose the Unicorn app server itself? You’ll probably want to use your firewall to prevent direct external access to that port, tho.