Site is accessible on the IP address when not following th install guide

Speaking objectively, this isn’t accurate. It’s not https only, as you can access the site directly via the IP address that isn’t https.

The difference is disallowing connecting insecurely without https and exposing the server origin IP. I’m unaware of any benefits to that.

If you DNS look up the top 50 sites in the world, it looks like none of them are accessible insecurely directly via the IP. I don’t think it is unreasonable to assume that the top 50 sites in the world are using best practices.

Here is a quite accurate top list:
https://www.similarweb.com/top-websites/

Here is a DNS lookup tool: