Okay, not sure if this is a bug or not but I made the appropriate changes, created a new member account and then logged in using an incognito and everything is the default. Nothing I added in admin shows up in the sidebar when they log in.
What I set up:
What a new user sees:
