There is a bug that was introduced when the option in the preferences was added. Usually, refreshing the site helps for the toggle to work the right way around again. Nat told me I will have to live with it for a bit.
Sometimes, for me, the toggle button doesn’t work at all until I refresh.