OK you are referring to a different setting.
Such a setting for User Map does not exist.
Once User Map is activated, a link is added.
The setting you are referring to controls the Topic Map link visibility.
So my advice remains the same, PR welcome. It would certainly be nice to have a link visibility setting for both, not just the Topic Map.
If this is really important to you and you don’t have the development resources, you can reach out to fund Pavilion to have this done for you.