The show inactive accounts site setting is only applied to non-staff users. If the setting is disabled (it’s disabled by default), then regular users will not be able to see the usercard or profile page of deactivated users. Staff users will still be able to see the usercard and profile page though.
The deactivated user will show up in your public user directory whether or not you have disabled the show inactive accounts site setting.