In the SAML plugin, this is controlled by the saml_default_emails_valid global setting (default true).
saml_default_emails_valid