The external_id saved to the single_sign_on_records table. You can delete all records from this table by entering the rails console and running
SingleSignOnRecord.destroy_all
As long as you are not setting require_activation to true in the SSO payload, after deleting your site’s SSO records, new SSO records will be created for your users based on their email address when they login with SSO.