SSO - "There is a problem with your account. Please contact the site's administrator."

The solution for my problem was:

  1. Admin → Settings → enable verbose SSO logging
  2. Navigate to /logs on one screen while attempting to login on the other

This found the problem, then…

  1. Delete existing account (non-sso) with the same email address
  2. Reattempt SSO login