After admin login, the email errors are visible from the admin console, indicating that they are stored in the database, and could have been accessible via the database before the first admin registration was completed.
The table skipped_email_logs has the info I was looking for.
If you are logged into the discourse container as user discourse, you can run:
psql discourse -c "select * from skipped_email_logs"