When I tried to use the same email address, it said the password was already set (as it was). I went ahead and changed the password via rake admin:create as per the prompt and then likewise granted admin privileges to the account. After this was done I revisited the main site and lo and behold Discourse came up properly and did not take me back to the setup process.