Stuck on “currently upgrading...”

What you mentioned in step 4 sounds like a previous upgrade did not clean up properly. Go ahead and try clicking “Reset Upgrade”, then return to /admin/upgrade and attempt to upgrade again. If that still fails, you’ll need to upgrade via SSH.