Send email after 2 weeks to users who have not confirmed account or logged in

That would be my thought, too.

If you go ahead with this, I would suggest explicitly mentioning that 1) further unsolicited emails won’t be sent, and, 2) the account will automatically be deleted if it is not eventually used. *
 

* obviously this is assuming that’s actually the case, which I believe it is with the default settings