You can follow Importing mailing lists (mbox, Listserv, Google Groups, emails, ...). Existing users will be matched by email address. New users will be created for non-existent email addresses. You can merge users (Rake task for merging users) after the import if some users used different email addresses in your Yahoo Groups.
I recommend trying it out with a backup of your current forum.