Yes, that’s how it’s supposed to work. Although, when you click on the ‘Continue the discussion’ link on the WordPress site, you will be automatically logged in to Discourse and then redirected to the topic. It wouldn’t be too hard to create a general link on the WordPress site that logged the user in and then redirected them to the forum’s homepage.