You can edit most of the text that the plugin adds to WordPress by going to the WP Discourse Text Content options page:
To edit the layout of the HTML that is added by the plugin, have a look at this topic: Customize the structure of WP Discourse templates.