Maintain tables from HTML email in when using HTML to Markdown

AI-generated summary

The discussion revolves around maintaining tables from HTML emails when using HTML to Markdown conversion in Discourse. Currently, tables get mangled and converted to plaintext. mcwumbly suggests skipping tables and maintaining them as HTML, while codinghorror mentions that Markdown table support might improve the situation.

vinothkannans explains that the issue lies in the server-side HTML to Markdown conversion, which doesn’t support Markdown tables yet. However, the client-side JavaScript conversion does support it. zogstrip proposes removing the Ruby version and replacing it with the JavaScript version to avoid code duplication.

Users brechtm and mcwumbly experience issues with tables breaking off messages during conversion. Editing and pasting raw HTML tables seems to work as a workaround. zogstrip mentions that tables will be properly converted once a specific PR is merged: https://github.com/discourse/discourse/pull/9586.

I was trying to advise a user on how they might import a Google Doc into Discourse as a new topic and suggested trying to copy/paste the doc into an email and then email it in. It mostly worked, but there were a few tables in the doc that got mangled in the process.

When an email into Discourse includes an HTML table, that table gets mangled and turned into plaintext on the Discourse side.

I have the incoming_email_prefer_html on as well as the “allow html tables” setting.

It’d be cool if tables were just skipped and maintained as HTML in that case. (Or perhaps there’s a table extension we’re planning on enabling once the markdown-it is in the mix?)

7 Likes

This might work better now that we have more formal Markdown table support @vinothkannans?

Yes, it will work better if the user used copy-paste method instead of email-in workaround.

HTML pasting feature uses client side JavaScript for Markdown conversion. But for incoming emails we converting it in server side using our custom converter which doesn’t support Markdown tables yet.

3 Likes

I see no point in duplicating our code in JS and Ruby. I will remove the Ruby version and replace it with the JS version.

8 Likes

I happen to receive emails containing tables, and the first table and anything trailing it doesn’t survive the translation to Markdown. This makes messages break off abruptly, which is very confusing for users. They can read the original HTML email by clicking the little envelope, but that’s hardly user-friendly and should probably be regarded as a bug.

Editing the message and pasting the raw HTML table into it seems to work well. Why not do this during Markdown conversion?

Tables will be properly converted once this PR is merged :ok_hand:

https://github.com/discourse/discourse/pull/9586

5 Likes