Interesting, when I upload videos they appear as an attachment with a download link, rather than an embedded video player.
If I edit the post afterwards and dismantle the attachment download link, leaving just the URL to the .mp4 video then an embedded player magically appears.
Am I doing something wrong?