Should Discourse convert GIFs to mp4 video files?

Yep, it seems to have built up a fair bit of traction, mostly thanks to the Reddit crowd. There’s an API of sorts too. If Discourse did its automatic grab-the-file-and-self-host-it I suppose this might work in the short term.

I really think this kind of workaround ought to be open source though. A lot of articles I’ve read describe Gfy as a new format, which is very misleading. There’s only one way to make a “Gfy”, and that’s through Gfycat.com. Gfy is a service.

4 Likes

Some communities would benefit from such functionality.
Especially ones with download remote images to local setting enabled :stuck_out_tongue:, but faster page loads alone is a good reason to think about it.

Quick hack would be to just use gfycat.com API.
Assuming one does not mirror remote images, I think it is achievable even with pure Javascript which you can add via /admin/customize/css_html. Lets say JS iterates over posts and if it finds .gif image. HTTP GET is performed:
http://upload.gfycat.com/transcode?fetchUrl=i.imgur.com/jGMtJIb.gif
It downloads&converts remote image (if not already present) and returns JSON with video details. At this point you replace .gif with video in post (see section “How can I embed these or link to them?”)
Custom plugin which bakes .webm into posts via background job would be of course more elegant.

Anyway,
I don’t think they (gfycat) do anything magical beside handling hight traffic quite well.
We can replicate functionality with ffmpeg alone (see 4chan’s guide to converting GIF to WebM).

If we plan to self-host .webm it would be just an extension to already existing download remote images to local feature. We would have an additional setting replace .gifs with optimized .webm versions (we could add another setting: convert only .gifs bigger than…).

Such native functionality requires ffmpeg as a dependency and comes with additional security risks.
It does not sound like a good default for Discourse: maybe it is possible to create it as a plugin?

7 Likes

A related development, Imgur is introducing GIFV:

The cornerstone of Project GIFV is a platform-wide upgrade to automatically convert uploaded GIF files on the fly into the MP4 video format. […]

The .GIFV Extension: With all these improvements, Imgur will now denote converted MP4s with a “.gifv” extension. The intention is to signal to users throughout the Internet that these links will feature a GIF experience that incorporates all the current and future enhancements made through Project GIFV. Imgur plans to submit an accompanying specification to relevant standards organizations before the end of the year.

5 Likes

The “gifv” “files” are actually just a HTML page that runs some Javascript to pick the GIF or MP4 file.

1 Like

Exactly! :smile_cat:
Discourse already has onebox for MP4 files.
So the only missing piece is some kind of a sidekick job that does the conversion and slight modification to the onebox to loop by default (if mp4 was created from gif).

You can do view video and share the gifv link, but you can’t save it. Facebook is embedding givf files nicely.

The problems I have read so far is poor display on some devices. Plus comment about this case:

If you upload to gfycat, you can actually get an .mp4 link that discourse will show inline :smile:

edit: hmm, this mp4 stopped working for me, but if I open in incognito or restart chrome it works again – not sure what’s up.

2 Likes

It works for imgur.
For example something like https://i.imgur.com/mYNXTPw.gif can be requested as https://i.imgur.com/mYNXTPw.webm which gives:

It would be nice if Discourse detected .gif URLs from common providers such as imgur/gfycat
and just replaced image with looped video (already provided by site), as it saves a lot of bandwidth.

1 Like

That sounds like something that could easily be done using the onebox, adding a white list either in the image or video engine. I am happy to build that, if such a PR is wanted (could also be behind a configuration setting, if needed).

3 Likes

I am fine with special MP4 handling onebox for these services that specialize in it.

8 Likes

A quick update,

Chrome does a terrible job with huge gif files, they can choke the web browser and cause all sorts of nasties not to mention mobile paying a hefty price on traffic and blowing data plans.

Gifv technique championed by imgur is good

http://i.imgur.com/zvATqgs.gifv

<video id="video" autoplay="autoplay" muted="muted" preload="auto" loop="loop" poster="//i.imgur.com/zvATqgsh.jpg">
        
     <source src="//i.imgur.com/zvATqgs.webm" type="video/webm">
     <source src="//i.imgur.com/zvATqgs.mp4" type="video/mp4">
     
     <object type="application/x-shockwave-flash" height="370" width="660" data="//s.imgur.com/include/flash/gifplayer.swf?imgur_video=//i.imgur.com/zvATqgs.mp4&amp;imgur_width=660&amp;imgur_height=370&amp;imgur_url=//imgur.com/zvATqgs">
         <param name="movie" value="//s.imgur.com/include/flash/gifplayer.swf?imgur_video=//i.imgur.com/zvATqgs.mp4&amp;imgur_width=660&amp;imgur_height=370&amp;imgur_url=//imgur.com/zvATqgs">
         <param name="allowscriptaccess" value="never">
         <param name="flashvars" value="height=370&amp;width=660">
         <param name="width" value="370">
         <param name="height" value="660">
         <param name="version" value="0">
         <param name="scale" value="scale">
         <param name="salign" value="tl">
         <param name="wmode" value="opaque">
     </object>
 </video>

It’s really just a video element with a bunch of fallbacks.

I see a few actionable things we can do here:

  1. If people hotlink anything larger than say 10mb force a “click” to actually download the image and hide it behind a preview

  2. get ffmpeg into our base image and do the webm and mp4 conversion for all animated gifs, don’t worry about the flash fallback.

  3. Offer an integration piece with imgur that uses imgur to do this … any gif larger than X gets sent to imgur for recompression. (or use a different service)

7 Likes

Another huge advantage is that you get no auto play on mobile with the technique above

1 Like

One thing to consider is how Slack deals with this:

http://img0.joyreactor.cc/pics/post/%D0%B3%D0%B8%D1%84%D0%BA%D0%B8-superjail-%D0%BC%D1%83%D0%BB%D1%8C%D1%82%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB-%D0%A1%D0%B2%D0%BE%D1%8F-%D0%B0%D1%82%D0%BC%D0%BE%D1%81%D1%84%D0%B5%D1%80%D0%B0-1886210.gif (Not automatically expanded because 30MB is too large. You can expand it anyway or open it in a new window. You can also change your preferences to allow images of any file size to auto expand.)

4 Likes

We do handle enormo gif links now in a sane way. One thing we don’t yet offer is the “expand it anyway” option :thinking:

3 Likes

Just created Discourse Gifs component which uses the technique

2 Likes

Did this ever see the light of day? I see

But neither of these make clear if the solution was implemented.

The reason I ask is that, unless I am mistaken, lightboxing does not appear compatible for gifs. By this I mean, I cannot click a gif and go fullscreen. When the gif contains detailed text, the user cannot zoom in without opening the image in another tab.

However, if the gif converts to an mp4 when uploaded, then we benefit from the fullscreen functionality of the existing video player, as well as the time bar – massive benefits when you are watching a short tutorial clip!

Is this conversion possibility already avaiable? I searched also “gif” in the settings and found

This is like saying “I should be able to click any image and have it go fullscreen” which doesn’t make a whole lot of sense to me? :confounded:

When comparing different documentation styles - all text, only video, text + gifs, the text + gifs option was vastly superior. Consequently, we plan on using gifs to demonstrate things in tutorial posts. However, if we can’t go fullscreen, or lightbox the gif, then written text can often be hard to see

gifstoosmall

And as you see when you hover over, you only get the option to pause

But what we really need is to be able to make the gif full size. The work around is to right click and open in new tab, which is fine for our more expert users, but the other 90% can’t be expected to adapt to that. So either we need a way to have uploaded gifs use lightboxing so they go full size when clicked, or simply converted to mp4s so Discourse provides fullscreen functionality.

Also, the expanded tables functionality is :ok_hand: :star_struck:

Then put the following notice under each one

:mega: to make this full size, right click (or tap and hold) and open in a new tab.

Hmmm I’d submit something more official if I knew ruby, but sadly Python and C are my main languages.

I’ll probably write a python script that runs periodically, identifies new posts, identifies gifs in new posts, put them in a conversions folder, and then update the post with the path to the new webm file.

I found the configuration below to work well for the conversion. This script will convert every gif file in the ConvertToWebm folder into a webm, whilst retaining the original gif. For our use-case the loss is acceptable(small text still readable), and file size reduces by even 20x in some cases

import glob, os
os.chdir("C:/Users/username/Videos/ConvertToWebm")
for file in glob.glob("*.gif"):
    print(file)
    filename = str(file[:-4])
    command = 'ffmpeg -i  "'+ str(file) +  '" -c vp9 -b:v 0 -crf 41 -strict experimental "' + filename + '.webm"'
    print(command)
    os.system(command)
3 Likes