[grid] from AI vision in chat

Contribute Bug
, ,

AI-generated summary

The discussion is about removing the [grid] syntax from AI vision in chat, as it doesn’t work and makes the output less beautiful. Jagster suggests removing it, but sam notes that it’s not a simple fix and requires changes in both AI and chat. sam explains that removing [grid] causes issues with image rendering, including too much text, only grabbing the title of the first image, and not using lightbox when clicking the link. However, zogstrip mentions that @joffreyjaffeux has fixed the issue in a GitHub pull request, and provides a screenshot showing the improved output with working lightbox.

1

Easier to show when I asked an image from GPT-bot on chat:

IMG_3456
IMG_34561581×686 124 KB

[grid] doesn’t work and because of the nature of chat I think it shouldn`t and therefore AI shouldn’t use it first place.

So, can we get rid of it?

Yes, really really minor one and doesn’t break anything. It just isn’t beautiful.

5 Likes
3

I started looking at this, the fix in AI is actually quite easy, trouble is we will need a fix in chat as well @zogstrip / @j.jaffeux

Specifically, once we remove [grid] stuff gets weird ™.

image
image1073×297 90.6 KB

For a block like this supplied to chat:

![Create an image in a humorous illustration style, featuring a cartoon monkey with exaggerated features. The monkey is wearing a vibrant-colored Hawaiian shirt and sunglasses. The spendthrift character has a wide grin and is holding a banana as if it's a microphone. The illustration features bright, playful colors similar to those found in children's books. Set against a background depicting a tropical beach with palm trees and a blazing sunset.](upload://6mq3rDixX44cdKzsXb2efl0GfwG.jpeg) ![Generate an image of a photo-realistic humorous monkey dressed in a business suit, seated at an office desk looking serious. The desk is strewn with banana peels, and the monkey is holding a banana as if it were a telephone to its ear. The office environment should depict a sense of chaos, with papers fluttering around, creating an amusing contrast.](upload://yLUEHwfiDZFeNeNgJmyi7YzD88q.jpeg)

Chat renders:

image
image1044×232 78.4 KB

This is a bit of a problem on a few counts.

  1. So much text
  2. It is only grabbing the title of the first image in the markdown which is confusing
  3. When you click the link it does not use lightbox, which is not fun

We can avoid the bugs by prepending text and getting something like:

image
image530×261 61.8 KB

But this does feel quite hacky.

…

Fixing by removing the grid will leave stuff worse off :frowning:

Also worse considering, we need to make sure there are proper upload refs for this case so we are not stuck with orphan images.

5 Likes
11

Preeeetty sure @j.jaffeux fixed it in

https://github.com/discourse/discourse/pull/29658

Here’s how it looks like

Screenshot 2024-12-30 at 17.37.25
Screenshot 2024-12-30 at 17.37.251475×1062 167 KB

And the lightbox works as well :clap:

5 Likes