Captioning goes nuts

Contribute Bug
, ,

AI-generated summary

Captioning goes nuts

RJJ reports experiencing issues with the captioning feature when inserting an image. The image is captioned with repetitive text, as seen in the screenshot. RGJ shares the raw text of the post, showing the repeated captions.

RJJ further tests the issue by uploading an actual image of a man with his feet on a table, which crashes the captioning engine.

Lilly acknowledges the issue and mentions that the AI team is working on it.

Roman_Rizzi explains that the regression was caused by a change to better support OSS models without system prompts and provides a link to the fix.

1

I was happily replying to a post and when I inserted an image, it hung for a long time and then it had tens of odd captions.

Screenshot 2024-08-23 163100
Screenshot 2024-08-23 1631001189×767 75.3 KB

4 Likes
2

{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} (Captioned by AI)
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} {:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."} (Captioned by AI)422×390 18.2 KB

1 Like
4

Look at the raw for the above post https://meta.discourse.org/raw/323079/2

![{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
{:type=>"text", :text=>"The image shows a person sitting in a chair with their feet propped up on a table."}
 (Captioned by AI)|422x390](upload://8ovc6XSQ6XOkGVN48gqpFxqoiFN.png)
3 Likes
5

image
image621×373 43.7 KB

I decided to upload an actual image of a man with his feet on a table (creative commons) and that crashes the captioning engine.

image
image1085×642 101 KB

5 Likes
8

Thanks @RGJ, yea I noticed this one happen to me too - the AI team is working on it. :slight_smile:

3 Likes
9

This regressed due to a change to better support OSS models without system prompts. Fixed by:

https://github.com/discourse/discourse-ai/pull/771

5 Likes
11

This topic was automatically closed after 2 days. New replies are no longer allowed.