Helper - Auto caption

:bookmark: This guide explains how to enable and configure automatic AI powered captions, which is part of the Helper feature of Discourse AI plugin.

:person_raising_hand: Required user level: Administrator

Auto caption allows users to harness AI to automatically caption any uploaded image, providing detailed descriptions.

Features

  • Manual Caption with AI option
  • Automatically caption with AI
  • Alerting users of enabling Auto caption for all uploaded images
  • Editable caption always including β€œ(Captioned by AI)” in copy

Enabling Auto caption

Prerequisites

You must configure at least one vision-powered Large Language Model (LLM) from a provider.

To get started you can configure them through the Discourse AI - Large Language Model (LLM) settings page.

Configuration

  1. Go to Admin β†’ Plugins
  2. Search for discourse-ai and ensure it’s enabled
  3. Ensure the Helper feature is enabled by checking composer ai helper enabled
  4. In ai helper enabled features ensure image_caption is an enabled feature of Helper
  5. Select the LLM at ai helper image caption model
  6. We recommend setting ai auto image caption allowed groups to specific user groups so they can use Auto caption

Additionally, users can also set their individual preferences to enable/disable Auto caption by navigating to their own user profile β†’ preferences β†’ AI

Technical FAQs

Why is the caption description not matching the image?

  • This depends on the vision-powered LLM and the image itself. More powerful LLMs might be able to better describe the picture but that is dependendent on the model. Picture fidelity and the subject of the picture are also important factors to consider in caption output.

Last edited by @Saif 2024-11-14T15:50:24Z

Check documentPerform check on document:
1 Like

When an image is uploaded, a short summary (about 1 sentence) is given. I assume that is generated by AI and will incur costs?

1 Like

Yes you would incur a cost and that would depend on the provider

1 Like

@NateDhaliwal, this should help give you some rough estimates.

1 Like

Right, thanks!