AI bot - Chat and PM integration

[Discourse]

This guide explains how to integrate AI bot - Personas into your chat and personal message (PM) experience.

Required user level: Administrator

Configuring chat and PM for Personas

In order to integrate with chat, a persona must have a User created and have a Default Language Model selected.

1. Enable Allow Chat Direct Messages , this will allow the user persona to receive direct messages (DMs).

2. Enable Allow Personal Messages, this will allow users to send PMs to the persona

Tips for configuring chat personas

When configuring a persona for chat, keep the following tips in mind:

• Max Context Posts: Chat messages tend to be short, so consider increasing the Max Context Posts setting to a higher number for personas focused on mentions. This will allow the AI to maintain more context from previous messages.

• Default LLM and User: Chat can only be enabled on a persona if you enable both a default LLM (language model) and user. Make sure to properly configure these settings.

• PM-based Features: All features available for PM-based personas are also available for chat personas. However, the optional advanced debugging information displayed in PMs is not shown in chat.

Auditing chat interactions

Auditing chat interactions can be a bit more challenging compared to other methods. However, ai_api_audit_logs will still have full logs of all chat interactions. You can query these logs using the Data Explorer in Discourse.

Chat behavior

When interacting with chat personas, keep the following behavior in mind:

• DM: A new thread will be unconditionally created for every new message sent to the bot via DM.

• Channel: When replying directly to a message in a channel and threading is enabled, a new thread will be created. Otherwise, the reply will be added to the channel.

Last edited by @Saif 2024-11-04T23:39:55Z

Last checked by @hugh 2024-08-06T02:12:37Z

Check document

Perform check on document:

[MachineScholar]

This is an amazing plugin and it’s working well. However, I have two issues that I haven’t been able to resolve after any tinkering:

1. I’m not able to select any default language model. Whenever I try to type in a name it only returns “No matches found”. Therefore I can’t use the chat feature for the persona.
2. For some reason when interacting with the bot via DM, the images are not uploading (using GPT-4o with vision enabled)

I’d be very thankful for any pointers on these two dilemmas.

[sam (Sam Saffron)]

Can you confirm if this is working properly now (be sure to update to latest) we redid how LLMs are configured.

[MachineScholar]

All fixed. Y’all are seriously the best.

[Leo_Wong]

Hello, can we setup so only allow the bot reply in certain chat channel ? thanks

[sam (Sam Saffron)]

Not at the moment, but this is certainly a good idea to add. Keep in mind it only replies on mentions at the moment, so it is quite hidden. Also we respect the permission on the persona so if users don’t have access to the person they will not hear back when they @mention.

[piffy]

Not sure if it’s worthy of its own topic but it seems like the [grid] is redundant in a chat message with images

[merefield (Robert)]

Full markdown support in Chat

It would be nice if the Chat window had full markdown support. Currently, it appears to intentionally not render markdown headers, as discussed here. I agree that most people would not type markdown headers in a chat but LLMs might. As chatbots are becoming more common, it would be nice if any markdown sent by an LLM displayed correctly in the Chat window. With RAG support bots in particular, the LLM receives raw post content from topics which may contain markdown headers. If it includes tho…