sam
(Sam Saffron)
May 24, 2023, 6:25am
1
This topic covers the configuration of AI Bot module of the Discourse AI plugin.
Feature set
The AI Bot allows for direct integration with generative AI powered by either OpenAI or Anthropic.
Replies from bot stream and can be stopped mid generation
Automatically titles PMs
Multiple team members can interact with a chat session
GPT-4 features
When configured it can generate images using stable diffusion
When configured it can search using Google
Is able to search through public content on the forum
Settings
ai_bot_enabled_chatbots
: list of bots to enable
ai_bot_enabled
: to enable the plugin
ai_bot_allowed_groups
: groups with access to the chat bot
ai_helper_add_ai_pm_to_header
: add robot to the top of the page to initiate messages
ai_stability_api_key
: (optional) stable diffusion api key
ai_google_custom_search_api_key
: (optional) google custom search api key
Providers
Caveats
The bot is an area of much experimentation and is changing rapidly.
Future work
Chat integration
Semantic search (currently uses traditional search)
Faster topic summaries
16 Likes
sam
(Sam Saffron)
May 31, 2023, 11:16pm
18
Per:
discourse:main
← discourse:tweaks-to-bot
opened 07:51AM - 31 May 23 UTC
For the time being smart commands only work consistently on GPT 4.
Avoid using a… ny smart commands on the earlier models.
Additionally adds better error handling to Claude which sometimes streams
partial json and slightly tunes the search command.
I don’t want perfect to be the enemy of good here.
I changed it so all the extra fancy stuff like search integration and image generation is only implemented on GPT 4 which is able to properly deal with the very complicated prompt.
I have some ideas on bringing these features to GPT 3.5 / Claude as well, but in the interim the basics are mighty useful on the simpler models.
Multiple people can interact with LLMs in a single session (something that is not possible in chat.openai.com )
Stuff streams like it does in the official UIs and can be cancelled.
We get access to our Markdown engine so you can get it to draw mermaid diagrams and other fancy things.
So this is very useful for general purpose tasks on the simpler models today.
3 Likes
sam
(Sam Saffron)
June 16, 2023, 3:35am
22
Given the latest news from OpenAI I am delighted to now support GPT 3.5 with full bot capacity! (to be merged soon)
discourse:main
← discourse:function-calling
opened 06:47AM - 15 Jun 23 UTC
Given latest GPT 3.5 16k which is both better steered and supports functions
we … can now support rich bot integration.
Clunky system message based steering is removed and instead we use the
function framework provided by Open AI
Tests still need fixing and system needs a bit more debugging, but early
results are very promising!
We’re announcing updates including more steerable API models, function calling capabilities, longer context, and lower prices.
Sadly I still can not get anthropic to work in this department, techniques such as GitHub - microsoft/guidance: A guidance language for controlling large language models. may get it there, but it can get super expensive.
6 Likes