Short update, the AI replies in topics/posts should be better. I ran some tests and think something is still not right but at least itās acting with knowledge from the topic.
If you want to help testing this, you can do so to test new topics (in a private category, to start with), mention the AI, provide clear information, numbers are simple to test with. Create a chain of max 10 posts with at least 2/3 numbers (default setting = 5 posts history), then ask if it recalls all the numbers mentioned earlier, in my test it completely āforgotā about one number - while it replied to it earlier.
Current known behavior - then AIBot has been mentioned once in a topic, it keeps replying until a third user comes in.
There are still some bugs with chat - which we will hopefully sort out tomorrow. Want to thank @merefield for the time he puts in. Good night for now.
OK Iāve concluded things are stable now and the obvious big bugs are resolved.
Chat support is finally working properly and Post responses now use the correct history when thereās been an explicit reply to a Post and make much more sense!
Thanks to @jimmynewtron and especially @MarcP for their collaboration and critical feedback.
AIBot seems to be broken in one of my toipcs. Not a concern for me but thought Iād report in case itās useful. Iām pressing the topic reply and itās only me and aibot thatās in the discussion
Message
OpenAIBot: There was a problem: undefined method user_idā for nil:NilClass`
Backtrace
/var/www/discourse/plugins/discourse-chatbot/app/jobs/regular/chatbot_reply_job.rb:56:in `rescue in execute'
/var/www/discourse/plugins/discourse-chatbot/app/jobs/regular/chatbot_reply_job.rb:51:in `execute'
/var/www/discourse/app/jobs/base.rb:249:in `block (2 levels) in perform'
/var/www/discourse/vendor/bundle/ruby/3.2.0/gems/rails_multisite-4.0.1/lib/rails_multisite/connection_management.rb:80:in `with_connection'
/var/www/discourse/app/jobs/base.rb:236:in `block in perform'
/var/www/discourse/app/jobs/base.rb:232:in `each'
/var/www/discourse/app/jobs/base.rb:232:in `perform'
/var/www/discourse/vendor/bundle/ruby/3.2.0/gems/sidekiq-6.5.8/lib/sidekiq/processor.rb:202:in `execute_job'
/var/www/discourse/vendor/bundle/ruby/3.2.0/gems/sidekiq-6.5.8/lib/sidekiq/processor.rb:170:in `block (2 levels) in process'
/var/www/discourse/vendor/bundle/ruby/3.2.0/gems/sidekiq-6.5.8/lib/sidekiq/middleware/chain.rb:177:in `block in invoke'
That fixed it yes- thanks. I just deleted the bot messages. However then when I asked it to summarise the thread it didnāt have anything to summarise. Does the history that gets sent to openai count the deleted messages when selecting the number of messages to include?
Any chance there could be some settings for this quick chat button. At the moment it appears to always take the user to a personal chat with the bot. Iām not sure I want to encourage lots of hidden personal communication with the bot. Users can go to ChatGPT themselves for that. If we had a setting to either direct user to a group chat channel or to create a new topic in a Category specifically setup for AI Discussions.
Iāve tried setting up a category where users can raise topics and effectively ask the bot questions. Can perhaps we flag categories that perform in this way where the bot will:
Always respond to the first post of a topic in that category
Continue to respond to posts if there are no other users in the discussion
Once other users enter discussion then the bot stops unless specifically replied to or mentioned in the post.
All these are only suggestions / ideas. I really like this plugin!
Oh BTW when trying to enable the summary plugin you mentioned my re-build fails and I have to remove the plugin to get the site up again. (Iāll post this separately on that thread in a bit with details)
