People, I see there are a few interesting topics on integrating bots at various levels into Discourse, but I did not see any topics about integrating the big, large-memory model AI bots like GPT-3, BlenderBot etc. Has anyone thought about this? or even made any progress implementing the idea? I am thinking of setting up another instance of Discourse with one of the big AI bots as an ordinary user on the system who participates like any other human user - but perhaps only replies when a post is directed at him specifically or where his handle is mentioned in a post. Before I jump in again with a new instance, I thought I might get some feedback first this time . . Thanks for any enlightenment . .

Proposal for an Answering Bot with Scheduled Categorization and Fine-Tuning for Discourse Forums Introduction: Discourse forums rely on user engagement and contributions, and a crucial aspect of this is the ability to get timely and accurate answers to questions. However, sometimes it may take a while for a response, discouraging users from continuing to participate in the conversation. To address this, we propose a bot that can automatically answer questions after a specific time frame to encourage community engagement. Additionally, the bot will allocate scheduled calls to categorize existing threads and build its own fine-tuning dataset, which can be updated from time to time. Objectives: The primary objectives of the answering bot with scheduled categorization and fine-tuning for discourse forums are to: Encourage community engagement by providing timely and accurate answers to questions that may otherwise remain unanswered. Automate the categorization of existing threads to ensure that questions are correctly tagged, and users can easily find relevant information. Build a fine-tuning dataset for the bot to improve its performance and accuracy over time. Proposed Solution: To achieve the objectives outlined above, we propose integrating a bot that can automatically answer questions after a specific time frame, allocated scheduled calls to categorize existing threads, and build its fine-tuning dataset. The bot will be designed to analyze user input, understand the context of the conversation, and generate appropriate responses based on predefined rules and machine learning models. The bot will use natural language processing (NLP) techniques to analyze user input and generate responses that are relevant to the conversation. It will be trained to understand the context of the question, the topic being discussed, and the user’s previous interactions to provide accurate and helpful answers. The bot will only respond to questions that have not been answered within a specific time frame or when summoned by a username directly. In addition to answering questions, the bot will allocate scheduled calls to categorize existing threads. It will analyze the thread’s content and tags to ensure that questions are correctly tagged and organized for easy navigation. The bot will also build its fine-tuning dataset by recording and categorizing user queries and responses. This dataset will be used to train and improve the bot’s performance over time. Benefits: The benefits of integrating an answering bot with scheduled categorization and fine-tuning for discourse forums are numerous, including: Encouraging community engagement: The bot will provide timely and accurate answers to questions, encouraging users to continue participating in the conversation. Improved categorization of threads: The bot will automate the categorization of threads, ensuring that questions are correctly tagged and organized for easy navigation. Improved accuracy and performance: The bot’s fine-tuning dataset will be used to train and improve its performance over time. Reduced workload for human moderators: The bot will reduce the workload of human moderators by automating the categorization of threads and answering questions that would otherwise go unanswered. Conclusion: Integrating an answering bot with scheduled categorization and fine-tuning for discourse forums is a valuable investment that can help encourage community engagement, automate categorization tasks, and improve the accuracy and performance of the bot over time. We recommend exploring the available NLP and machine learning models to select the one that best meets the needs of the discourse forum. The integration process should be planned and executed carefully, with proper testing and training to ensure that the bot performs as intended.

This is a great start but unfortunately, as the OP, it still does not achieve what I said I was lookig for in the beginning. However, after having been looking at this area for many years now, unless I win the lottery, I am not going to get exactly what I want by trying to pay for it myself. To reiterate, I need a bot that can not only do what you outline above but also has a persistent memory for previous discussions with individuals - just a like a human has. Since I am not going to get exactly what I want anytime soon but Discourse itself + the developing proposal for a Discourse AI Bot would do a LOT of what I want, maybe I should just put all my efforts into helping as much as I can with that project while I continue to investigate persistent memories using Graph Theory and other stuff - that could be added later?

[image] Philip Rhoades: To reiterate, I need a bot that can not only do what you outline above but also has a persistent memory for previous discussions with individuals - just a like a human has. If the Discourse implementation/proposals don’t meet your needs, and you’re happy to fund the development of Open Source AI software (Apache-2.0, which Discourse themselves would then be free to re-purpose), I would be more than happy to set up for you an AI bot for Discourse that has memory.

Everything here is going to depend on the model. I can see a lot of general interest here, but nobody has suggested which model to use and nobody proved that the model can do anything remotely useful. Even getting good stuff out of OPT is hard and Facebook added a fair bit of params. My general concern here (also to the industry at wide) is that in the open space there is nothing even remotely close to GPT 3 devinci, and GPT 4 is on the horizon and will make it even harder to compete.

[image] Sam Saffron: but nobody has suggested which model to use and nobody proved that the model can do anything remotely useful. In the following post above both a model, and the usefulness is detailed: [image] Integrating GPT3-like bots? Development Here is a great implementation of a GPT bot that is able to use the entire website context built ontop of supabase (open source): [ClippyGPT - How I Built Supabase’s OpenAI Doc Search (Embeddings)] I suspect, Discourse and supabase would be a great alignment here. A plugin that undergoes forum embeddings using the approach in that video above, and then creates a user backed by that would be amazing. I would certainly be interested. But unfortunately, I think if it’s not in the ope… The process is Supabase + OpenAI GPT API. Right now GPT 3.5 + OpenAI embeddings is sufficient to achieve many tasks desired today of a Discourse bot. The GPT API is not open source. But, it is an API. And when an open source model catches up (such as https://github.com/LAION-AI/Open-Assistant), it can be swapped into its place. [image] Sam Saffron: My general concern here (also to the industry at wide) is that in the open space there is nothing even remotely close to GPT 3 devinci, and GPT 4 is on the horizon and will make it even harder to compete. I certainly agree. That’s why, for now, under the hood GPT 3.5 would be used until a better alternative is available.

My big concern here is attribution, especially when a corpus is enormous like a Discourse forum and so much of the data used to train the bot may be out of date. There are some big fundamental issues with this ClippyGPT approach. You can’t replace search with something that is not providing links back to content. Training this would also be a monster of a task.

[image] Simon Biggs: If the Discourse implementation/proposals don’t meet your needs, and you’re happy to fund the development of Open Source AI software (Apache-2.0, which Discourse themselves would then be free to re-purpose), I would be more than happy to set up for you an AI bot for Discourse that has memory. Prob better to PM you for a better discussion about the details of this idea . .

Hi Phil, I am also in the Sydney timezone (Wagga Wagga). My email address is me@simonbiggs.net. Let’s organise a time to do a video call? Cheers, Simon

Oh wow! - I moved from Sydney to Cowra in 2015! - I just drove near you a few days ago going to and from Holbrook! Are you around at all for the rest of the day?

Speaking of Sydney… :wink: I’m surprised that nobody has mentioned the “new” Bing yet. I think it’s a great example of what could be implemented in Discourse. [image] Reinventing search with a new AI-powered Microsoft Bing and Edge, your... To empower people to unlock the joy of discovery, feel the wonder of creation and better harness the world’s knowledge, today we’re improving how the world benefits from the web by reinventing the tools billions of people use every day, the search... Est. reading time: 6 minutes [Microsoft is Updating Bing with ChatGPT - Here's What You Need to Know]

Integrating GPT3-like bots?

Development

merefield (Robert) February 24, 2023, 3:08pm 59

This is going quite well too:

Topic		Replies	Views
ChatGPT Integration tools for Discourse Product Support	6	2174	February 27, 2023
Comparison between discourse-ai AI Bot and merefield/discourse-chatbot General ai , ai-bot	4	618	May 25, 2023
ChatGPT Assistant Integration Product Support	5	1703	February 11, 2024
Advice on a support bot for a technical support forum (Discourse AI vs Discourse Chatbot) General ai , ai-bot	57	5454	April 29, 2026
Discourse AI - AI bot Site Management how-to , ai , ai-bot	49	20009	March 1, 2026

Integrating GPT3-like bots?

Related topics