Discourse Chatbot 🤖 (Now smarter than ChatGPT!*)

This is done:

  • up Open AI gem to latest
    • will provide more config options in future
    • ups default timeout to 120 seconds (useful given recent problems with Open AI API response times! :sweat_smile: )
  • move console logging behind setting

Note that I was already using Rails.logger.debug for some elements, but feedback to console is important to me during my development workflow, so this is now behind a setting, default OFF.

Also I’ve merged this useful PR:

  • FEATURE: Add fine-tuning to settings (top_p, frequency_penalty & presence_penalty (see OpenAI API)
  • IMPROVE: Better locales and make the URL’s clickable
  • FIX: Respect max_tokens also in gpt-3.5-turbo model, this line was not in the prompt before

Thanks @MarcP :rocket:

still no GPT-4 access yet … :sweat_smile: … I’ll be adding support for that asap.

7 Likes

Azure provides a more friendly openai api, is there any plan to consider supporting it? (Quickstart - Get started using ChatGPT (Preview) and GPT-4 (Preview) with Azure OpenAI Service - Azure OpenAI Service | Microsoft Learn)

1 Like

Why would that be of benefit and give us more than we have now? Can you please provide a more detailed, persuasive, justification?

What do you mean by “a more friendly” openai api?

I’ve already adopted the de-facto standard Ruby bridge to the official Open AI platform API, a solution which is pretty friendly from a developers perspecive and connects us directly to the source service? :slight_smile:

2 Likes

It looks like they add some kind of filter… not sure if we want that?

2 Likes

IMHO they are trying to manage what people talk, think and share over the world applying direct censorship and deciding what people can or can’t do, trying to push Google without ads plus AI.

I was out ChatGPT because of that and then I register myself without a phone number, using VPN and with an e-mail alias.

But now I validate my first thougts because Microsoft kicks 10.000 employees to invest 10.000 millions into AI and they are breaking all the good thing.

There is nothing with that level of data but I see some folks are working into an open-source alternative.

The plugin and the possible workflow is awesome to Discourse daily basis, I hope it stays and only get stronger, with or without OpenAI.

3 Likes

Yeah my intention is to add other bots once there is another obvious good alternative, especially one that doesn’t attempt to nanny.

We have moderation on forums in any case so we can manage the output of less constrained bots.

There are some perfectly reasonable innocent use cases which are currently blocked. For example, a user on the Open AI forum complained the bot was not allowed to simulate fighting which was useless for his intended purpose of using it to create Dungeons & Dragons scenarios :).

3 Likes

is there a free option?

1 Like

OpenAI has a limited free quota, can you read the whole topic here?

You will find good discussion and your question already asked :slight_smile:

3 Likes

The general benefit is that companies get to “do business with Microsoft” vs doing business with a startup. Often, legal places less of an obstacle approving Microsoft because they have SOC2 and ISO certifications and so on.

3 Likes

Messages from AIbot are truncated.

When I ask AIBot to reply in English, the message is not truncated. It seems to be related to the character length judgement in different languages.

1 Like

Interesting.

First such report. I’m simply displaying the entire response, but a token limit setting is present and sent to the API. Try increasing it? I’m afraid there are limits on how much we can control what the bot responds with.

2 Likes

Fine. Is that the same thing as “friendly” though? And that doesn’t pass the common sense test? Azure is surely just passing the same data through or are they actively altering it?

1 Like

Azure have private copies of the models, heavy investment in open ai. The only company that gets this level of access, it upsets Musk he rants about it

5 Likes

Got it. Makes sense. Thanks.

1 Like

This looks to have potential commercial benefit. If you want this please contact me privately to discuss terms.

2 Likes

According to the performance difference between Microsoft and ChatGPT, the content output by Microsoft’s ai API is more secure, and I hope my forum users can get more definite answers.

Regarding commerciality, my opinion is that other services of Azure, such as translation services, have been integrated by other plug-ins. I was wondering what is the reason you think the azure API is commercial?

1 Like

Are you saying that the Azure service is in fact an API to Bing not just GPT-4? Looking at the documentation that is not obvious to me:

This looks to mostly duplicate what Open AI provides and no more.

In any case I intend to add GPT-4 support when I have access, but plan presently only to use OpenAI’s API directly.

See Sam’s point above.

Note, this is free software. I cannot provide unlimited free enhancements. Just like everyone else I have bills to pay. If a commercial entity is interested in funding this I may look at it sooner. And note it’s not just the time it takes me to add features but that I have to support them for the life of the plugin too which gets a greater burden the more complex the solution.

But at least you will need to demonstrate this is not just duplicating the same capabilities of GPT-4.

3 Likes

I got truncated messages even in English. Just asked bot to add missed points :slight_smile:

Снимок экрана от 2023-03-30 12-31-29

3 Likes

To solve this there are two options:

  1. Increase max tokens. You can somewhat control the length if you give it directions in the system role, e.g. “answer as short as possible” (this is an example, will get you really short replies, most of the times).
  2. Simply ask: “continue your answer”.
4 Likes

This is the best explanation I could find OpenAI vs Azure OpenAI - msandbu.org

3 Likes