AI-bot misses date on chat only

Product Support
, ,

AI-generated summary

Jagster reports that the AI-bot in chat consistently provides incorrect dates when answering time-sensitive questions — such as the next full moon in Finland — despite correctly answering the same question in PMs or topic threads. In one example, the bot confidently claimed the next full moon was on 28.10.2023, then later corrected itself to 28.7.2024 after being asked to verify the current date — though the correct answer was actually 21.7.2024, which the bot knew in PMs. Jagster estimates this error occurs 8 out of 10 times in chat, but never elsewhere, suggesting a possible difference in the API or system prompt used in chat versus other contexts. They note that even the human-operated Chatbot exhibits similar behavior, hinting that the issue may stem from chat-specific configuration rather than the AI’s core logic. Jagster later confirms the issue appears to have been resolved, and closes the report.

1

I don’t know if this is actual support question, but the staff knows what to do.

I asked on chat from AI-bot what is the phase of moon today in Finland. It asked correctly. Then I asked when is next full moon in Finland. It was totally sure it will be 28.10.2023

When I asked it verifying current date and the reviewing its latest answer, it got it right, 28.7.2024.

But this isn’t the bery first time. By stetson statistic I claim it makes similar error 8 times out of 10, if the request need knowledge of current date. But this happens only in chat. Not when conversation happends on PM or topics.

And why this isn’t pure support question — Chatbot act similar way. Those two AI-solutions has really different system promp, though. But I don’t think that mentionable persona by DAI follows exacly same system prompt that is valid on foorum. That guessing comes from its answers that are different in many ways than what it would generate in PM/topics.

So what is happened here? Does chat chatting using different API what ever to OpenAI’s direction or what?

2

And kind of funniest part here is AI was all the time wrong, no matter what date or year it offered. Right answer would be 21.7.24 — and on PM it knew it.

3

Something fixed this at some point. Let’s tidy up places a bit.