If this helps anyone, it appears the content window configured in the LLM configuration was too small. Increasing it seems to have fixed it (for now atleast). Will keep an eye on it.
Perhaps discourse could find another way to handle it if the context window isn’t large enough rather than cutting off the message which makes it an invalid message.