# Observability for Discourse AI

**URL:** <https://meta.discourse.org/t/observability-for-discourse-ai/316107>\
**Category:** Feature\
**Tags:** ai, ai-bot\
**Created:** [July 12, 2024, 4:00pm UTC](https://meta.discourse.org/t/observability-for-discourse-ai/316107 "2024-07-12T16:00:12Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![Falco](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/falco/32/179432_2.png) [@Falco](https://meta.discourse.org/u/Falco)\
**Post date:** [August 1, 2024, 4:10pm UTC](https://meta.discourse.org/t/observability-for-discourse-ai/316107/2 "2024-08-01T16:10:40Z")

</div>

> [@aas](#):
>
> Using LangSmith is as simple as running `yarn add langchain langsmith` and adding a few environment variables.

Hahahaha, I wish.

> [@aas](#):
>
> supporting monitoring

We log every single request and response to LLMs in a table, and allow admins to query those at any time via [Data Explorer](https://meta.discourse.org/t/32566?silent=true). Have you tried this already?

 ![image](https://global.discourse-cdn.com/meta/original/4X/d/2/c/d2c2856e44687849588b84e06dc84762fafece57.png)

```json
{
  "max_tokens": 2000,
  "model": "meta-llama/Meta-Llama-3.1-70B-Instruct",
  "temperature": 0,
  "stop": [
    "\n</output>"
  ],
  "messages": [
    {
      "role": "system",
      "content": "You are a markdown proofreader. You correct egregious typos and phrasing issues but keep the user's original voice.\nYou do not touch code blocks. I will provide you with text to proofread. If nothing needs fixing, then you will echo the text back.\nYou will find the text between <input></input> XML tags.\nYou will ALWAYS return the corrected text between <output></output> XML tags.\n\n"
    },
    {
      "role": "user",
      "content": "<input>We log every single request and response to LLMs in a table, and allow admins to query those at any time via Data Explorer. Have you tried already?</input>"
    }
  ]
}

```

```json
{
  "id": "chat-45cd241b6e0f4a58840fcc9f49dfa56a",
  "object": "chat.completion",
  "created": 1722528517,
  "model": "meta-llama/Meta-Llama-3.1-70B-Instruct",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "<output>We log every single request and response to LLMs in a table, and allow admins to query those at any time via Data Explorer. Have you tried this already?</output>",
        "tool_calls": []
      },
      "logprobs": null,
      "finish_reason": "stop",
      "stop_reason": null
    }
  ],
  "usage": {
    "prompt_tokens": 135,
    "total_tokens": 174,
    "completion_tokens": 39
  }
}

```

> [@aas](#):
>
> evaluating LLMs

Creating evals for our features is certainly on our roadmap for 3.4, in special for tweak on our Related Topics and Summarization features.

---

_[View the full topic](https://meta.discourse.org/t/observability-for-discourse-ai/316107)._