Estimating costs of using LLMs for Discourse AI

Documentation Site Management
, ,
3

We recently shared the following with a customer who was asking about AI search use in Meta and how much that costed us

Last month we did 1104 searches in Meta

  • GPT-4o-mini pricing, which would cost $0.25
  • Using haiku would be $0.53
  • Gemini Flash would be $0.06

We have to pay attention to request tokens which was around 85868 and response tokens which was around 408417 from the LLM