Alright, i’ve taken a crack at this:
Napkin estimates:
ChatGPTv4 API
- $0.0008 per 100 words
- 1 user averages about 100 words (or tokens) per day on each AI module
- Running all 6 AI modules
$0.0008 * 6 = $0.0048
Total monthly cost per user: $0.0048 * 30 = $0.144
The minimum server requirements for self hosting are around:
- 16GB of free RAM, 32 preferred
- 3.5 GHz or higher CPU and 8 cores or more
- 100GB SSD
The lowest cost server which meets those requirements on Digital Ocean is:
- 16 GB Ram
- 8 Premium Intel vCPUs (over 3.5 GHz)
- Bandwidth: 6,000 GiB
- SSD: 2x 200 GiB
- Monthly cost: $244.00
So self-hosting ChatGPT4 will be more cost effective than using its API service when Discourse has around 2,000 active users per month.
With some pretty wobbly and generous rounding involved. Does that sound about right @Falco