AI Summary Backfill is wasting tokens summarizing PMs

Our ratio is 10 PMs for every normal topic:

topic_type total_count
Private Messages 52130
Normal (Regular) Topics 5399

(Data Explorer code is courtesy of ChatGPT o1.)

The normal topics often use somewhat more input tokens than PMs, which mitigates the issue somewhat, but still.

2 Likes