Evaluating Google's Perspective API on your Discourse forum

I love the approach of being able scan the history of a forum and surface historical issues.

I think we should introduce a new model to store all this information and just have the official plugin backfill the model, then you can run queries about history in data explorer.

I would say a great first move here @erlend_sh with the perspective plugin is focusing on validating this historically.

  • Plugin runs in a “no warnings, no jits, only update model” mode (site setting)

  • Plugin has a job that backfills N posts every N minutes.

  • We then have a few data explorer queries to report on:

    • Most toxic categories
    • Most toxic users
    • Most toxic posts
    • Most toxic posts today

I feel way more easy about enabling this if I could see how it performed historically.

Working through history can allow forum admins to adjust all the params according to historic behavior in the forum.

15 Likes