Evaluating Google's Perspective API on your Discourse forum

Yes it is.

I used the app to help decide whether installing the discourse-etiquette plugin was a good idea yet. I concluded that the flagging feature of the plugin would probably be useful to mods, but the automated feedback to users might be risky.

Here are the stats by category on my forum - seems mods urgently need to check out “2016 Parents” (an opt-in category) and work out what’s going wrong there!

As I imagined, most of the toxicity happens in our ethics and politics categories.

Here are the overall scores for SE23.life

Attack on Author 0.1
Attack on Commenter 0.19
Incoherent 0.505
Inflammatory 0.175
Likely to Reject 0.412
Obscene 0.165
Severe Toxicity 0.045
Spam 0.382
Toxicity 0.116
Unsubstantial 0.41

I’d be interested to hear how other forums compare

6 Likes