# Civil Comments -- rate three other comments before posting

**URL:** https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401
**Category:** General
**Created:** [22 באוגוסט,‏ 2015,‏ 9:32am UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401 "2015-08-22T09:32:25Z")
**Posts on this page:** 15
**Page:** 1

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [22 באוגוסט,‏ 2015,‏ 9:32am UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/1 "2015-08-22T09:32:25Z")

</div>

Our old pal @hanzo clued me in to [http://civilcomments.com/](http://civilcomments.com/) which I couldn’t make heads or tails of from the website alone. But watching their intro video tells the story.

Here’s the special bit : **before anyone can post a comment, they must first rate three random comments for quality and civility**

 ![](https://global.discourse-cdn.com/meta/original/3X/a/4/a4422d82a714ebefbd2b36a8ac408f7ffd9c7496.png) 

_and_ rate **their own comment** for quality and civility, too:

 ![](https://global.discourse-cdn.com/meta/original/3X/1/4/14ef5475f169353ca9f5fdebbdedfe4ff3352a1d.png) 

Then all that “human ranking” feeds into the other stuff like explicit likes, replies, etcetera to determine which ‘best’ comments get published

 ![](https://global.discourse-cdn.com/meta/original/3X/e/e/ee426328fc2493ef25055c76ccf97b4b5c99e624.png) 

And also to filter out (or amplify) users

 ![](https://global.discourse-cdn.com/meta/original/3X/7/2/721394f8db2bb46297c7385e631dec6ca89fbccf.png) 

I’m kind of unclear if you have to rate 3 random comments every time you comment, but maybe? Perhaps it’s only other new users rating other new users?

It’s a Disqus competitor, not anything that really competes with us. But some interesting ideas at least. One red flag for me is rating yourself on “quality”. Because I don’t know about _you_ guys, but all _my_ posts are ∞ quality.

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [22 באוגוסט,‏ 2015,‏ 9:39am UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/2 "2015-08-22T09:39:13Z")

</div>

All my posts are top cuality too!

A+++

---

<div class="post-metadata">

### Author: ![omfg](https://avatars.discourse-cdn.com/v4/letter/o/5e9695/32.png) [@omfg](https://meta.discourse.org/u/omfg)
#### Post date: [22 באוגוסט,‏ 2015,‏ 9:51am UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/3 "2015-08-22T09:51:50Z")

</div>

I don’t mind if the comments are uncivil, as long as they are useful (i.e. have good quality).  
(This is not to say I dislike civility, I just don’t mind that others are uncivil as long as their posts are useful).

If the feature was available, I’d hope that the Civility part could be disabled.  
It’s up to each community’s mods and users (who can flag comments if they’re way below that community’s standard) to define civility.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [22 באוגוסט,‏ 2015,‏ 9:57am UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/4 "2015-08-22T09:57:54Z")

</div>

Well, that’s another problem. You have to set ground rules about what civility means. I do think there are accepted normal standards for civility, but you probably have to be somewhat explicit about _teaching_ those standards to people before asking them to blindly rate others on it.

I always found it amusing that Joel [ran an experiment](https://blog.stackexchange.com/2012/07/the-hunting-of-the-snark/) on this using Mechanical Turk and rating Stack Overflow comments as “friendly”, “unfriendly”, or “unknown/neutral”

> Of 7000 comments submitted, there were 161 that were rated as “unfriendly” by 75% or more of the reviewers… that’s about 2.3%
> 
> Of 7000 comments submitted, 557 were rated as “friendly” by 75% of more of the reviewers… that’s about 8%

I also think friendly/unfriendly is a lot easier to decide, and even there, consider that of 7000 comments:

- 557 rated friendly
- 161 rated unfriendly
- **6,282 rated neutral/unknown**

Which kinda shows you how hard it is to rate things on squishy subjective emotional stuff.

Remember, too, that in the video they’re asking you to rank civility **on a scale** which is harder yet! Was this 0/3 civil? 1/3 civil? 2/3 civil? 3/3 civil?

---

<div class="post-metadata">

### Author: ![geoff777](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/geoff777/32/202388_2.png) [@geoff777](https://meta.discourse.org/u/geoff777)
#### Post date: [22 באוגוסט,‏ 2015,‏ 12:23pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/5 "2015-08-22T12:23:24Z")

</div>

I think they need “darkness”.  
Do they force the happy head shot profile pics? (As he quickly changes his)  
Everyone’s 20ish …  
Way toooo nice.

---

<div class="post-metadata">

### Author: ![downey](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/downey/32/166878_2.png) [@downey](https://meta.discourse.org/u/downey)
#### Post date: [22 באוגוסט,‏ 2015,‏ 2:38pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/6 "2015-08-22T14:38:32Z")

</div>

No, they’re civil, happy, and 20-ish because they live in Portland. 🌉 🐦

---

<div class="post-metadata">

### Author: ![purldator](https://avatars.discourse-cdn.com/v4/letter/p/bcef8e/32.png) [@purldator](https://meta.discourse.org/u/purldator)
#### Post date: [22 באוגוסט,‏ 2015,‏ 2:47pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/7 "2015-08-22T14:47:14Z")

</div>

Very interesting. Could be done randomly to check the current environment’s social health. Or a requirement for basic users before ascending to the member trust level.

It also reminds me of [the techniques League of Legends now uses to curtail purely abusive behavior](https://meta.discourse.org/t/measures-taken-against-bad-behaviour-in-league-of-legends/26084).

---

<div class="post-metadata">

### Author: ![Hanzo](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/hanzo/32/102157_2.png) [@Hanzo](https://meta.discourse.org/u/Hanzo)
#### Post date: [22 באוגוסט,‏ 2015,‏ 5:02pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/8 "2015-08-22T17:02:01Z")

</div>

> [@codinghorror](#):
>
> all my posts are ∞ quality.

This has got to be part of the internal mechanism used to build a credibility or trust rating. If you consistently say that your own posts are A+++, and the broad majority of the users think otherwise, the algorithm _could_ weight your opinion less over time. What muddies that, however, is a cesspool of trolls.

What happens when you are the only shining star in a sea of shit? If you are the only one in touch with reality, and genuinely honest with yourself about the quality of your posts/comments, wouldn’t a community filled with trolls that feel the opposite simply work against this algorithm?

Of course, if self-rating is used in a different capacity, it escapes me as to how. Perhaps I’ll have more on this after ☕.

---

<div class="post-metadata">

### Author: ![Stephen](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/stephen/32/95011_2.png) [@Stephen](https://meta.discourse.org/u/Stephen)
#### Post date: [22 באוגוסט,‏ 2015,‏ 5:33pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/9 "2015-08-22T17:33:10Z")

</div>

I’m fine with a simple two-button affair:

![](https://global.discourse-cdn.com/meta/original/3X/2/8/285030d1d1b659ba43973d94b15b4f28fe761e82.png)

---

<div class="post-metadata">

### Author: ![purldator](https://avatars.discourse-cdn.com/v4/letter/p/bcef8e/32.png) [@purldator](https://meta.discourse.org/u/purldator)
#### Post date: [23 באוגוסט,‏ 2015,‏ 2:08pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/10 "2015-08-23T14:08:34Z")

</div>

Only a Sith deals in absolutes.

---

<div class="post-metadata">

### Author: ![Ajedi32](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/ajedi32/32/107370_2.png) [@Ajedi32](https://meta.discourse.org/u/Ajedi32)
#### Post date: [23 באוגוסט,‏ 2015,‏ 4:56pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/11 "2015-08-23T16:56:21Z")

</div>

Haha, so they implemented [XKCD 810](https://xkcd.com/810/)?

---

<div class="post-metadata">

### Author: ![erlend\_sh](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/erlend_sh/32/119475_2.png) [@erlend\_sh](https://meta.discourse.org/u/erlend_sh)
#### Post date: [24 באוגוסט,‏ 2015,‏ 8:01pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/12 "2015-08-24T20:01:04Z")

</div>

> before anyone can post a comment, they must first rate three random comments for quality and civility

I feel like this is asking too much of the Average Joe. I don’t expect newcomers to help me keep my clubhouse clean. That’s the regulars’ job, who’ll do a better job of it anyways.

---

<div class="post-metadata">

### Author: ![dfabulich](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/dfabulich/32/108716_2.png) [@dfabulich](https://meta.discourse.org/u/dfabulich)
#### Post date: [24 באוגוסט,‏ 2015,‏ 10:41pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/13 "2015-08-24T22:41:41Z")

</div>

I think the idea is to identify people who don’t know what a civil comment is.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [24 באוגוסט,‏ 2015,‏ 10:46pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/14 "2015-08-24T22:46:00Z")

</div>

Thinking about it a bit more, there are a few things you could measure here with the **force user to rate their own reply before posting** technique:

Did they …

- change anything before posting? How much did they change?
- abandon the response entirely?
- spend any time looking at the dialog before clicking “post”?

I agree that the self rating is probably a placebo (or maybe even a red herring!), it’s doubtful you would factor any self rating into your algorithms because of bias. But there are a number of interesting data points you could collect here..

---

<div class="post-metadata">

### Author: ![fefrei](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/fefrei/32/119538_2.png) [@fefrei](https://meta.discourse.org/u/fefrei)
#### Post date: [25 באוגוסט,‏ 2015,‏ 7:14pm UTC](https://meta.discourse.org/t/civil-comments-rate-three-other-comments-before-posting/32401/15 "2015-08-25T19:14:11Z")

</div>

I’m not even sure whether the main point here is to gather data. I think this is also a way to ensure [the 98% of people](http://blog.codinghorror.com/the-just-in-time-theory/) that usually post civil comments, but could be tempted in the heat of the argument, are thoughtful and civil: Is there a better way to teach people to self-reflect on their comment than to show them other comments in the context of rating civility, and then letting them look at their own comment again?
