20

I propose that:

  • This site's core users MUST much more frequently downvote answers even if they are "only" mediocre or we are going to face a consistent decrease in quality

because (each of these is expanded on at length below):

  1. All (or at least most) our questions are subjective
  2. Anyone can post answers on nearly all our questions
  3. Permissibility of mediocre answers invites more mediocre answers
  4. There is no real incentive to stop posting mediocre answers except DVing

This has been discussed before but I believe is worth a serious revisit at this point.

Also, this is a separate problem from question quality.


What is unique about The Workplace compared to many other SE sites

Questions asked on this site, will, in general, not have an objective answer. There is almost never a "here's THE answer" question asked here. Every single question asked on this site is effectively a subjective question.

From the linked blog post, there are specific qualities desired in subjective answers:

The Back It Up! Principle:

  • Something that happened to you personally
  • Something you can back up with a reference

They talk about how “opinion, by itself, is noise.” They’re not saying that subjective opinions are to be avoided; they’re attempting to mold and shape their inherently subjective Q&A into something constructive, informative and helpful. As it turns out, there is an entire field of subjective “expertise” that has the hallmarks of making great Q&A sites:

Our FAQ even specifically has this text:

Please note that answers should be backed up either with a reference, or experiences that happened to you personally. You should always include in your answer information about why you think your answer is correct.

So as a site, included in the "How Should I Answer?" component of our FAQ is text which requires people to have some sort of "back it up" rule already.

Issue 1:

  • Subjective answers require special care in how they are answered (ie not "here's the answer")

Everyone is an expert here (or can pretend...)

Most people cannot go to StackOverflow and contribute answers to problems outside their expertise or familiarity.

We don't have this luxury. Almost anyone who has worked in any capacity can provide some amount of "answers" to the overwhelming majority of constructive questions asked on this site. Anyone who comes here can contribute their thoughts on questions.

This means we have effectively no barrier to entry on our site (which is great, honestly) for answering questions, so anyone can contribute. This is a huge plus for the long term viability of The Workplace. But the problem is anyone can contribute their thoughts, regardless of whether they constitute a "good" answer or not by our site standards.

This results in

Issue #2:

  • The barrier to entry at The Workplace is incredibly low (ie non-existent)

Low quality or mediocre answers invite similar answers

Prevalence of mediocre answers simply invites more of the similar. Wikipedia has a great article on this topic (officially called Broken window theory). The idea (with respect to crime) is when there is a prevalence of small crimes - graffiti, broken windows, etc - this enables more of the same as well as more serious problems. By targeting the "weaker" crimes police can effectively combat crime as a whole.

This principle is also very true on our Q/A site. Answers which are low quality (say 1 line answers) invite more of the same. We get this problem nearly every time one of our questions appears on the popular questions list.

Not only is this true with really bad answers, it is also true with mediocre answers which do not really fit our site standard for answers described on our FAQ as well as in the link about subjective questions. If we consistently tolerate mediocre answers we are going to slowly have a decrease in overall quality. It is my opinion that we are already on this route - overall answer quality seems to have been slowly decreasing since I first got active on here (hopefully not because of me...) and the overwhelming majority of answers no longer seem to even try to meet the "good subjective answer" characteristics.

Issue #3

  • Consistent mediocre/low quality answers invite more similar answers

Upvoting good answers does NOT do anything to encourage only good answers

It might, but plenty of mediocre answers receive upvotes here too. Is it true that, most often, answers meeting our FAQ have higher vote counts than mediocre answers? Yes. But that doesn't change the fact that many mediocre answers never receive downvotes and in fact often receive upvotes (especially those on popular questions...).

Not downvoting mediocre answers does not discourage them. Sure, the best answers float to the top (normally). But without downvotes there is no incentive to stop posting mediocre bad answers.

Not to mention the whole host of repeated answers we get saying basically the same thing.

A thought experiment: what would happen to average answer quality on this site do if every answer which was mediocre or "meh" received downvotes?

Issue #4:

  • Without downvotes on mediocre answers, there is no incentive to stop posting them
5
  • 2
    Are the answers you're referring to up voted? I think we need an example or two. I feel like a lot of low quality posts that are NAA get removed.
    – jmort253 Mod
    Commented Jan 15, 2013 at 2:36
  • 5
    I think this post could be cut down to Without downvotes on mediocre answers, there is no incentive to stop posting them Commented Jan 17, 2013 at 19:05
  • 10
    Start by getting people to not up-vote mediocre answers. Some people will up-vote any opinion they agree with, regardless of quality as an answer. Commented Jan 24, 2013 at 15:38
  • @MonicaCellio it is worth keeping in mind that this approach might break in "artificially hot" questions: "There are just too many new visitors to keep things under local community control, and there are just too many new voters and commenters to get things going as designed..."
    – gnat
    Commented Feb 15, 2013 at 9:28
  • As an aside... Ohh how i wish "Most people cannot go to StackOverflow and contribute answers to problems outside their expertise or familiarity" would stop them from doing it anyway. Commented Feb 16, 2013 at 4:24

4 Answers 4

21

I would disagree with downvoting mediocre answers just for being mediocre.

The downvote tooltip reads "This answer was not useful", so I don't downvote unless the answer is not useful. This includes unhelpful, low quality, and incorrect answers, but does not include useful mediocre answers.

Where would SO be today if it downvoted mediocre answers and only upvoted high-quality answers? Nobody would answer the thousands of questions that get asked every day because they wouldn't want to spend the time to write an extremely high-quality answer, or face downvotes just because their answer was "mediocre".

As I said in this MSO post about a badge for having a high rep-per-answer ratio:

I disagree with this proposal as its currently phrased since I think it encourages users to only post a few excellent answers instead of many acceptable answers, which I think would be bad for the site due to the number of questions that get asked here.

If we have an "expert" participating in the site, I'd much rather have them answer as many questions as possible instead of spending their time on just a few questions.

I come to SO seeking help with a specific problem, not a tutorial. I value fast and accurate answers that solves my problem. Sure I appreciate users who take the time to explain things in detail to me, however I would much rather have a fast answer to my problem than no answer at all just because someone doesn't want to ruin their answer/rep ratio to get a badge.

In addition, badges are normally used to encourage specific behaviors, and as someone who posts a lot of quick answers here while waiting for some process or another to finish, I would feel like I'm doing something wrong by posting quick short answers instead of taking the time to write a more detailed answer.

Yes I do think we should keep educating users about the "Back it up" rule by leaving comments on answers that are not backed up by facts, references, or personal experience, however I do not think we should be downvoting mediocre answers just because they aren't "expert" quality, especially not if they actually contain useful information.

We should be reserving those for answers that are not actually useful, as the tooltip says, and letting the system work as designed, with the best answers getting voted to the top.

Also in regards to

Overall answer quality seems to have been slowly decreasing since I first got active on here

I have found the opposite. I am consistently impressed by the high quality of the some of the answers on here (many of them yours), and think what you may be noticing is more questions and answers overall as the Workplace gains more visitors.

Sure you may be seeing more mediocre or low-quality answers, but we also have more questions, more answers, and more visitors.

So I would just keep doing what you've been doing: downvoting low quality/incorrect answers, educating and guiding new users about the "Back-it-up" rule or other site guidelines in comments when you see a need for it, and voting up the great questions and answers.

9
  • 2
    what would be your take on downvote based on reasoning (...explained with comment if you wish) like this? "this answer does not appear useful because it looks that all its points are better presented in other answers to this question"
    – gnat
    Commented Jan 14, 2013 at 21:54
  • 7
    Rachel, how do you propose preventing repetition in answers, as an alternative to downvoting?
    – jmort253 Mod
    Commented Jan 14, 2013 at 22:15
  • 1
    especially not if they actually contain useful information. the problem is, that nearly ALL our questions are polls because of their subjective nature - "what do you think I should do?" - which means that we will (and do) have a whole host of answers providing one element of that poll (which might be useful) yet doing so in a way which is completely not in line with the FAQ
    – enderland
    Commented Jan 14, 2013 at 23:49
  • 3
    @enderland - "What do you think I should do?" feels sort of like a get out of jail free card for when you don't have an actual question. Sort of like the Office Politics question. To me, these definitely seem closeable. Then possibly editable.
    – jmort253 Mod
    Commented Jan 15, 2013 at 3:19
  • 8
    Where would SO be today if it downvoted mediocre answers and only upvoted high-quality answers? In a far better place than it is, SO today is one big crapfest.
    – yannis
    Commented Jan 15, 2013 at 22:30
  • 1
    @YannisRizos Sorry, I disagree. I love SO for it's fast and accurate answers :)
    – Rachel
    Commented Jan 15, 2013 at 23:34
  • 7
    @Rachel - I rarely use SO anymore because its only worthless questions that get answered. I have 2 hard questions out there with out an answer. And one that has an answer of well we don't think you can do that, despite the fact that I was able to get it working. Commented Jan 17, 2013 at 19:01
  • 1
    @Chad: Maybe you need to offer a bounty on those hard questions.
    – Jim G.
    Commented Jun 15, 2013 at 16:54
  • @Yannis: C'mon. It's not THAT bad. I rely on SO nearly every day at my job. // Besides, you'll get better results on the front page if you exclude tags that you're not interested in.
    – Jim G.
    Commented Jun 15, 2013 at 16:57
5

From the linked blog post, there are specific qualities desired in subjective answers:

The Back It Up! Principle:

  • Something that happened to you personally
  • Something you can back up with a reference

{...}

Our FAQ even specifically has this text:

Please note that answers should be backed up either with a reference, or experiences that happened to you personally. You should always include in your answer information about why you think your answer is correct.

It's true:

  1. Each answer should be backed up.
  2. You should always include in your answer information about why you think your answer is correct.

...And while many great answers do either cite a source or retell a story based on personal experience - You are not required to do so.

Logic, metaphors, and common-sense can form the backbone of a great answer.

Consider the following historical figures. They would all easily achieve Jon Skeet-like status if they participated in Workplace.SE.

  1. Jesus Christ might use parables to back up His answers.
  2. Aristotle might use logic to back up his answers.
  3. Confucius might appeal to Confucianism (as an ethical and philosophical system) to back up his answers.
  4. Benjamim Franklin might use pithy sayings packing enormous wisdom to back up his answers.

Yet none of them would be too fastidious about citing sources or retelling personal stories!

2
  • 5
    Logic is fine, but "common sense" usually isn't as common as you think (and if it is, the question probably should have been closed). The only hypothetical answerer on your list whose answers would likely be any good here is Aristotle, and only if he actually explains his logic. Commented Jun 16, 2013 at 19:56
  • @Monica Cellio: "Common Sense" usually isn't as common as you think... And that's exactly why it's so important for our experts to dispense "common sense" to the masses! meta.workplace.stackexchange.com/questions/2187/…
    – Jim G.
    Commented Nov 29, 2013 at 16:54
3

Please, no. Do not downvote too much. I can tell you couple reasons for that if you wish:

  1. It is not a fortunate form of negative criticism; it's not constructive, and it feels worse to the target person than it seems. In most cases, you don't want to lose the person, you want them to get better. For that, constructive and encouraging criticism is necessary, and that's not something a downvote can serve.

  2. SE sites that consider downvotes to be a rare thing are nice places to be at. Yes, I speak from my own experience, my "home site" is TeX, typical vote record here is 1 downvote for 100--1000 upvotes, and we are all happy: we get high quality contents, we get better answers scored higher than not so good ones etc. Atop of that, we get people willing to improve their answers, learn the policies etc. The fact that you don't want to downvote the post means, if you want to give feedback, that you have to comment on it. This improves the communication between the users. Observe that while we're not of the most busy sites, our chat room is busy almost always.

I know, there are other factors that influence the fact that TeX.SE is a relax and nice place, but still, I see that the positive air and lack of downvotes is one of them.

Conclusion: No, mediocre answers shouldn't be downvoted. Only answers giving really bad, unacceptable advice should be downvoted. Distinction between excellent, good and mediocre answers should be based on upvotes.

11
  • 1
    consider the difference between sites: TeX has a natural barrier to entry, requiring a certain level of technical competence, this organically protects it from getting too much "noisy" answers. FWIW Code Golf seems to have even higher barriers and they can afford really relaxed attitude. At Workplace, there's nothing like that, everyone believes they're qualified to answer - barrier to entry is as low as it gets. If this isn't balanced, site will degrade into "self-help group for commiserating"
    – gnat
    Commented Aug 11, 2014 at 20:54
  • @gnat I don't think that downvoting mediocre answers is a way to balance high noise. Downvotes won't give the valuable feedback, most likely the people will quit and not improve their posts. Speaking of commiserating: it seems to be yet another problem -- are you sure that downvotes provide a treatment for such posts? It's the amount of high quality traffic that makes the site good, if you have enough of it, the low quality traffic is not an issue, if you don't have enough of it, aggressive reduction of the low quality traffic won't make it better.
    – yo'
    Commented Aug 11, 2014 at 21:07
  • no problem, suggest a different way. Think of how Back It Up and Don't Repeat Others rules can be enforced (for comparison, at Code Golf that would be as easy as it gets - code that doesn't compile or fails the test certainly breaks Back It Up)
    – gnat
    Commented Aug 11, 2014 at 21:11
  • @gnat Don't repeat others -- what about a comment like: Well, your ideas seem to be covered by the JohnDoe's answer. Of course, with no upvoting. Maybe try to encourage people to delete their answers if they're found duplicated? Yes, you can community-delete them as low quality, but then you lack the realization of the OP that something wrong may have happened. As for Backing up: I dunno, I really dunno. But I know that a comment like this answers seems to lack any reference is a good thing anyways, and I don't believe that -5 score is a further improvement.
    – yo'
    Commented Aug 11, 2014 at 21:19
  • 3
    Hi @tohecz, the only problem with this suggestion is that voting is what we use to push great content to the top of the page and not-so-good content to the bottom. Without down votes, the community cannot push the lower quality stuff downwards. On a site dedicated to being a resource of knowledge, this is a critical toolset at our disposal.
    – jmort253 Mod
    Commented Aug 12, 2014 at 3:22
  • @jmort253 Well, once you have multiple answers, the most common scenario is that they differ by a good amount of votes even if no downvotes are present. So do you really need them to distinguish good and mediocre answers? I don't think so.
    – yo'
    Commented Aug 12, 2014 at 7:49
  • 1
    okay, comment, then what? remember it's not TeX nor Code Golf where readers have technical, objective measures to detect (and ignore) unworthy answers. Imagine someone answering to a question about some complicated workplace issue "Just Quit" - answer like that has a great chance to collect a couple upvotes because, because oh it feels so commiserating, so supportive. What chances does your comment have to change mind of the answerer who just has got a nice chunk of reputation - clearly indicating that their way of answering is welcome?
    – gnat
    Commented Aug 12, 2014 at 13:51
  • @gnat Sorry, but do you consider such answers as mediocre?
    – yo'
    Commented Aug 12, 2014 at 13:52
  • @tohecz definitely. It doesn't take much effort to answer "just quit"
    – gnat
    Commented Aug 12, 2014 at 14:22
  • @gnat Sorry, I wasn't clear, I meant, isn't "just quit" a bad answer in most cases? If it's not the case when the answerer clearly explains that it is a considerable option, such answer is definitely bad, not mediocre. So maybe we have quite a different sense of good-mediocre-bad, and this causes the misunderstanding?
    – yo'
    Commented Aug 12, 2014 at 14:32
  • it depends on how one serves it. Just put enough hand-waving to obscure the just-quit and answer starts looking like mediocre. Her, again, consider difference with technical sites. At Code Golf, readers can easily get to the primary substance (code) and objectively evaluate it. At Workplace, there's nothing like that
    – gnat
    Commented Aug 12, 2014 at 14:50
-8

I am against down voting if the post is already at 0. If they are in a positive score and it isn't following the guidelines of WPB then I down vote.

The reason for this is that having a negative score has negative repercussions to people who may over time make a great contribution to the community at a later point.

When you give a negative score people lose a few points, if they are already at a low level they just won't bother responding anymore. In some cases you can even cause their privileges to be revoked for something that they may seem petty.

Having a zero score on the other hand means you haven't been dismissed, but you need to improve if you want get a score.

TL;DR. I'd only down vote if the post broke the rules and it was >0 score. Otherwise I leave a comment asking them to fix the answer. I only down vote if the post is at 0 if it adds absolutely nothing to the discussion or spam.

[edit] In response to @Enderland comment below.

Let's take you for example on one of my posts.

How to convince colleagues about my point of view in a meeting?

I posted a possible answer, which if you had been dealing in that area that I often do, you would know it is a well known technique. It had been up for some time and the OP even responded to it.

Now you came along and down voted it because you were not knowledgable enough to know this. I saw the down vote long before your some what rude/informal comment as to why you down voted (clearly not intentional, but needs work).

I then added what I considered to be pointless background information to make you happy (And you removed the down vote).

Now a better response, would have just to ask for clarification or "can you clean it up so it matches our rules?"

But that I should stress this is me!

Most people would see such a thing and say "Screw this" and leave. In fact nearly every question I look at these days has been deemed closed by moderators which while need improvement, could lead to some excellent discourse. It feels less like an exchange and rather a private chat area for a handful of people.

Try looking at how SO handles such matters. Bad questions aren't just closed. They are normally asked to be corrected in comments, others more knowledgable correct the question.

15
  • 1
    "voting if the person..." as far as I can tell this is dangerously slippery, no matter if you vote up or down. Stack Exchange expects one to vote on post content but never on person
    – gnat
    Commented Jan 23, 2013 at 9:18
  • I meant the post. Apologies for the confusion, corrected. Commented Jan 23, 2013 at 9:24
  • 7
    Arrrg I could not disagree more! I want EVERY mediocre answer to receive a downvote (with a comment explaining why) first so that there is a "oh, I should fix this" incentive. I want people to feel the standard here is good answers - not mediocre/bad/meh/off topic answers. Not hitting them with a DV initially supports the opposite.
    – enderland
    Commented Jan 23, 2013 at 15:08
  • Updated my post above. Do we down vote now when we disagree with someone? Is that how it works here? Commented Jan 23, 2013 at 15:43
  • 3
    Yah - meta is a bit different. Up/Downvotes here are more "agree/disagree"
    – enderland
    Commented Jan 23, 2013 at 15:46
  • Now a better response, would have just to ask for clarification or "can you clean it up so it matches our rules?" I'm not sure how that is different than my comment here
    – enderland
    Commented Jan 23, 2013 at 15:48
  • @enderland. It's different because a comment is flagged to the user and they can act on it. A down vote on the other hand penalises the person who is posting (lowers score, can disable privileges). It isn't a big deal if you have been around a while, but for new users it can illicit a negative response. Commented Jan 23, 2013 at 15:50
  • 1
    This is why I said with a comment explaining why - I rarely DV stuff without comments - except in "obvious" cases - and I almost always remove the DV when people address my comments (as in the case of the linked answer you added).
    – enderland
    Commented Jan 23, 2013 at 15:53
  • let us continue this discussion in chat
    – enderland
    Commented Jan 23, 2013 at 15:55
  • Right. So for a new user it comes across "I am punishing you unless you listen to me". Where as just the comment on it's own would illicit a more positive response. I'd say if you still want to DV, then do the comment first then wait a day before the DV. Commented Jan 23, 2013 at 15:56
  • In my experience so far nearly 100% of people have modified answers when there is a DV/comment and nearly no one modifies them if it's just a comment (and I've done this a TON :P)
    – enderland
    Commented Jan 23, 2013 at 15:58
  • 4
    Bad questions aren't just closed. SO totally does just close some, and they're often deleted to boot. Things should be improved to be sure, but downvotes indicating "this could be better" are a big part of driving the improvement
    – Zelda
    Commented Jan 23, 2013 at 17:30
  • 1
    The irony of the amount of downvotes on this is bittersweet. Though i agree to some extent that what votes are to be used for isnt really defined anywhere and people go about it each in their own way
    – user5305
    Commented Jan 25, 2013 at 16:35
  • 2
    The FAQ on Meta WPB says that down votes mean you disagee, it isn't used here that it would be on WPB. And while myself and enderland disagree on actions, we agree on the reasons of the intent (to improve discussion). Commented Jan 25, 2013 at 19:08
  • 2
    I've been thinking about this some and am unsure if I am quite as opposed, now. There is definitely something about the "new to a SE and then get downvoted" feeling of annoyance.
    – enderland
    Commented Jun 16, 2013 at 2:22

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .