I must admit that my reviews didn't go fast. The instructions tell us to take a different approach to reviewing the posts. Unlike other review queues, the instructions tell us to focus on how a non-Workplace SE user may view our site by forcing us to go check out the competition and do Google searches, as if we were the person looking for the answers and evaluating content in different search results to determine which resource may be most helpful.
I don't think it's fair to say reviewers are being lazy or not taking their time, but I do think it's possible that maybe some folks have misinterpreted the point of this exercise. This isn't a normal, everyday review queue, and the approach to these reviews is quite different:
Run comparative Google searches on these questions and see if the content is better or worse than what is already out there on the internet. Are the answers correct, clear, useful and informative? Would the question and answer be interesting to the kind of user this site is trying to attract? Choose:
- Excellent if this question is well-written and has a clear, comprehensive answer that is far better than other available resources. This question shows up early in search results.
- Satisfactory if this question has a clear, comprehensive answer that is comparable or better than the information found elsewhere. This question shows up later in the search results or requires oddly specific search terms to find.
- Needs Improvement if this question is poorly written, not generally useful, or has an answer that is no better than what can be found elsewhere. Alternatively, this question does not turn up on the first page or two in Google despite repeated search attempts.
- Skip if you are not sure and want to go to the next question
Based on these instructions, I found that I gave a Satisfactory or Needs Improvement rating to questions that I previously thought were pretty awesome and that I had upvoted! I found that what I perceived as really awesome posts didn't show up in search results and were buried on the third page, or the posts were on the front page of Google but weren't as good as other material out there.
The challenge as I see it is that the really useful information is sort of in the long tail. It's useful, but perhaps a bit harder to find. Maybe this is a problem, but maybe it isn't. After all, someone who has a specific problem will likely tailor their search keywords until they find what they're looking for. I know that when I have a problem, and I do a search, and the generic answer just doesn't cut it, I keep searching until my keywords lead me to the same or a similar problem as what I'm facing.