I have noted that the vote mechanism assign the same score for one vote up/down independently by the user score. In my opinion this is not fairly as high scored users has a deeper understanding of the subject discussed. I think that a better way would be assign a score by this formula

vote up/down = +/- int(log(user score))

what do you think?

share
5  
Re: "as high scored users has a deeper understanding of the subject discussed" - that certainly isn't true. If Brad Efron joined our site tomorrow, his reputation would be '1'. Does that mean you or I have a deeper understanding of the bootstrap than he does? –  Macro Jul 3 '12 at 12:22
    
yes i know, but this is a temporary situation. In the long time my statement is true. Is the same problem of entry level elo ranking in chess. –  emanuele Jul 3 '12 at 12:25
2  
ELO is based on a model of competition. It is difficult to see how that could be adapted to voting or a collaborative reputation system, which is what this site is based on. –  whuber Jul 3 '12 at 13:13
1  
Yes you right, indeed i am talking about the entry level ranking problem. I am not saying that Elo ranking would be a better method to rank the vote. –  emanuele Jul 3 '12 at 14:23
add comment

2 Answers 2

up vote 14 down vote accepted

The proposal is intuitive and appealing. It appears predicated, though, on the implicit assumption that high-rep people provide better information than low-rep people about the quality of questions and answers. This appears derived from equating reputation with knowledge, capability, or capacity for judgment. That equation is debatable.

(On our site there are users with enough reputation through sheer activity alone to have earned tag badges in subjects where they are not very knowledgeable. I will, with some diffidence, hold myself out as example number one: purely because many questions are tagged with , I earned a tag badge for before knowing enough about that software to even offer an R-based answer to any question! On the face of it, then, my votes on R-tagged questions and answers ought to count less, not more, than those of experienced R programmers.)

A deeper concern I have is that differential voting power could create an insular clique of high-rep people who effectively control the scores of questions and answers. I worry that this could narrow the site to reflect only the interests of its most active users.

When proposing significant changes to how this site works, we should always ask ourselves, what higher purpose would the change achieve? In this case, would we attract or retain more users? Probably not. Attract high-quality users? On the contrary, such people might be put off by having relatively little influence despite attaining demonstrably high levels of expertise. Improve the ratings of questions and answers? Perhaps--although that depends on assuming reputation (which measures activity) reflects the capacity to judge quality, as I discussed in the opening paragraph.

An interesting way to pursue the original idea would be to implement an alternative reputation/score measure in parallel with the existing one. At first this could be done invisibly and experimentally (by making the measure visible only to a few experimenters). If at some point evidence arose that the alternative were beneficial, then the alternative scores could be displayed to the world.

share
4  
+1 For "I worry that this could narrow the site to reflect only the interests of its most active users". –  user10525 Jul 3 '12 at 16:02
add comment

It is natural to apply such a weighting and I like the idea, but consider the challenge that the reputation a user has earned is bound to the tags of the answered questions. This can be included into the score model by setting the weight of a user vote to 0 if no reputation has been earned in this tag and normalization per tag otherwise, but what shall be done in case of rare tags ?

What shall be done if a question has multiple tags and the user has not earned (enough) reputation in all of these ?

In summary, such a change, although appealing and certainly more correct, might introduce more problems than it does solve (occam's razor).

Another solution could be to drive more responsible users to this site. If every question get the attention it deserves it is not necessary anymore to apply weighting to improve the meaning of answers with a small number of votes.

share
    
I am not sure that this is a true problem. Indeed reputation is a sort average over the tags score. Another solution may a wider ladder on voting system. eg: very bad, bad, neutral, good, very good –  emanuele Jul 3 '12 at 14:25
6  
"although appealing and certainly more correct" - the bolded part just isn't true. This is putting complete faith in numerical reputation. See meta.stats.stackexchange.com/questions/1218/… - for a discussion of how numerical reputation is not always a great measure of quality. If all you want to do is get a ton of points, that's not so difficult. Just answer as many questions as possible. As long as your answers aren't complete nonsense, you will have lots of rep in no time, even if you receive more downvotes than upvotes. –  Macro Jul 3 '12 at 14:50
    
thanks @Macro for the comment. I see the point. However, any system which relies solely on the numerical rep points has this problem, may it be the current one or the suggestion of the OP. My point was to make it less broken by extension (as gung suggests in the linked question). Thanks again for the comment. –  steffen Jul 3 '12 at 21:17
add comment

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .