A good First Monday piece by Hassan Masum and Yi–Cheng Zhang called Manifesto for the Reputation Society , which avoids most of the “I know! Let’s call reputation a number, then work with the numbers!” problems common to such work.
eBay did us a huge disservice by making reputation look simple. eBay hosts millions of one-time, numerically expressible, single-variable transactions (“How much money for how many Beanie Babies?”), among distributed actors in non-iterated communication. This makes it a game theorists wet dream, but a bad proxy for reputation systems generally. Massum and Zhang recognize this, and examine many other reputation systems as well — Slashdot, Amazon, even Google’s PageRank algorithm — making this the best “Start reading here” paper for reputation I’ve found.
You may mentally assign a friend a bad reputation for being on time or returning borrowed items promptly, while still thinking them reliable for helping out in case of real need. No person can be reduced to a single measure of “quality.”
So people will have different reputations for different contexts. But even for the same context, people will often have different reputations as assessed by different judges. None of us is omniscient — we all bring our various weaknesses, tastes, bias, and lack of insight to bear when rating each other. And people and organizations often have hidden agendas, leading to consciously distorted opinions.
Reputations are rarely formed in isolation — we influence each others’ opinions. Studying the structure of social connectivity promises to reveal insights about how we interact, and thinking about simple quantities like the average number of sources consulted before an opinion is formed will help us to better filter these opinions.
Are reputations only for people? No, their scope is far wider:
- They can be for groups of people: companies, media sources, non–governmental organizations, fraternities, political movements.
- They are often used for inanimate objects: books, movies, music, academic papers, consumer products. Typically, whenever we talk about the “quality” of an object with some degree of subjectivity, we can also speak of its reputation, usually as assessed by multiple users — bestseller lists are a simple example.
- Finally, ideas can have reputations. Belief systems, theories, political ideas, and policy proposals are the bedrock of public discussion. The waxing and waning of idea–reputations directly affects their likelihood of implementation, and thus the environment that we all share.
It’s curious that they called it a manifesto, since its long on description and short on prescription, but it’s better for not being one.
They also point to Masum’s earlier First Monday piece on a distributed reputation layer called TOOL (which, unlike the Manifesto, suffers from some of the same problems as RELATIONSHIP markup, I think). They also point to the Reputations Research Network , and to last year’s MIT/NSF Symposium on Reputation Systems as places to find other work in the field.
1. Tim Keller on July 19, 2004 5:04 PM writes...
Yes, reputation services & YASNSs suffer from schizophrenia or autism. But finding that out by building them & testing them is a necessary step in the process of understanding & harnessing the power of social networks & collective intelligence. Should we wait around & not build any new type of social software system until we can prove that it's accurate, complete & models all aspects of its real-world analog without fail?
Let's get down-&-dirty with it. Let's try to build new systems, then take them apart & see where they failed so we can build the next one better.
Tim
Permalink to Comment2. Jan on July 19, 2004 5:17 PM writes...
Another useful reference (which they don't cite, however) is the First Monday essay on the Augmented Network, which has some ideas on reputation systems and interoperability between systems and sites.
Permalink to Comment3. Dave Evans on July 20, 2004 10:42 AM writes...
Reputation management alone is not the best solution. I saw the Verified Person presentation recently and Trufina looks promising as well. One of them will add reputation management to their offering, and I bet they will do quite well, especially in the online dating space, where this type of feature is desperately needed.
Permalink to Comment