The question of inequality and unfairness has come up again, from Seth’s Gatekeepers posts and subsequent conversation, to pointers to Clive Thompson’s A-Listers article in New York magazine, which article discusses the themes from Powerlaws, Weblogs, and Inequality (though without mentioning that essay or noting that the original powerlaw work was done in 2003.)
The most interesting thing I’ve read on the subject was in Doc Searls post:
I’ve always thought the most important thesis in Cluetrain was not the first, but the seventh: Hyperlinks subvert hierarchies.
What I’ve tried to say, in my posts responding to Tristan’s, Scott’s and others making the same point, is nothing more than what David Weinberger said in those three words.
I thought I was giving subversion advice in the post that so offended Seth. But maybe I was wrong. Maybe being widely perceived as a high brick in the blogosphere’s pyramid gives my words an unavoidable hauteur — even if I’m busy insisting that all the ‘sphere’s pyramids are just dunes moving across wide open spaces.
[…]
I’ll just add that, if ya’ll want to subvert some hierarchies, including the one you see me in now, I’d like to help.
The interesting thing to me here is the tension between two facts: a) Doc is smart and b) that line of thinking is unsupportable, even in theory. The thing he wants to do — subvert the hierarchy of the weblog world as reflected in lists ranked by popularity — is simply impossible to do as a participant.
Part of the problem here is language. Hierarchy has multiple definitions; the sort of hierarchy-subverting that networks do well is routing around or upending nested structures, whether org charts or ontologies. This is the Cluetrain idea that hyperlinks subvert hierarchies.
The list of weblogs ranked by poularity is not a hierarchy in that sense, however. It is instead a ranking by status. The difference is critical, since what’s being measured when we measure links or traffic is not structure but judgment. When I’m not the CEO, I’m not the CEO because there’s an org chart, and I’m not at the top of it. There is an actual structure holding the hierarchy in place; if you want to change the hierarchy, you change the structure.
When I’m not the #1 blogger, however, there are no such structural forces making that so. Ranking systems don’t work that way; they are just lists ordered by some measured characteristic. To say you want to subvert that sort of hierarchy makes little sense, because there are only two sorts of attack: you can say that what’s being measured isn’t important (and if it isn’t, why try to subvert it in the first place?), or you can claim that lists are irrelevant (which is tough if the list is measuring something real and valuable.)
Lists are different from org charts. The way to subvert a list is to opt out; were Doc to stop writing, he would cede his place in the rankings to others. At the other extreme, for him to continue to champion the good over the mediocre, as he sees it, sharpens the very hierarchy he wants to subvert. Huis clos.
The basic truth of such ranking systems is unchanged: for you to win, someone else must lose, because rank is a differential. Furthermore, in this particular system, the larger the blogsphere grows, the greater the inequality will be between being the most- and median-trafficked weblog.
All of that is the same as it was in 2003. The power law is always there, any time anyone wants to worry about it. Why the worrying happens in spasms instead of steadily is one of the mysteries of the weblog world.
The only things that are different in 2006 are the rise of groups and of commercial interests. Of the top 10 Technorati-measured blogs, (Disclosure: I am an advisor to Technorati), all but one of them are either run by more than one poster, or generate revenue from ads or subscriptions. (The exception is PostSecret, whose revenue comes from book sales, not directly from running the site.) Four of the top five and five of the ten are both group and commercial efforts — BoingBoing, Engadget, Kos, Huffington Post, and Gizmodo.
Groups have wider inputs and outputs than individuals — the staff of BoingBoing or Engadget can review more potential material, from a wider range of possibilities, and post more frequently, than can any individual. Indeed, the only two of those ten blogs operating in the classic “Individual Outlet” mode are at #9 and 10 — Michelle Malkin and Glenn Reynolds, respectively.
And blogs with business models create financial incentives to maximize audience size, both because that increases potential subscriber and advertisee pools, but also because a high ranking is attractive to advertisers even outside per capita calculations of dollars per thousand viewers.
(As an aside, there’s a pair of interesting technical questions here: First, how big is the A-list ad-rate premium over pure per-capita calculations? Second, if such a premium exists, is it simply a left-over bias from broadcast media, or does popularity actually create measurable value over mere audience count for the advertiser? Only someone with access to ad rate cards from a large sample could answer those questions, however.)
In his post Shirky’s Law, Hugh Macleod quotes me saying:
Once a power law distribution exists, it can take on a certain amount of homeostasis, the tendency of a system to retain its form even against external pressures. Is the weblog world such a system? Are there people who are as talented or deserving as the current stars, but who are not getting anything like the traffic? Doubtless. Will this problem get worse in the future? Yes.
I still think that analysis is correct. From the perspective of 2003, it’s the future already, and attaining the upper reaches of traffic, for even very committed bloggers, is much harder. That trend will continue. In February of 2009, I expect far more than the Top 10 to be dominated by professional, group efforts. The most popular blogs are no longer quirky or idiosyncratic individual voices; hard work by committed groups beats individuals working in their spare time for generating and keeping an audience.
1. Joshua Porter on February 15, 2006 11:13 AM writes...
I'm a little confused about your usage of the word "structure", because I would argue that the linkages with which the Search engines assign rank is a definite structure.
In other words, I'm not on the A-list because everyone there has more inbound links than me...or whatever it is the algorithm perceives as modeling value. If I want to change that, I have to change the judgment of others, which will in turn cause them to link to me, thus changing the structure...
However, I still see a distinction in what you say. Links are about judgment. But what is judgment if not some sort of social structure? If a lot of people judge something good, it will be popular...and the social structure is in place to support that.
I see this as why change happens so slowly. If there was no social structure, popularity would change with the wind. But as you point out, it doesn't change with the wind as seen in the Power Law. Perhaps that is what the Power Law models...social structure. Britney Spears will be popular for a long time, even if she doesn't put out any more CDs because there is some structure holding her in place.
So, in my view social structure(judgment) leads to digital structure(links)...and what Google did was to recognize that. The big problem now is to find the structure, wherever it exists digitally. And the best software models the structure best: in the form of links, buddies, ratings, etc.
This is a very naturalistic point of view. See what exists in the world, and go try to model it.
Permalink to Comment2. Dan Phiffer on February 16, 2006 9:36 PM writes...
I, for one, find ranking lists pretty irrelevant. In the extreme, if they *exlusively* defined my choice of content (e.g. television), I'd probably shut my laptop and go find something better to do. Are these lists not "measuring something real and valuable?" Not for me--they're measuring popularity, not depth/quality/consistency/clarity. Surely popular websites shouldn't be discounted as lacking these measures by virtue of being popular, but the structures they sit atop aren't essential to how I spend my attention.
Permalink to Comment3. Clay Shirky on February 16, 2006 11:10 PM writes...
But Dan, the question isn't whether any one person does or doesn't find them valuable -- the question is whether enough people find them valuable to make them valuable. (And recursion is the new recursion.) Aggregators and filters that produce ranked lists generate huge amounts of traffic on their own. (c.f. the Digg Effect.) So the issue here isn't about getting any one user's attention in particular so much as it's about getting attention in general.
Collaborative filtering of all sorts, whether link ranking or anything else, is a key technique for focusing people's attention right now, which gives ranked lists a positive feedback loop that is quite valuable to the site owners, no matter what individual users do or don't do with those lists.
Permalink to Comment4. Dan Phiffer on February 17, 2006 11:36 PM writes...
Yeah, I understand that the structure you're describing is self-perpetuating in many ways, but I just don't think the "market" necessarily optimizes for "value." Maybe I'm just reading that word, value, differently than I should.
One thing that is common to the group blogs, and most of the big A-listers, is their high volume. Stacking the archives for Googlebot only works as long as PageRank is the best way to find things. Digg, to me, is a noisy crowded restaurant where everyone is too busy--going table to table, shaking hands, exchanging cards--to actually try the food.
My feeling is that as web users at large acquire better tools (intellectual and software), the powerlaw curve will tend more toward looking like a line. Not that the curviness will disappear, but that being an A-lister might not be nearly as meaningful as we learn how to find the *right* signals in the noise.
Permalink to Comment5. maria zuppello on February 20, 2006 12:47 AM writes...
Hi, my name is maria Zuppello and I'm the first Italian reporter getting alone, with a small digital camera, without a crew to Antarctica.
Permalink to CommentI'm writing from New York where I'm working on a documentary about bioweapons with Danny Schechter. Former CNN and CBS producer Danny won 2 Emmy Awards and he's famous all around the world to be "the news dissector": every day he criticizes the American Media System.
I have been creating a blog about my experience with him
htttp://videojournalist.blogs.it
and he still has his own blog
www.mediachannel.org
You can write in Italian as well as in English
Keep in touch!
Maria
6. Sorin Adam Matei on February 26, 2006 1:04 PM writes...
The very success of the top dogs can contain the seeds of the system's ultimate decline and demise (until it will be born again, as something else).
http://www.matei.org/ithink/2006/02/26/the-end-of-blogging/
Permalink to Comment7. Rocco Windham on November 1, 2006 7:57 AM writes...
oapq
Permalink to Comment