The Long Tail and expertise
I attended an interesting talk last night by David Eaves, expert on social media and government (Government 2.0).
In general I thought he made some excellent points, but I wanted to push back on the long tail portion of his presentation. His point was that the old model positioned the government official as the only source of knowledge on a topic. His example was health policy and Health Canada. The individual bureaucrat knows a lot (head of the power-law curve), but that knowledge is at best equal to the remainder of the curve. In other words, collectively Canadians know as much as the expert does.
I’m not so sure. I think there are two reasons. One is immediacy and contextual knowledge, the other is tied to expertise.
Firstly, as David himself acknowledges, it’s one thing to have that knowledge distributed among Canadians. But it is another thing to make that knowledge accessible. And if the knowledge isn’t available when needed, then it might as well not exist. Admittedly, this can be improved with cognitive support tools like wikis.
My bigger problem is the dismissal of expertise. I’ll reference Malcolm Gladwell’s book Outliers, in which he mentions the popular notion that to be good at something requires 10,000 hours of practice. More importantly, 10,000 people with 1 hour of practice does not equal 1 person with 10,000 hours of practice. But the former is exactly what crowd-sourcing suggests we do.
For some problems, I agree, you don’t need that much expertise. So we can get by asking the retired fisherman what he thinks of the weather recently, or the person who worked on NAFTA what a EU-Canada free trade deal should be. But for most problems, I don’t see expertise as additive.
With the climate change issue, I think it is clear that a majority of people hold opinions which are at odds with the best understanding we have of the issue. So I also don’t think the Long Tail is continuous. It is entirely possible that the experts know the reality, while the ‘great unwashed’ are hoodwinked by ad campaigns, incompetent reporting, or poor communication from the experts. The flip side is also possible, of course – that the experts are horribly uninformed (although not in the case of climate science!).
I also am unconvinced by the Mozilla example. Popular models of open-source software development frequently mention the bazaar approach, and I’m sure this is what David means. But studies on large-scale open-source software (Eclipse, Linux, Apache) show that often most progress is made by the 10-12 people at the heart of the project. My own research bears this out. There is a lot of irrelevant and distracting noise for these projects.
Tangentially, I’m not a believer in the “Given enough eyeballs, all bugs are shallow” mantra, either. First of all, because it is a maxim, and not at all tested empirically. More importantly, it depends on what kind of eyeballs, doesn’t it? Most users of Firefox, for example, have no expertise in diagnosing errors in Javascript, let alone C++ internals. Their bug reports tend to be on the most obvious bugs. It takes experts to find the source of the more obscure (more important?) bugs.
David also illustrated his point about crowd-sourcing by mentioning the alternative to the space shuttle, DIRECT. His point was that these people were able to design a large spacecraft without any institutional assistance. Totally agree about the design, but two points. One, these people were most certainly experts. In fact, they were all NASA employees. Secondly, there is a vast difference between building the spacecraft and designing it. Spacecraft take millions, if not billions, of dollars to build. That tools have reduced the cost for entry into the design phase does not make it any cheaper to produce. I still see that as a public good which no company has incentive to assume.
This all sounds a bit cynical, but I do agree with David that there is a lot of expertise that ought to be leveraged (by government) that isn’t. And I think he is right to focus (at least at first) on improving government’s internal knowledge management processes.
I think you have to believe in intellectual equality in order to buy David’s argument. This is also making a lot of assumptions about rationality. Given that 60% of the adult population has problems with formal reasoning I’m not sure I can care that much about that long tail, if 60% could be bunk. Look at politics, look at the US. In the southern US you had 80% of white males agree on something. Is this the long tail? Collective intelligence has reared its head in markets, especially mortages and real estate. It didn’t work out either. I remain highly skeptical of this version of “long tail” intelligence.
Anonymous
2010 January 15 at 11:05