How has the American identity developed amidst such a diversity of conflicting ideas and beliefs?  And, how has the clash of differing opinions contributed to strength?

The idea that unity is strengthened by diversity may at first sound counter-intuitive, but it is measurable and irrefutable.

In his book, The Wisdom of Crowds, James Surowiecki describes compelling evidence that large groups of people possess an extraordinary power to solve problems when their judgment is aggregated, and that the more diverse the crowd, the more efficient the solutions.

Citing a variety of examples Surowiecki presents a fascinating description of the conditions in which democratic decision-making does and does not work.

In his introduction to the book we hear of the surprise of scientist Francis Galton when 787 participants in a raffle at a county fair submitted guesses at what the weight of a large ox would be after it had been slaughtered and dressed.

“The analogy to a democracy, in which people of radically different abilities and interests each get one vote, had suggested itself to Galton immediately. ‘The average competitor was probably as well fitted for making a just estimate of the dressed weight of an ox, as an average voter is of judging the merits of most political issues on which he votes,’ he wrote.”

Galton, who expected to confirm his view that “the average voter” was capable of very little good judgment, borrowed the tickets from the organizers following the competition. He then ran a series of statistical tests on them.  Adding all the contestants’ estimates, he calculated the average.

The crowd had guessed that the ox, after it had been slaughtered and dressed, would weigh 1,197 pounds. In fact, it weighed 1,198 pounds.

Another example described by Surowiecki is the story of the 1968 loss of the United States submarine Scorpion, which disappeared in the Atlantic Ocean. The Navy had no idea what happened to the vessel, where it was or how fast it had been traveling.

Mr. Surowiecki recounts the story as told by Sherry Sontag and Christopher Drew in their book Blind Man’s Bluff, about how a naval officer named John Craven assembled a diverse group of people – mathematicians, submarine specialists, and salvage men – provided them with a number of varied scenarios, and asked them to offer their best guesses without benefit of contact with each other. All they knew was the sub’s last reported location.

The group laid wagers on why the submarine ran into trouble, on its speed as it headed for the ocean floor and the steepness of descent, among other things.

Craven built a composite picture of what happened and calculated the group’s collective estimate of where the submarine was. The location he came up with was not a location specifically suggested by any members of the group. But, that is where it was.

The Navy found the wreck 220 yards from where Craven’s group said it would be.

Mr. Surowiecki proceeds to demonstrate the surprising consistency of this outcome in widely varied circumstances. And, he explains how groups work well in some circumstances better than others.

As we all know, there are times when aggregating individual judgments produces a collective decision that is disastrous; a riot, for example, or a stock market bubble.

Interestingly, he writes: “Diversity and independence are important because the best collective decisions are the product of disagreement and contest, not consensus or compromise.

“An intelligent group, especially when confronted with cognition problems, does not ask its members to modify their positions in order to let the group reach a decision everyone can be happy with.  Instead, it figures out how to use mechanisms – like market prices, or intelligent voting systems – to aggregate and produce collective judgments that represent not what any one person in the group thinks but rather, in some sense, what they all think.

“Paradoxically, the best way for a group to be smart is for each person in it to think and act as independently as possible.”

Later in the present project, we will look at practical methods by which groups with diverse viewpoints can engage in creative problem-solving and decision-making in a manner that goes beyond consensus, even when face-to-face, to reach unexpected and mutually satisfying outcomes.

Tom

In two weeks: The challenge we must rise to.