Monday, November 22, 2010

THE DUNNING -KRUGER EFFECT

Dunning–Kruger effect
From Wikipedia, the free encyclopedia


The Dunning–Kruger effect is a cognitive bias in which an unskilled person makes poor decisions and reaches erroneous conclusions, but their incompetence denies them the metacognitive ability to realize their mistakes. The unskilled therefore suffer from illusory superiority, rating their own ability as above average, much higher than it actually is, while the highly skilled underrate their abilities, suffering from illusory inferiority. This leads to the situation in which less competent people rate their own ability higher than more competent people. It also explains why actual competence may weaken self-confidence: because competent individuals falsely assume that others have an equivalent understanding. "Thus, the miscalibration of the incompetent stems from an error about the self, whereas the miscalibration of the highly competent stems from an error about others."

The Dunning–Kruger effect was put forward by Justin Kruger and David Dunning. Similar notions have been expressed – albeit less scientifically – for some time. Dunning and Kruger themselves quote Charles Darwin ("Ignorance more frequently begets confidence than does knowledge")and Bertrand Russell ("One of the painful things about our time is that those who feel certainty are stupid, and those with any imagination and understanding are filled with doubt and indecision."). W.B. Yeats put it concisely thus: "The best lack all conviction, while the worst / Are full of passionate intensity." The Dunning–Kruger effect is not, however, concerned narrowly with high-order cognitive skills (much less their application in the political realm during a particular era, which is what Russell was talking about.) Nor is it specifically limited to the observation that ignorance of a topic is conducive to overconfident assertions about it, which is what Darwin was saying. Indeed, Dunning et al. cite a study saying that 94% of college professors rank their work as "above average" (relative to their peers), to underscore that the highly intelligent and informed are hardly exempt. Rather, the effect is about paradoxical defects in perception of skill, in oneself and others, regardless of the particular skill and its intellectual demands, whether it is chess, playing golf or driving a car.


Hypothesis

The hypothesized phenomenon was tested in a series of experiments performed by Justin Kruger and David Dunning, then both of Cornell University. Kruger and Dunning noted earlier studies suggesting that ignorance of standards of performance is behind a great deal of incompetence. This pattern was seen in studies of skills as diverse as reading comprehension, operating a motor vehicle, and playing chess or tennis.

Kruger and Dunning proposed that, for a given skill, incompetent people will:

1. tend to overestimate their own level of skill;
2. fail to recognize genuine skill in others;
3. fail to recognize the extremity of their inadequacy;
4. recognize and acknowledge their own previous lack of skill, if they can be trained to substantially improve.

Dunning has since drawn an analogy ("the anosognosia of everyday life") to a condition in which a person who suffers a physical disability because of brain injury seems unaware of or denies the existence of the disability, even for dramatic impairments such as blindness or paralysis.

Supporting studies

Kruger and Dunning set out to test these hypotheses on human subjects consisting of Cornell undergraduates who were registered in various psychology courses. In a series of studies, they examined self-assessment of logical reasoning skills, grammatical skills, and humor. After being shown their test scores, the subjects were again asked to estimate their own rank, whereupon the competent group accurately estimated their rank, while the incompetent group still overestimated their own rank. As Dunning and Kruger noted,

Across four studies, the authors found that participants scoring in the bottom quartile on tests of humor, grammar, and logic grossly overestimated their test performance and ability. Although test scores put them in the 12th percentile, they estimated themselves to be in the 62nd.

Meanwhile, people with true knowledge tended to underestimate their relative competence. Roughly, participants who found tasks to be relatively easy erroneously assumed, to some extent, that the tasks must also be easy for others.

A follow-up study, reported in the same paper, suggests that grossly incompetent students improve their ability to estimate their rank after minimal tutoring in the skills they had previously lacked—regardless of the negligible improvement in actual skills.

In 2003 Dunning and Joyce Ehrlinger, also of Cornell University, published a study that detailed a shift in people's views of themselves influenced by external cues. Participants in the study (Cornell University undergraduates) were given tests of their knowledge of geography, some intended to positively affect their self-views, some intended to affect them negatively. They were then asked to rate their performance, and those given the positive tests reported significantly better performance than those given the negative.

Daniel Ames and Lara Kammrath extended this work to sensitivity to others, and the subjects' perception of how sensitive they were. Other research has suggested that the effect is not so obvious and may be due to noise and bias levels.

Dunning, Kruger, and coauthors' latest paper on this subject comes to qualitatively similar conclusions to their original work, after making some attempt to test alternative explanations. They conclude that the root cause is that, in contrast to high performers, "poor performers do not learn from feedback suggesting a need to improve."

Cross-cultural variation

Studies on the Dunning–Kruger effect tend to focus on American test subjects. Similar studies on European subjects show marked muting of the effect; studies on some East Asian subjects suggest that something like the opposite of the Dunning–Kruger effect operates on self-assessment and motivation to improve:

Regardless of how pervasive the phenomenon is, it is clear from Dunning's and others' work that many Americans, at least sometimes and under some conditions, have a tendency to inflate their worth. It is interesting, therefore, to see the phenomenon's mirror opposite in another culture. In research comparing North American and East Asian self-assessments, Heine of the University of British Columbia finds that East Asians tend to underestimate their abilities, with an aim toward improving the self and getting along with others.

Popular views

Although the Dunning–Kruger effect addresses erroneous perceptions of skill in general, not intelligence (and the lack thereof) in particular, casual commentary on it tends to dwell on that particular axis.

Dunning and Kruger were awarded the Ig Nobel Prizes in Psychology in 2000 for their report, "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments".



No comments:

Post a Comment