Clustering illusion

From Infogalactic: the planetary knowledge core
Jump to: navigation, search
Up to 10,000 points randomly distributed inside a square with apparent "clumps" or clusters

The clustering illusion is the tendency to erroneously consider the inevitable "streaks" or "clusters" arising in small samples from random distributions to be non-random. The illusion is caused by a human tendency to underpredict the amount of variability likely to appear in a small sample of random or semi-random data.[1]

Examples

Thomas Gilovich, an early author on the subject, argued that the effect occurs for different types of random dispersions, including two-dimensional data such as clusters in the locations of impact of World War II V-1 flying bombs on maps of London; or seeing patterns in stock market price fluctuations over time.[1][2] Although Londoners developed specific theories about the pattern of impacts within London, a statistical analysis by R. D. Clarke originally published in 1946 showed that the impacts of V-2 rockets on London were a close fit to a random distribution.[3][4][5][6][7]

The clustering illusion is central to the "hot hand fallacy", the first study of which was reported by Gilovich, Robert Vallone and Amos Tversky. They found that the idea that basketball players shoot successfully in "streaks", sometimes referred to by sportcasters as having a "hot hand" and widely believed by Gilovich et al.'s subjects, was false. In the data they collected, if anything the success of a previous throw very slightly predicted a subsequent miss rather than another success.[8]

Similar biases

Using this cognitive bias in causal reasoning may result in the Texas sharpshooter fallacy. More general forms of erroneous pattern recognition are pareidolia and apophenia. Related biases are the illusion of control which the clustering illusion could contribute to, and insensitivity to sample size in which people don't expect greater variation in smaller samples. A different cognitive bias involving misunderstanding of chance streams is the gambler's fallacy.

Possible causes

Daniel Kahneman and Amos Tversky explained this kind of misprediction as being caused by the representativeness heuristic[2] (which itself they also first proposed).

See also

References

  1. 1.0 1.1 Lua error in package.lua at line 80: module 'strict' not found.
  2. 2.0 2.1 Lua error in package.lua at line 80: module 'strict' not found.
  3. Lua error in package.lua at line 80: module 'strict' not found.
  4. Gilovich, 1991 p. 19
  5. Lua error in package.lua at line 80: module 'strict' not found.
  6. Lua error in package.lua at line 80: module 'strict' not found.
  7. Lua error in package.lua at line 80: module 'strict' not found.
  8. Lua error in package.lua at line 80: module 'strict' not found.

External links