Wednesday, January 26, 2011

Yale Students Outsmarted By a Rat

A rat was put in a T-shaped maze with a few morsels of food placed on either the far right or left side of the enclosure. The placement of the food is randomly determined, but the dice is rigged: over the long run, the food was placed on the left side sixty per cent of the time. How did the rat respond? It quickly realized that the left side was more rewarding. As a result, it always went to the left, which resulted in a sixty percent success rate. The rat didn't strive for perfection. It didn't search for a Unified Theory of the T-shaped maze, or try to decipher the disorder. Instead, it accepted the inherent uncertainty of the reward and learned to settle for the best possible alternative.

The experiment was then repeated with Yale undergraduates. Unlike the rat, their swollen brains stubbornly searched for the elusive pattern that determined the placement of the reward. They made predictions and then tried to learn from their prediction errors. The problem was that there was nothing to predict: the randomness was real. Because the students refused to settle for a 60 percent success rate, they ended up with a 52 percent success rate. Although most of the students were convinced they were making progress towards identifying the underlying algorithm, they were actually being outsmarted by a rat.

The danger of random processes-things like slot machines and basketball shots-is that they take advantage of a defect built into the emotional brain. Dopamine neurons get such a visceral thrill from watching a hot player sink another jumper or from winning a little change from a one-armed bandit or from correctly guessing the placement of a food morsel that our brains completely misinterpret what's actually going on. We trust our feelings and perceive patterns, but the patterns don't actually exist.

John Lehrer
How We Decide