Friday, April 15, 2011

What Happens Once the Test is Over

A study by the University of Michigan Law School found that LSAT scores bore virtually no relationship to career success as measured by levels of income, life satisfaction or public service. Even the NFL Combine is a big waste of time. According to a recent study by economists at the University of Louisville, there’s no “consistent statistical relationship” between the results of players at the Combine and subsequent NFL performance.

The reason maximal measures are such bad predictors is rooted in what these tests don’t measure. It turns out that many of the most important factors for life success are character traits, such as grit and self-control, and these can’t be measured quickly.

The problem, of course, is that students don’t reveal their levels of grit while taking a brief test. Grit can only be assessed by tracking typical performance for an extended period. Do people persevere, even in the face of difficulty? How do they act when no one else is watching? Such traits often matter more than raw talent. We hear about them in letters of recommendation, but hard numbers take priority.

The larger lesson is that we’ve built our society around tests of performance that fail to predict what really matters: what happens once the test is over.

Jonah Lehrer
author of How We Decide