STEINS PARADOX IN STATISTICS
STEINS PARADOX IN STATISTICS
复制标题
DOI:
10.1038/scientificamerican0577-119
复制
发表时间:
1977-01-01
影响因子:
3
通讯作者:
MORRIS, C
中科院分区:
文献类型:
--
作者:
EFRON, B;MORRIS, C
Sometimes a mathematical result is strikingly contrary to generally held belief even though an obvi ously valid proof is given. Charles Stein of Stanford University discovered such a paradox in statistics in 1955. His result undermined a century and a half of work on estimation theory, going back to Karl Friedrich Gauss and Adrien Ma rie Legendre. After a long period of re sistance to Stein's ideas, punctuated by frequent and sometimes angry debate, the sense of paradox has diminished and Stein's ideas are being incorporated into applied and theoretical statistics. Stein's paradox concerns the use of ob served averages to estimate unobserv able quantities. Averaging is the second most basic process in statistics, the first being the simple act of counting. A base ball player who gets seven hits in 20 offi cial times at bat is said to have a batting average of. 350. In computing this sta tistic we are forming an estimate of the player's true batting ability in terms of his observed average rate of success. Asked how well the player will do in his next 100 times at bat, we would proba bly predict 35 more hits. In traditional statistical theory it can be proved that no other estimation rule is uniformly better than the observed average. The paradoxical element in Stein's re sult is that it sometimes contradicts this elementary law of statistical theory. If we have three or more baseball players, and if we are interested in predicting fu ture batting averages for each of them, then there is a procedure that is better than simply extrapolating from the three separate averages. Here" better" has a strong meaning. The statistician who employs Stein's method can expect to predict the future averages more ac curately no matter what the true bat ting abilities of the players may be.