Topic: Management Improvement
Statistics Abuse and Me by Jay Mathews:
How can that be? Is it important? First, yes it is important. Effective use of data is an important part of management improvement. Emphasis is needed on “effective”; data misuse is rampant and creates problems. Use of data by itself is not sufficient.
To be effective you need to learn to think about not what is printed on the page but what lies behind the numbers you see. The numbers are just proxies for the real situation. Look beyond the numbers you see to what they mean and understand how the numbers presented may not fully capture the important details you need to consider.
Ok back to how the SAT numbers could seem to go up fairly significantly for all the sub groups of the total but only a little bit for the total. This numerical quirk is known as Simpson’s Paradox. If the proportions of the subgroups (Asians, American Indians…) change then the overall average is effected not just by the changes of the subgroup average SAT scores but the changes of the weighting of each subgroup (so if the overall average is less than even the lowest gain for a subgroup you know that the subgroup weighting must have increased for one or more of the subgroups with lower SAT scores).
Take care when you are make decision based on your understanding of data to avoid assumptions that may not be correct.
Pingback: Curious Cat Science and Engineering Blog » Report on K-12 Science Education in USA
Pingback: CuriousCat: Search Share Data - Checking the ACSI
Pingback: CuriousCat: Fooled by Randomness
Pingback: Curious Cat Science and Engineering Blog » 500 Year Floods
Pingback: Curious Cat Science and Engineering Blog » Mistakes in Experimental Design and Interpretation
Pingback: Curious Cat Management Improvement Blog » Friday Fun: Correlation
Pingback: Curious Cat Science and Engineering Blog Â» Bigger Impact: 15 to 18 mpg or 50 to 100 mpg?
Pingback: Curious Cat Management Improvement Blog » Management Blog Posts From May 2006
Pingback: Is the Results Due to Mathematical Probability or Individual Merit? « The W. Edwards Deming Institute Blog