From the IES Director: Statistically Significant Doesn’t Mean Meaningful
American Statistical Association Releases Statement on Statistical Significance and p-Values.
The American Statistical Association (ASA) has released a statement on statistical significance and p-values, outlining six principles of proper use and p-value interpretation. For example, p-values and tests of statistical significance do not determine the size of an effect or whether a difference is educationally meaningful. The ASA releases this guidance on p-values to improve the conduct and interpretation of quantitative science and to inform the growing emphasis on the reproducibility of scientific research. For additional information, please contact Brian Gill (bgill@mathematica-mpr.com) to discuss how Bayesian statistics can lead to better understanding of recent National Assessment of Educational Progress (NAEP) results while moving the field away from the p<.05 bright line that leads to misinterpretations.
