ANOVA F-test and Kruskal-Wallis test performance comparison under varying distributions, variance heterogeneity, sample sizes, and noncentrality structures
*Ryan R. RahrigCorresponding authorr-rahrig@onu.eduSchool of Science, Technology and MathematicsOhio Northern UniversityAda, OH 45810, U.S.A.View full profile →
* Corresponding author · click or hover a name for details
- Received:
- 14 Dec 2022
- Published Online:
- 18 Dec 2024
- Article type:
- Research Article
- Language:
- EN
- Article no.:
- JSMS-1116
- Pages:
- 1595–1613
Abstract
Keywords
Subject Classifications
References
[1] T. Micceri, “The unicorn, the normal curve, and other improbable creatures,” Psychological Bulletin, vol. 105, pp. 156–166 (1989).
[2] M. J. Blanca, J. Arnau, D. López-Montiel, M. M. Marín, and A. L. Salvador, “Skewness and kurtosis in real data samples,” Methodology, vol. 9, pp. 78-84 (2013).
[3] C. R. Harvey and A. Siddique, “Conditional Skewness in Asset Pricing Tests,” The Journal of Finance, vol. 55, pp. 1263–1295 (2000).
[4] K. Kobayashi, “Analysis of quantitative data obtained from toxicity studies showing non-normal distribution,” J. Toxicol. Sci., vol. 30, pp. 127–134 (2005).
[5] W. J. van der Linden, “A Lognormal Model for Response Times on Test Items,” Journal of Educational and Behavioral Statistics, vol. 31, pp. 181–204 (2006).
[6] M. B. Brown and A. B. Forsythe, “372: The Anova and Multiple Comparisons for Data with Heterogeneous Variances,” Biometrics, vol. 30, p. 719 (1974).
[7] W. H. Kruskal and W. A. Wallis, “Use of Ranks in One-Criterion Variance Analysis,” JASA, vol. 47, pp. 583–621 (1952).
[8] B. L. Welch, “On the Comparison of Several Mean Values: An Alternative Approach,” Biometrika, vol. 38, p. 330 (1951).
[9] D. S. Moore, G. P. McCabe, and B. A. Craig, Introduction to the Practice of Statistics, 9th ed. New York: W.H. Freeman, Macmillan Learning (2014).
[10] D. D. Wackerly, W. Mendenhall, and R. L. Scheaffer, Mathematical Statistics with Applications, 7th ed. Belmont, CA: Thomson Brooks/Cole (2008).
[11] B. Baldi and D. S. Moore, The Practice of Statistics in the Life Sciences, 4th ed. New York, NY: W.H. Freeman, Macmillan Learning (2018).
[12] A. G. Bluman, Elementary Statistics: A Step by Step Approach, 10th ed. New York, NY: McGraw-Hill Education (2018).
[13] M. F. Triola and L. Iossi, Elementary Statistics, 13th ed. United States: Pearson (2018).
[14] D. T. Larose, Discovering Statistics, 3rd ed. New York: W.H. Freeman & Company, a Macmillan Education imprint (2016).
[15] M. Sullivan, Fundamentals of Statistics: Informed Decisions Using Data, 5th ed. Boston: Pearson (2018).
[16] C. Warren, K. Denley, and E. Atchley, Beginning Statistics, 2nd ed. Charleston, SC: Hawkes Learning Systems (2014).
[17] J. J. Higgins, An Introduction to Modern Nonparametric Statistics, Pacific Grove, CA: Brooks/Cole (2004).
[18] D. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures, 5th ed. Boca Raton: CRC Press (2011).
[19] P. Sprent and N. C. Smeeton, Applied Nonparametric Statistical Methods, 4th ed. Boca Raton: Chapman & Hall/CRC (2007).
[20] A. Tomarken and R. Serlin, “Comparison of ANOVA Alternatives Under Variance Heterogeneity and Specific Noncentrality Structures,” Psychological Bulletin, vol. 99, pp. 90–99 (1986).
[21] A. Khan and G. D. Rayner, “Robustness to Non-Normality of Common Tests for the Many-Sample Location Problem,” Journal of Applied Mathematics and Decision Sciences, vol. 7, pp. 187–206 (2003).
[22] K. Moder, “Alternatives to F-Test in One Way ANOVA in Case of Heterogeneity of Variances (A Simulation Study),” Psychological Test and Assessment Modeling, vol. 52 (2010).
[23] T. V. Hecke, “Power Study of ANOVA Versus Kruskal-Wallis Test,” Journal of Statistics and Management Systems, vol. 15, pp. 241–247 (2012).
[24] H. Buning, “Robust Analysis of Variance,” Journal of Applied Statistics, vol. 24, pp. 319–332 (1997).
[25] P. A. Lachenbruch and P. J. Clements, “ANOVA, Kruskal-Wallis, Normal Scores and Unequal Variance,” Communications in Statistics - Theory and Methods, vol. 20, pp. 107–126 (1991).
[26] Z. Yusof, S. Abdullah, and S. S. Syed-Yahaya, “Comparing the Performance of Modified F t Statistic with ANOVA and Kruskal Wallis Test,” (2013).
[27] B. Lantz, “The Impact of Sample Non-Normality on ANOVA and Alternative Methods,” Br J Math Stat Psychol, vol. 66, pp. 224–244 (2013).
[28] B. J. Feir-Walsh and L. E. Toothaker, “An Empirical Comparison of the ANOVA F-Test, Normal Scores Test and Kruskal-Wallis Test Under Violation of Assumptions,” Educational and Psychological Measurement, vol. 34, pp. 789–799 (1974).
[29] H. J. Keselman, J. C. Rogan, and B. J. Feir-Walsh, “An Evaluation of Some Nonparametric and Parametric Tests for Location Equality,” British Journal of Mathematical and Statistical Psychology, vol. 30, pp. 213–221 (1977).
[30] C. Golinski and R. A. Cribbie, “The Expanding Role of Quantitative Methodologists in Advancing Psychology,” Canadian Psychology/Psychologie canadienne, vol. 50, pp. 83–90 (2009).
[31] H. J. Keselman, C. J. Huberty, L. M. Lix, R. L. O’Neill, B. A. Tobin, and R. A. Olejnik, “Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses,” Rev. Educ. Res., vol. 68, pp. 350-386 (1998).
[32] M. J. Blanca, R. Alarcón, J. Arnau, M. J. Bono, and A. L. M. L. Liu, “Non-normal data: Is ANOVA still a valid option?” Psicothema, vol. 29, pp. 552–557 (2017).
[33] E. Schmider, M. Ziegler, E. Danay, S. Beyer, and C. L. F. D. P. Bühner, “Is it really robust?: Reinvestigating the robustness of ANOVA against violations of the normal distribution assumption,” Methodology, vol. 6, pp. 147–151 (2010).
[34] R. T. Hurlburt, Comprehending Behavioral Statistics, 6th ed. Dubuque, IA: Kendall Hunt Publishing Company (2017).
[35] D. C. Howell, Statistical Methods for Psychology, 8th ed. Belmont, CA: Wadsworth Cengage Learning (2013).
[36] R. C. Blair and J. J. Higgins, “A comparison of the power of Wilcoxon’s rank-sum statistic to that of Student’s t statistic under various nonnormal distributions,” J. Educ. Behav. Stat., vol. 5, pp. 309–335 (1980).
[37] R Core Team, “R: A language and environment for statistical computing,” R Foundation for Statistical Computing, Vienna, Austria (2020). Available: https://www.R-project.org/.
[38] P. de Valpine, D. Turek, C. J. Paciorek, C. Anderson-Bergman, D. T. Lang, and R. Bodik, “Programming with models: writing statistical algorithms for general model structures with NIMBLE,” J. Comput. Graph. Stat., vol. 26, no. 2, pp. 403-413 (2017).
[39] C. H. Jackson, “Multi-state models for panel data: The msm package for R,” J. Stat. Softw., vol. 38, pp. 1–29 (2011).
[40] R. Bendayan, J. Arnau, M. J. Blanca, and R. Bono, “Comparación de los procedimientos de Fleishman y Ramberg et al. para generar datos no normales en estudios de simulación,” Anales de Psicología, vol. 30, no. 1, pp. 364-371 (2014).
[41] R. R. Robey and R. S. Barcikowski, “Type I error and the number of iterations in Monte Carlo studies of robustness,” Br. J. Math. Stat. Psychol., vol. 45, pp. 283–288 (1992).
[42] H. Scheffé, The Analysis of Variance, Wiley Classics Library ed. New York: Wiley-Interscience Publication (1999).
