Effect size estimates: current use, calculations, and interpretation

Catherine O Fritz, Peter E Morris, Jennifer J Richler

Research output: Contribution to journalArticleResearchpeer-review

Abstract

The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial eta squared was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen’s d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.
Original languageEnglish
Pages (from-to)2-18
Number of pages16
JournalJournal of Experimental Psychology: General
Volume141
Issue number1
DOIs
Publication statusPublished - 1 Feb 2012

Fingerprint

interpretation
confidence
analysis of variance
experimental psychology

Cite this

Fritz, Catherine O ; Morris, Peter E ; Richler, Jennifer J. / Effect size estimates: current use, calculations, and interpretation. In: Journal of Experimental Psychology: General. 2012 ; Vol. 141, No. 1. pp. 2-18.
@article{8a25619e07ca454995817da8014e3cb2,
title = "Effect size estimates: current use, calculations, and interpretation",
abstract = "The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial eta squared was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen’s d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.",
author = "Fritz, {Catherine O} and Morris, {Peter E} and Richler, {Jennifer J}",
year = "2012",
month = "2",
day = "1",
doi = "10.1037/a0024338",
language = "English",
volume = "141",
pages = "2--18",
journal = "Journal of Experimental Psychology: General",
issn = "0096-3445",
publisher = "American Psychological Association",
number = "1",

}

Effect size estimates: current use, calculations, and interpretation. / Fritz, Catherine O; Morris, Peter E; Richler, Jennifer J.

In: Journal of Experimental Psychology: General, Vol. 141, No. 1, 01.02.2012, p. 2-18.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Effect size estimates: current use, calculations, and interpretation

AU - Fritz, Catherine O

AU - Morris, Peter E

AU - Richler, Jennifer J

PY - 2012/2/1

Y1 - 2012/2/1

N2 - The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial eta squared was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen’s d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.

AB - The Publication Manual of the American Psychological Association (American Psychological Association, 2001, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial eta squared was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen’s d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.

UR - http://www.apa.org/pubs/journals/xge/index.aspx

U2 - 10.1037/a0024338

DO - 10.1037/a0024338

M3 - Article

VL - 141

SP - 2

EP - 18

JO - Journal of Experimental Psychology: General

JF - Journal of Experimental Psychology: General

SN - 0096-3445

IS - 1

ER -