The challenge of the Psychonomic Society Guidelines on statistical issues (2012)

Peter E Morris, Catherine O Fritz

Research output: Contribution to conference typesPoster

Abstract

In 2012 the Psychonomic Society adopted new guidelines on statistical issues. We examined all of the empirical papers published in the Society’s journals in 2013 to discover how much needs to change to meet the guidelines. The Guidelines call for authors to consider statistical power and sample size, but only a tiny proportion of papers did so. The Guidelines emphasize the importance of reporting appropriate measures of variability “e.g., confidence intervals around means and/or around standardized effect sizes”, but the reporting of variability was patchy. Nearly half the papers failed to report effect sizes and almost none discussed them. Effect size estimates were mostly limited to partial eta squared and Cohen’s d, rather than population estimates. Confidence intervals were very rarely reported and almost never used or discussed. Psychonomics authors and editors face a challenge to update the standard of statistical reporting if the 2012 Guidelines are to be met.
Original languageEnglish
Publication statusPublished - 21 Nov 2014
Event55th Annual Meeting of the Psychonomic Society - Long Beach, California
Duration: 21 Nov 2014 → …
http://www.psychonomic.org/2014-annual-meeting

Conference

Conference55th Annual Meeting of the Psychonomic Society
Period21/11/14 → …
Internet address

Fingerprint

confidence
editor
Society

Keywords

  • statistics
  • effect size
  • confidence intervals
  • quantitative reporting
  • publication norms

Cite this

Morris, P. E., & Fritz, C. O. (2014). The challenge of the Psychonomic Society Guidelines on statistical issues (2012). Poster session presented at 55th Annual Meeting of the Psychonomic Society, .
Morris, Peter E ; Fritz, Catherine O. / The challenge of the Psychonomic Society Guidelines on statistical issues (2012). Poster session presented at 55th Annual Meeting of the Psychonomic Society, .
@conference{4bfe216025ea400587020710eee7f7b4,
title = "The challenge of the Psychonomic Society Guidelines on statistical issues (2012)",
abstract = "In 2012 the Psychonomic Society adopted new guidelines on statistical issues. We examined all of the empirical papers published in the Society’s journals in 2013 to discover how much needs to change to meet the guidelines. The Guidelines call for authors to consider statistical power and sample size, but only a tiny proportion of papers did so. The Guidelines emphasize the importance of reporting appropriate measures of variability “e.g., confidence intervals around means and/or around standardized effect sizes”, but the reporting of variability was patchy. Nearly half the papers failed to report effect sizes and almost none discussed them. Effect size estimates were mostly limited to partial eta squared and Cohen’s d, rather than population estimates. Confidence intervals were very rarely reported and almost never used or discussed. Psychonomics authors and editors face a challenge to update the standard of statistical reporting if the 2012 Guidelines are to be met.",
keywords = "statistics, effect size, confidence intervals, quantitative reporting, publication norms",
author = "Morris, {Peter E} and Fritz, {Catherine O}",
year = "2014",
month = "11",
day = "21",
language = "English",
note = "55th Annual Meeting of the Psychonomic Society ; Conference date: 21-11-2014",
url = "http://www.psychonomic.org/2014-annual-meeting",

}

Morris, PE & Fritz, CO 2014, 'The challenge of the Psychonomic Society Guidelines on statistical issues (2012)' 55th Annual Meeting of the Psychonomic Society, 21/11/14, .

The challenge of the Psychonomic Society Guidelines on statistical issues (2012). / Morris, Peter E; Fritz, Catherine O.

2014. Poster session presented at 55th Annual Meeting of the Psychonomic Society, .

Research output: Contribution to conference typesPoster

TY - CONF

T1 - The challenge of the Psychonomic Society Guidelines on statistical issues (2012)

AU - Morris, Peter E

AU - Fritz, Catherine O

PY - 2014/11/21

Y1 - 2014/11/21

N2 - In 2012 the Psychonomic Society adopted new guidelines on statistical issues. We examined all of the empirical papers published in the Society’s journals in 2013 to discover how much needs to change to meet the guidelines. The Guidelines call for authors to consider statistical power and sample size, but only a tiny proportion of papers did so. The Guidelines emphasize the importance of reporting appropriate measures of variability “e.g., confidence intervals around means and/or around standardized effect sizes”, but the reporting of variability was patchy. Nearly half the papers failed to report effect sizes and almost none discussed them. Effect size estimates were mostly limited to partial eta squared and Cohen’s d, rather than population estimates. Confidence intervals were very rarely reported and almost never used or discussed. Psychonomics authors and editors face a challenge to update the standard of statistical reporting if the 2012 Guidelines are to be met.

AB - In 2012 the Psychonomic Society adopted new guidelines on statistical issues. We examined all of the empirical papers published in the Society’s journals in 2013 to discover how much needs to change to meet the guidelines. The Guidelines call for authors to consider statistical power and sample size, but only a tiny proportion of papers did so. The Guidelines emphasize the importance of reporting appropriate measures of variability “e.g., confidence intervals around means and/or around standardized effect sizes”, but the reporting of variability was patchy. Nearly half the papers failed to report effect sizes and almost none discussed them. Effect size estimates were mostly limited to partial eta squared and Cohen’s d, rather than population estimates. Confidence intervals were very rarely reported and almost never used or discussed. Psychonomics authors and editors face a challenge to update the standard of statistical reporting if the 2012 Guidelines are to be met.

KW - statistics

KW - effect size

KW - confidence intervals

KW - quantitative reporting

KW - publication norms

UR - http://www.psychonomic.org/2014-annual-meeting

M3 - Poster

ER -

Morris PE, Fritz CO. The challenge of the Psychonomic Society Guidelines on statistical issues (2012). 2014. Poster session presented at 55th Annual Meeting of the Psychonomic Society, .