Premium
p ‐Curve analysis of the Taylor Aggression Paradigm: Estimating evidentiary value and statistical power across 50 years of research
Author(s) -
West Samuel J.,
Hyatt Courtland S.,
Miller Joshua D.,
Chester David S.
Publication year - 2021
Publication title -
aggressive behavior
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.223
H-Index - 92
eISSN - 1098-2337
pISSN - 0096-140X
DOI - 10.1002/ab.21937
Subject(s) - value (mathematics) , psychology , power (physics) , aggression , social psychology , poison control , meta analysis , reliability (semiconductor) , statistics , econometrics , economics , mathematics , medicine , medical emergency , physics , quantum mechanics
The overall reliability or evidentiary value of any body of literature is established in part by ruling out publication bias for any observed effects. Questionable research practices have potentially undermined the evidentiary value of commonly used research paradigms in psychological science. Subsequently, the evidentiary value of these common methodologies remains uncertain. To quantify the severity of these issues in the literature, we selected the Taylor Aggression Paradigm (TAP) as a case study and submitted 170 hypothesis tests spanning over 50 years of research to a preregistered p ‐curve analysis. The TAP literature ( N = 24,685) demonstrated significant evidentiary value but yielded a small average effect size ( d = 0.29) and inadequate power (38%). The main effects demonstrated greater evidentiary value, power, and effect sizes than interactions. Studies that tested the effects of measured traits did not differ in evidentiary value or power to those that tested the effects of experimentally manipulated states. Exploratory analyses revealed that evidentiary value, statistical power, and effect sizes have improved over time. We provide recommendations for researchers who seek to maximize the evidentiary value of their psychological measures.