Invited commentary: Comparing the independent segments procedure with group sequential designs.
Author(s) -
Daniël Lakens
Publication year - 2021
Publication title -
psychological methods
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.981
H-Index - 151
eISSN - 1939-1463
pISSN - 1082-989X
DOI - 10.1037/met0000400
Subject(s) - type i and type ii errors , computer science , flexibility (engineering) , psycinfo , statistical hypothesis testing , equivalence (formal languages) , sample size determination , path (computing) , machine learning , statistics , mathematics , programming language , medline , discrete mathematics , political science , law
Psychological science would become more efficient if researchers implemented sequential designs where feasible. Miller and Ulrich (2020) propose an independent segments procedure where data can be analyzed at a prespecified number of equally spaced looks while controlling the Type I error rate. Such procedures already exist in the sequential analysis literature, and in this commentary, I reflect on whether psychologists should choose to adopt these existing procedures instead. I believe limitations in the independent segments procedure make it relatively unattractive. Being forced to stop for futility based on a bound not chosen to control Type II errors, or reject a smallest effect size of interest in an equivalence test, limits the inferences one can make. Having to use a prespecified number of equally spaced looks is logistically inconvenient. And not having the flexibility to choose α and β spending functions limits the possibility to design efficient studies based on the goal and limitations of the researcher. Recent software packages such as rpact (Wassmer & Pahlke, 2019) make sequential designs equally easy to perform as the independent segments procedure. While learning new statistical methods always takes time, I believe psychological scientists should start on a path that will not limit them in the flexibility and inferences their statistical procedure provides. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom