Premium
Estimating data from figures with a Web‐based program: Considerations for a systematic review
Author(s) -
Burda Brittany U.,
O'Connor Elizabeth A.,
Webber Elizabeth M.,
Redmond Nadia,
Perdue Leslie A.
Publication year - 2017
Publication title -
research synthesis methods
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.376
H-Index - 35
eISSN - 1759-2887
pISSN - 1759-2879
DOI - 10.1002/jrsm.1232
Subject(s) - intraclass correlation , statistics , raw data , computer science , meta analysis , missing data , systematic review , outcome (game theory) , econometrics , data mining , medline , mathematics , medicine , psychometrics , mathematical economics , political science , law
Background Systematic reviewers often encounter incomplete or missing data, and the information desired may be difficult to obtain from a study author. Thus, systematic reviewers may have to resort to estimating data from figures with little or no raw data in a study's corresponding text or tables. Methods We discuss a case study in which participants used a publically available Web‐based program, called webplotdigitizer , to estimate data from 2 figures. We evaluated and used the intraclass coefficient and the accuracy of the estimates to the true data to inform considerations when using estimated data from figures in systematic reviews. Results The estimates for both figures were consistent, although the distribution of estimates in the figure of a continuous outcome was slightly higher. For the continuous outcome, the percent difference ranged from 0.23% to 30.35% while the percent difference of the event rate ranged from 0.22% to 8.92%. For both figures, the intraclass coefficient was excellent (>0.95). Conclusions Systematic reviewers should consider and be transparent when estimating data from figures when the information cannot be obtained from study authors and perform sensitivity analyses of pooled results to reduce bias.