Open AccessTesting and Validation of Computational Methods for Mass Spectrometry
Author(s) -
Laurent Gatto,
Kasper D. Hansen,
Michael R. Hoopmann,
Henning Hermjakob,
Oliver Kohlbacher,
Andreas Beyer
Publication year - 2015
Publication title -
journal of proteome research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.644
H-Index - 161
eISSN - 1535-3907
pISSN - 1535-3893
DOI - 10.1021/acs.jproteome.5b00852
Subject(s) - computer science , correctness , data mining , experimental data , range (aeronautics) , metabolomics , computational model , proteomics , algorithm , bioinformatics , chemistry , mathematics , engineering , statistics , biology , biochemistry , gene , aerospace engineering
High-throughput methods based on mass spectrometry (proteomics, metabolomics, lipidomics, etc.) produce a wealth of data that cannot be analyzed without computational methods. The impact of the choice of method on the overall result of a biological study is often underappreciated, but different methods can result in very different biological findings. It is thus essential to evaluate and compare the correctness and relative performance of computational methods. The volume of the data as well as the complexity of the algorithms render unbiased comparisons challenging. This paper discusses some problems and challenges in testing and validation of computational methods. We discuss the different types of data (simulated and experimental validation data) as well as different metrics to compare methods. We also introduce a new public repository for mass spectrometric reference data sets ( http://compms.org/RefData ) that contains a collection of publicly available data sets for performance evaluation for a wide range of different methods.