Premium
LiveBench‐6: Large‐scale automated evaluation of protein structure prediction servers
Author(s) -
Rychlewski Leszek,
Fischer Daniel,
Elofsson Arne
Publication year - 2003
Publication title -
proteins: structure, function, and bioinformatics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.699
H-Index - 191
eISSN - 1097-0134
pISSN - 0887-3585
DOI - 10.1002/prot.10535
Subject(s) - server , computer science , benchmark (surveying) , set (abstract data type) , scale (ratio) , artificial intelligence , data mining , machine learning , computer network , physics , geodesy , quantum mechanics , programming language , geography
The aim of the LiveBench experiment is to provide a continuous evaluation of structure prediction servers in order to inform potential users about the current state‐of‐the‐art structure prediction tools and in order to help the developers to analyze and improve the services. This round of the experiment was conducted in parallel to the blind CAFASP‐3 evaluation experiment. The data collected almost simultaneously enables the comparison of servers on two different benchmark sets. The number of servers has doubled from the last evaluated LiveBench‐4 experiment completed in April 2002, just before the beginning of CAFASP‐3. This can be partially attributed to the rapid development in the area of meta‐predictors (consensus servers). The current results confirm the high sensitivity and specificity of the meta‐predictors. Nevertheless, the comparison between the autonomous (not meta) servers participating in the last CAFASP‐2 and LiveBench‐2 experiment and the current set of autonomous servers demonstrates that progress has been made also in sequence structure fitting functions. In addition to the growing number of participants, the current experiment marks the introduction of new evaluation procedures, which are aimed to correlate better with functional characteristics of models. Proteins 2003;53:542–547. © 2003 Wiley‐Liss, Inc.