Premium
The effects of research level and article type on the differences between citation metrics and F 1000 recommendations
Author(s) -
Du Jian,
Tang Xiaoli,
Wu Yishan
Publication year - 2016
Publication title -
journal of the association for information science and technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.903
H-Index - 145
eISSN - 2330-1643
pISSN - 2330-1635
DOI - 10.1002/asi.23548
Subject(s) - citation , transformative learning , perspective (graphical) , impact factor , consistency (knowledge bases) , psychology , bibliometrics , medline , data science , computer science , library science , political science , pedagogy , artificial intelligence , law
F 1000 recommendations were assessed as a potential data source for research evaluation, but the reasons for differences between F 1000 Article Factor ( FFa scores) and citations remain unexplored. By linking recommendations for 28,254 publications in F 1000 with citations in S copus, we investigated the effect of research level (basic, clinical, mixed) and article type on the internal consistency of assessments based on citations and FFa scores. The research level has little impact on the differences between the 2 evaluation tools, while article type has a big effect. These 2 measures differ significantly for 2 groups: (a) nonprimary research or evidence‐based research are more highly cited but not highly recommended, while (b) translational research or transformative research are more highly recommended but have fewer citations. This can be expected, since citation activity is usually practiced by academic authors while the potential for scientific revolutions and the suitability for clinical practice of an article should be investigated from a practitioners' perspective. We conclude with a recommendation that the application of bibliometric approaches in research evaluation should consider the proportion of 3 types of publications: evidence‐based research, transformative research, and translational research. The latter 2 types are more suitable for assessment through peer review.