Open AccessSTREET: Swedish Tool for Risk/Resource Estimation at EvenTs. Part two, resource assessment – face validity and inter–rater reliability
Author(s) -
Andreas Berner,
Tariq Alharbi,
Eric Carlström,
Amir KhorramManesh
Publication year - 2015
Publication title -
journal of acute disease
Language(s) - English
Resource type - Journals
eISSN - 2589-5516
pISSN - 2221-6189
DOI - 10.1016/s2221-6189(15)30019-6
Subject(s) - resource (disambiguation) , reliability (semiconductor) , face validity , estimation , inter rater reliability , foundation (evidence) , validity , risk assessment , medicine , resource use , statistics , computer science , environmental resource management , engineering , mathematics , geography , environmental science , psychometrics , computer security , rating scale , computer network , power (physics) , physics , systems engineering , archaeology , quantum mechanics
ObjectiveTo develop a validated and generalized collaborative tool to be utilized by high reliability organizations in order to conduct common resource assessment before major events and mass gatherings.MethodsThe Swedish resource and risk estimation guide was used as foundation for the development of the generalized collaborative tool, by three different expert groups, and then analyzed. Analysis of inter-rater reliability was conducted through simulated cases that showed weighted and unweight κ-statistics.ResultsThe results revealed a mean of unweight κ-value from the three cases of 0.44 and a mean accuracy of 61% of the tool.ConclusionsA better collaboration ability and more accurate resource assessment with acceptable reliability and validity were shown in this study to be used as a foundation for resource assessment before major events/mass-gathering in a simulated environment. However, the result also indicates the challenges of creating measurable values from simulated cases. A study on real events can provide higher reliability but needs, on the other hand, an already developed tool