Premium
Fast subset scan for multivariate event detection
Author(s) -
Neill Daniel B.,
McFowland Edward,
Zheng Huanian
Publication year - 2012
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/sim.5675
Subject(s) - scan statistic , univariate , multivariate statistics , computer science , statistic , event (particle physics) , data mining , multivariate analysis , data stream mining , artificial intelligence , pattern recognition (psychology) , statistics , machine learning , mathematics , physics , quantum mechanics
We present new subset scan methods for multivariate event detection in massive space–time datasets. We extend the recently proposed ‘fast subset scan’ framework from univariate to multivariate data, enabling computationally efficient detection of irregular space–time clusters even when the numbers of spatial locations and data streams are large. For two variants of the multivariate subset scan, we demonstrate that the scan statistic can be efficiently optimized over proximity‐constrained subsets of locations and over all subsets of the monitored data streams, enabling timely detection of emerging events and accurate characterization of the affected locations and streams. Using our new fast search algorithms, we perform an empirical comparison of the Subset Aggregation and Kulldorff multivariate subset scans on synthetic data and real‐world disease surveillance tasks, demonstrating tradeoffs between the detection and characterization performance of the two methods. Copyright © 2012 John Wiley & Sons, Ltd.