Premium
Streaming data
Author(s) -
Szewczyk William
Publication year - 2010
Publication title -
wiley interdisciplinary reviews: computational statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.693
H-Index - 38
eISSN - 1939-0068
pISSN - 1939-5108
DOI - 10.1002/wics.130
Subject(s) - streaming data , computer science , streaming algorithm , process (computing) , context (archaeology) , data stream mining , data mining , exploratory data analysis , big data , data science , mathematical analysis , paleontology , mathematics , biology , upper and lower bounds , operating system
As the ability to collect data continues to outstrip the ability to process and analyze it, the age‐old paradigm of store‐and‐process is becoming untenable. Finding one or two interesting items in the midst of many possible signals depends on context which often changes over time. A new way to interact with data is needed to handle some of these challenges. The streaming data model is one such approach. In this article, we present the streaming data model as well as two approaches to designing algorithms to handle streaming data. The first, the single processor method, traces its heritage to database models. The second, the multi‐processor method, is more aligned with signal processing algorithms. We will close with a critique of the current approaches and some of the statistical challenges that streaming data pose. WIREs Comp Stat 2011 3 22–29 DOI: 10.1002/wics.130 This article is categorized under: Algorithms and Computational Methods > Algorithms Data: Types and Structure > Streaming Data Statistical Learning and Exploratory Methods of the Data Sciences > Streaming Data Mining