Premium
Data agility through clustered edge computing and stream processing
Author(s) -
Dautov Rustem,
Distefano Salvatore,
Bruneo Dario,
Longo Francesco,
Merlino Giovanni,
Puliafito Antonio
Publication year - 2018
Publication title -
concurrency and computation: practice and experience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.309
H-Index - 67
eISSN - 1532-0634
pISSN - 1532-0626
DOI - 10.1002/cpe.5093
Subject(s) - computer science , distributed computing , cloud computing , stream processing , edge computing , edge device , data processing , enhanced data rates for gsm evolution , big data , data mining , database , artificial intelligence , operating system
Summary The Internet of Things is underpinned by the global penetration of network‐connected smart devices continuously generating extreme amounts of raw data to be processed in a timely manner. Supported by Cloud and Fog/Edge infrastructures – on the one hand, and Big Data processing techniques – on the other, existing approaches, however, primarily adopt a vertical offloading model that is heavily dependent on the underlying network bandwidth. That is, (constrained) network communication remains the main limitation to achieve truly agile IoT data management and processing. This paper aims to bridge this gap by defining Clustered Edge Computing – a new approach to enable rapid data processing at the very edge of the IoT network by clustering edge devices into fully functional decentralized ensembles, capable of workload distribution and balancing to accomplish relatively complex computational tasks. This paper also proposes ECStream Processing that implements Clustered Edge Computing using Stream Processing techniques to enable dynamic in‐memory computation close to the data source. By spreading the workload among a cluster of collocated edge devices to process data in parallel, the proposed approach aims to improve performance, thereby supporting agile data management. The experimental results confirm that such a distributed in‐memory approach to data processing at the very edge of an IoT network can outperform currently adopted Cloud‐enabled architectures, and has the potential to address a wide range of IoT‐related data‐intensive time‐critical scenarios.