Premium
Real‐time anomaly detection using parallelized intrusion detection architecture for streaming data
Author(s) -
P Chellammal,
P D Sheba Kezia Malarchelvi
Publication year - 2018
Publication title -
concurrency and computation: practice and experience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.309
H-Index - 67
eISSN - 1532-0634
pISSN - 1532-0626
DOI - 10.1002/cpe.5013
Subject(s) - computer science , intrusion detection system , anomaly detection , streaming data , data mining , architecture , heuristic , mechanism (biology) , domain (mathematical analysis) , feature selection , feature (linguistics) , concept drift , machine learning , artificial intelligence , data stream mining , art , mathematical analysis , philosophy , linguistics , mathematics , epistemology , visual arts
Summary High usage levels of networking technologies has resulted in large amounts of data being generated. This in‐turn has lured several fraudsters, whose anomalous behaviors create undesired consequences to legitimate users. This paper proposes an Adaptive Parallelized Intrusion Detection (APID) architecture to handle the hugeness and data imbalance associated with streaming data. The architecture is composed of a feature selection strategy to reduce data size, an effective data segregation mechanism to handle data imbalance and a heterogeneous ensemble and a heuristic combiner mechanism to provide effective predictions. Adaptivity is incorporated by the reinforcement mechanism that retrains the model based on false predictions given by the model. The proposed APID architecture is generic; hence, it supports heterogeneous models and can also incorporate any number of machine learning models. Hence, it becomes flexible to adapt the model to data pertaining to any domain. Experiments were performed with KDD CUP 99, NSL‐KDD, and Koyoto 2006 datasets. Comparisons performed with recent works in literature indicates anomaly detection rates between 98% to 99% exhibiting the effectiveness of the proposed model.