Open AccessResearch on a Method of Log Aggregation
Author(s) -
Xinming Lai,
Haitao Wang,
Jing Zhao,
Fan Zhang,
Chao Zhao,
Gang Wu
Publication year - 2019
Publication title -
iop conference series. materials science and engineering
Language(s) - English
Resource type - Journals
eISSN - 1757-899X
pISSN - 1757-8981
DOI - 10.1088/1757-899x/688/3/033012
Subject(s) - container (type theory) , computer science , queue , cluster (spacecraft) , data mining , data aggregator , service (business) , real time computing , storm , scale (ratio) , distributed computing , database , computer network , engineering , geography , mechanical engineering , wireless sensor network , economy , meteorology , economics , cartography
This paper proposed a log aggregation method in scale container platform. This method collects container log data from cluster nodes through system management tool and container governance tool, provides the indiscriminate collection service for different platforms, aggregates log data in time based on Storm stream processing to implement real-time performance, implement high performance and high availability of container log data aggregation under scale clusters based on Kafka as the aggregation queue of log data.