Research and Implementation of a Method for Web Log Analysis Template Extraction | Zendy

Zengchao Ni | Zendy; Hongqi Liu | Zendy; Yuanping Chen | Zendy; Dengsheng Wu | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

Research and Implementation of a Method for Web Log Analysis Template Extraction

Author(s) -

Zengchao Ni,

Hongqi Liu,

Yuanping Chen,

Dengsheng Wu

Publication year - 2019

Publication title -

procedia computer science

Language(s) - English

Resource type - Journals

SCImago Journal Rank - 0.334

H-Index - 76

ISSN - 1877-0509

DOI - 10.1016/j.procs.2019.12.037

Subject(s) - computer science , preprocessor , template matching , matching (statistics) , pattern recognition (psychology) , similarity (geometry) , word (group theory) , data mining , segmentation , artificial intelligence , basis (linear algebra) , template , tree (set theory) , image (mathematics) , mathematics , statistics , geometry , programming language , mathematical analysis

Extracting log template is a very effective method to deal with massive system logs. In this paper, based on Web system logs, the template extraction method based on label recognition tree is used to extract log template, and on this basis, the log preprocessing and template expression generation method are studied and improved. Aiming at the complex structure problem of system logs, the preprocessing method based on text similarity is adopted, and the classification of a log message is realized. The use of the maximum template matching method solves the problem of inconsistent log format and insufficient template matching caused by word segmentation. In the end, the log template extraction method is evaluated. The results show that the accuracy of the method is up to 96.4%, and the template matching degree is greatly increased.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research