arrow
Return

A Lightweight Algorithm for Message Type Extraction in System Application Logs

delete2012-11-01
delete98
PRE
AI
A
A. Nur Zincir‐Heywood
E
Evangelos Milios
DOI:10.1109/TKDE.2011.138delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Message type or message cluster extraction is an important task in the analysis of system logs in computer networks. Defining these message types automatically facilitates the automatic analysis of system logs. When the message types that exist in a log file are represented explicitly, they can form the basis for carrying out other automatic application log analysis tasks. In this paper, we introduce a novel algorithm for carrying out message type extraction from event log files. IPLoM, which stands for Iterative Partitioning Log Mining, works through a 4-step process. The first three steps hierarchically partition the event log into groups of event log messages or event clusters. In its fourth and final stage, IPLoM produces a message type description or line format for each of the message clusters. IPLoM is able to find clusters in data irrespective of the frequency of its instances in the data, it scales gracefully in the case of long message type patterns and produces message type descriptions at a level of abstraction, which is preferred by a human observer. Evaluations show that IPLoM outperforms similar algorithms statistically significantly.
Keywords:
Algorithms
experimentation
event log mining
fault management
clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

D
Dalhousie University
Scholars:
2.0W
Papers: 1.8W
Citations: 2.3W
Cited Papers

Cited Papers

Indenyl and fluorenyl transition element complexes
err1978-10-01
err0
PREAI
errA.N. Nesmeyanov; N.A. Ustynyuk; L.G. Makarova; V.G. Andrianov; Yu.T. Struchkov; Steffen Andrae; Yu.A. Ustynyuk; S.G. Malyugina
errShare
errSave
Heteronucleare clustersysteme
err1981-03-01
err0
PREAI
errKlaus Bartl; Roland Boese; Günter Schmid
errShare
errSave
Paleocurrent reconstruction of the deep Pacific inflow during the middle Miocene: Reflections of East Antarctic Ice Sheet growth
err2003-05-22
err0
errOAAI
errIan R. Hall; I. Nicholas McCave; Rainer Zahn; Lionel Carter; Paul C. Knutz; Graham P. Weedon
errShare
errSave
COMPLICATED ANORECTAL SEPSIS
err1997-02-01
err0
PREAI
errRobert Gilliland; Steven D. Wexner
errShare
errSave
Jets in minimum bias physics
err1985-09-01
err0
PREAI
errG. Pancheri; Y. Srivastava
errShare
errSave
Risk factors for necrotic cholecystitis during the COVID-19 pandemic: the ChoCO-WSES prospective collaborative study’s experience
err2021-12-31
err0
errOAAI
errBelinda de Simone; Fausto Catena; Salomone Di Saverio; Massimo Sartelli; Fikri M. Abu-Zidan; Mauro Podda; Walter L Biffl; Luca Ansaloni; Federico Coccolini; Ernest E Moore; Yoram Kluger; Carlos Augusto Gomes; Ferdinando Agresta; Elie Chouillard
errShare
errSave
Transdermal estradiol substitution therapy for the induction of puberty in female hypogonadism
err2014-03-27
err0
PREAI
errMariangela Cisternino; K. Nahoul; M. Bozzola; G. Grignani; G. Perani; P. Sampaolo; M. Roger; F. Severi
errShare
errSave
researcher View more