arrow
Return

Logfun: An efficient function-Level log management framework for systems implemented with python

delete2026-04-01
delete0
PRE
AI
M
Min Li
G
Gou Tan
M
Mingdong He
G
Guangba Yu
陈鹏飞 cover
陈鹏飞 (Pengfei Chen) *
C
Chuanfu Zhang
DOI:10.1016/j.jss.2026.112854delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Logging provides essential execution information for debugging and troubleshooting. Current applications typically integrate logging frameworks to enhance log standardization and unified management. However, existing logging frameworks significantly impact the efficiency of program execution and consume substantial storage resources. Because they lack mechanisms to automatically detect high-frequency or redundant logs and enforce precise dynamic logging controls. During log analysis, it is extraordinarily hard for these frameworks to provide raw log templates and maintain consistent log sequence integrity. Therefore, we propose LogFun, a function-level logging framework that achieves efficient logging and runtime control. It enables efficient log compression and extraction of log templates and variables, as well as automatically identifies high-frequency and redundant logs natively. The experiments show that LogFun decreases the function latency by 23% compared to current logging frameworks. The runtime log controlling decreases latency by 59% and reduces the log volume by 63% in high-load scenarios. LogFun significantly reduces log volume and achieves a compression ratio of 75x to 170x when combined with compression tools. Additionally, LogFun provides precise log templates and variables, reducing the pre-processing overhead associated with log anomaly detection and improving model accuracy.
Keywords:
Logging framework
Log compression
Function as a service
Large language model

Journal

Journal of Systems and Software cover
Journal of Systems and Software
IF:
4.1
Papers:
5.5K
Citations:
8.4K

Organization

C
China Southern Power Grid
Scholars:
3.4K
Papers: 2.4K
Citations: 8
S
Sun Yat sen University
Scholars:
7.7K
Papers: 2.0K
Citations: 1.8W
Cited Papers

Cited Papers

Log-based software monitoring: a systematic mapping study
err2021-05-06
err15
errOAAI
errCandido, Jeanderson; Aniche, Mauricio; van Deursen, Arie
errShare
errSave
Support vector machines
err1998-07-01
err0
PREAI
errM.A. Hearst; S.T. Dumais; E. Osuna; J. Platt; B. Scholkopf
errShare
errSave
A Qualitative Study of the Benefits and Costs of Logging From Developers' Perspectives
err2021-12-01
err47
PREAI
errLi, Heng; Shang, Weiyi; Adams, Bram; Sayagh, Mohammed; Hassan, Ahmed E.
errShare
errSave
A literature review and existing challenges on software logging practices
err2024-06-18
err2
PREAI
errBatoun, Mohamed Amine; Sayagh, Mohammed; Aghili, Roozbeh; Ouni, Ali; Li, Heng
errShare
errSave
Log4Perf: suggesting and updating logging locations for web-based systems' performance monitoring
err2019-10-26
err20
PREAI
errYao, Kundi; de Padua, Guilherme B.; Shang, Weiyi; Sporea, Catalin; Toma, Andrei; Sajedi, Sarah
errShare
errSave
Improving State-of-the-Art Compression Techniques for Log Management Tools
err2022-08-01
err7
PREAI
errYao, Kundi; Sayagh, Mohammed; Shang, Weiyi; Hassan, Ahmed E.
errShare
errSave
FaaSDeliver: Cost-Efficient and QoS-Aware Function Delivery in Computing Continuum
err2023-09-01
err2
PREAI
errYu, Guangba; Chen, Pengfei; Zheng, Zibin; Zhang, Jingrun; Li, Xiaoyun; He, Zilong
errShare
errSave
Brain: Log Parsing With Bidirectional Parallel Tree
err2023-09-01
err20
PREAI
errYu, Siyu; He, Pinjia; Chen, Ningjiang; Wu, Yifan
errShare
errSave
A study of the performance of general compressors on log files
err2020-08-12
err15
PREAI
errYao, Kundi; Li, Heng; Shang, Weiyi; Hassan, Ahmed E.
errShare
errSave
researcher View more