.png){kind=icon}
返回
Large language model-based optical network log analysis using LLaMA2 with instruction tuning
.png){kind=icon}
PRE
AI
DOI：10.1364/JOCN.527874.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The optical network encompasses numerous devices and links, generating a significant volume of logs. Analyzing these logs is significant for network optimization, failure diagnosis, and health monitoring. However, the large-scale and diverse formats of optical network logs present several challenges, including the high cost and difficulty of manual processing, insufficient semantic understanding in existing analysis methods, and the strict requirements for data security and privacy. Generative artificial intelligence (GAI) with powerful language understanding and generation capabilities has the potential to address these challenges. Large language models (LLMs) as a concrete realization of GAI are well-suited for analyzing DCI logs, replacing human experts and enhancing accuracy. Additionally, LLMs enable intelligent interactions with network administrators, automating tasks and improving operational efficiency. Moreover, fine-tuning with open-source LLMs protects data privacy and enhances log analysis accuracy. Therefore, we introduce LLMs and propose a log analysis method with instruction tuning using LLaMA2 for log parsing, anomaly detection and classification, anomaly analysis, and report generation. Real log data extracted from the field-deployed network was used to design and construct instruction tuning datasets. We utilized the dataset for instruction tuning and demonstrated and evaluated the effectiveness of the proposed scheme. The results indicate that this scheme improves the performance of log analysis tasks, especially a 14% improvement in exact match rate for log parsing, a 13% improvement in F1-score for anomaly detection and classification, and a 23% improvement in usability for anomaly analysis, compared with the best baselines.
Keyword:
Optical fiber networks
Tuning
Anomaly detection
Security
Accuracy
Data models
Knowledge engineering
Semantics
Monitoring
Analytical models
期刊
IF:
4.3
论文数:
2.2K
被引数:
3.8K
机构
引用论文
.png){kind=icon}
1,2,4,5‐Benzenetetracarboxylic Acid and 4,4′‐Bipyridine as Ligands in Designing Low‐Dimensional Coordination Polymers1,2，4,5-苯四甲酸和4,4-联吡啶作为低维配位聚合物设计中的配体
PREAI
分享收藏Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks光网络中混合无监督/监督机器学习的自学异常检测
OAAI
OAAI分享收藏Origin and significance of diastolic Doppler flow signals in the left ventricular outflow tract二尖瓣口舒张期多普勒血流信号的起源及意义OAAI
OAAI分享收藏Sedimentology, stratigraphy, and paleoclimate at the late Miocene Coffee Ranch fossil site in the Texas Panhandle晚中新世德克萨斯州潘汉德尔地区的Coffee Ranch化石点的沉积学、地层学和古气候
PREAI
分享收藏Coronary artery fistula: Diagnosis by transesophageal two-dimensional and Doppler echocardiography冠状动脉瘘：经食管二维及多普勒超声心动图诊断
PREAI
分享收藏Relation of regional asynchrony to global left ventricular systolic and diastolic function in patients with angina pectoris without previous myocardial infarction.区域不同步与无先前心肌梗死史的心绞痛患者全球左心室收缩和舒张功能的关系。OAAI
OAAI分享收藏Accelerated Remote Consultation Tele-POCUS in Cardiopulmonary Assessment (ARCTICA)加速远程咨询远程POCUS在心肺评估中的应用 (ARCTICA)
OAAI
OAAI分享收藏
查看更多内容