arrow
返回

Unstructured Big Data Threat Intelligence Parallel Mining Algorithm

delete2024-06-01
delete0
delete
OA
AI
Z
Zhihua Li
X
Xinye Yu
J
Junhao Qian *
DOI:10.26599/BDMA.2023.9020032delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To efficiently mine threat intelligence from the vast array of open-source cybersecurity analysis reports on the web, we have developed the Parallel Deep Forest-based Multi-Label Classification (PDFMLC) algorithm. Initially, open-source cybersecurity analysis reports are collected and converted into a standardized text format. Subsequently, five tactics category labels are annotated, creating a multi-label dataset for tactics classification. Addressing the limitations of low execution efficiency and scalability in the sequential deep forest algorithm, our PDFMLC algorithm employs broadcast variables and the Lempel-Ziv-Welch (LZW) algorithm, significantly enhancing its acceleration ratio. Furthermore, our proposed PDFMLC algorithm incorporates label mutual information from the established dataset as input features. This captures latent label associations, significantly improving classification accuracy. Finally, we present the PDFMLC-based Threat Intelligence Mining (PDFMLC-TIM) method. Experimental results demonstrate that the PDFMLC algorithm exhibits exceptional node scalability and execution efficiency. Simultaneously, the PDFMLC-TIM method proficiently conducts text classification on cybersecurity analysis reports, extracting tactics entities to construct comprehensive threat intelligence. As a result, successfully formatted STIX2.1 threat intelligence is established.
Keyword:
unstructured big data mining
parallel deep forest
multi-label classification algorithm
threat intelligence

期刊

Big Data Mining and Analytics 封面图
Big Data Mining and Analytics
IF:
6.2
论文数:
274
被引数:
1.0K

机构

J
Jiangnan University
学者数:
3.9W
论文数: 2.7W
被引数: 4.7W
引用论文

引用论文

Hepatic clearance and retention of aluminium: studies in the isolated perfused rat liver
err1996-12-01
err0
PREAI
errMichael Whihelm; Daphne E. Jaeger; Heike Schüll-Cablitz; Dieter Hafner; Helga Idel
err分享
err收藏
err分享
err收藏
Absence of aluminium in neurofibrillary tangles in Alzheimer's disease
err1998-01-01
err0
PREAI
errJagoda Makjanic; Brendan McDonald; Christopher Philip Li-Hsian Chen; Frank Watt
err分享
err收藏
BCSE: Blockchain-Based Trusted Service Evaluation Model over Big Data
err2022-03-01
err29
errOAAI
errLi, Fengyin; Yu, Xinying; Ge, Rui; Wang, Yanli; Cui, Yang; Zhou, Huiyu
err分享
err收藏
Application of Internet of Things in the Health Sector: Toward Minimizing Energy Consumption
err2022-12-01
err2
errOAAI
errMoutaib, Mohammed; Ahajjam, Tarik; Fattah, Mohammed; Farhaoui, Yousef; Aghoutane, Badraddine; El Bekkali, Moulhime
err分享
err收藏
A Cross-Layer Cooperative Jamming Scheme for Social Internet of Things
err2021-08-01
err18
errOAAI
errHuo, Yan; Fan, Jingjing; Wen, Yingkun; Li, Ruinian
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容