arrow
返回

Multi-Task Prediction Method for User Behavior Utilizing Transformers

delete2025-11-01
delete0
PRE
AI
李珂 封面图
李珂 (Ke Li)
F
Fang, Huan *
S
Shao, Chifeng
X
Xu, Yifei
DOI:10.20965/jaciii.2025.p1507delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pattern recognition of user behavior plays an important role in extracting portrait, and critical event sequence extraction is also valuable. Addressing these two issues, an approach of Transformer-based multitask user behavior prediction is investigated in this paper, named LogSeqTrans model, to enhance the accuracy of predicting user actions and extract critical event sequences. By serializing user behavior data and employing information entropy to identify key events, the proposed LogSeqTrans model processes data through an embedding layer, an encoding layer, and an output layer. The embedding layer converts events and their temporal information into high-dimensional vectors. The encoding layer leverages a multi-head self-attention mechanism to capture sequence dependencies, while the output layer simultaneously predicts behavior types, event occurrence times, and remaining durations. Experimental results demonstrate that the proposed model surpasses other models across three open datasets. Specifically, the average accuracy of LogSeqTrans model for the next activity prediction task significantly outperforming alternative models; Similarly, in the tasks of predicting the next activity occurrence time and the remaining time, the mean absolute errors of LogSeqTrans model are all outperforming comparative models. These results indicate that LogSeqTrans is highly effective in multi-task prediction and capturing complex sequence patterns.
Keyword:
user behavior portrait
critical events extraction
log serialization
multi-task prediction
Transformer

期刊

J
Journal of Advanced Computational Intelligence and Intelligent Informatics
IF:
0.8
论文数:
87
被引数:
626

机构

暂无机构信息
引用论文

引用论文

Activity Prediction of Business Process Instances with Inception CNN Models
err2019-11-12
err0
PREAI
errNicola Di Mauro; Annalisa Appice; Teresa M. A. Basile
err分享
err收藏
An Asymptotic Statistical Learning Algorithm for Prediction of Key Trading Events
err2020-03-01
err6
PREAI
errYin, Jianfei; Wang, Ruili; Ju, Shunda; Bai, Yizhe; Huang, Joshua Zhexue
err分享
err收藏
Neural Collaborative Filtering
err2017-04-03
err0
errOAAI
errXiangnan He; Lizi Liao; Hanwang Zhang; Liqiang Nie; Xia Hu; Tat-Seng Chua
err分享
err收藏
MTLFormer: Multi-Task Learning Guided Transformer Network for Business Process Prediction
err2023-01-01
err2
errOAAI
errWang, Jiaojiao; Huang, Jiawei; Ma, Xiaoyu; Li, Zhongjin; Wang, Yaqi; Yu, Dingguo
err分享
err收藏
学者 查看更多内容