arrow
返回

Mitigating sensitive information leakage in LLMs4Code through machine unlearning

delete2026-01-22
delete0
PRE
AI
S
Shanzhi Gu
Z
Zhaoyang Qu
R
Ruotong Geng
M
Mingyang Geng
S
Shangwen Wang
C
Chuanfu Xu
H
Haotian Wang
Z
Zhipeng Lin
D
Dezun Dong
DOI:10.1016/j.neunet.2026.108606delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
• Machine unlearning is a promising way to simultaneously mitigate the privacy concerns of LLMs4Code while maintaining their code generation capabilities at the same time. Specifically, unlearning can decrease the leak rate of AIXCoder by more than 50% while only bringing a negligible side effect to code generation. • After unlearning, LLMs4Code learn to adopt diverse forms to prevent the leakage of sensitivities, in which the most popular one is to replace the sensitive fields with variable names and abbreviations. • After unlearning, LLMs4Code become more likely to leak the privacy indirectly, which means they tend to leak the information that is not explicitly queried. This suggests that future works should also take into consideration the indirect privacy leakage for a more robust unlearning process. • All code and data in this study are publicly available at https://doi.org/10.5281/zenodo.14729266 .

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

A
Academy of Military Sciences
学者数:
156
论文数: 54
被引数: 0
N
national university of defense technology
学者数:
5.0K
论文数: 1.5K
被引数: 0
B
bytedance
学者数:
88
论文数: 40
被引数: 3
学者 查看更多机构
引用论文

引用论文

IRCoCo: Immediate Rewards-Guided Deep Reinforcement Learning for Code Completion
err2024-07-12
err0
PREAI
errLi,Bolun; Sun,Zhihong; Huang,Tao; Zhang,Hongyu; Wan,Yao; Li,Ge; Jin,Zhi; Lyu,Chen
err分享
err收藏
err分享
err收藏
Efficient and Scalable Hybrid Parallelization of Unstructured Computational Fluid Dynamics with Geometric Multigrid
err2026-03-01
err2
PREAI
errXu, Cuanfu; Qiu, Haozhong; Deng, Liang; Zhang, Jian; Gao, Xiang; Fang, Jianbin; Wang, Qingsong; Ding, Yue; Wang, Yue; Han, Zhimeng; Che, Yonggang
err分享
err收藏
Zero-Shot Machine Unlearning零射机器学习
err2023-01-01
err16
errOAAI
errChundawat, Vikram S.; Tarun, Ayush K.; Mandal, Murari; Kankanhalli, Mohan
err分享
err收藏
DCSolver: Accelerating Sparse Iterative Solvers via Divide-and-Conquer on GPUs
err2025-09-30
err0
PREAI
errQiu,Haozhong; Xu,Chuanfu; Fang,Jianbin; Zhang,Jian; Deng,Liang; Dai,Zhe; Ding,Yue; Wang,Yue; Han,Zhimeng; Che,Yonggang; Liu,Jie
err分享
err收藏
err分享
err收藏
没有更多内容