arrow
Return

SecNLP: An NLP classification model watermarking framework based on multi-task learning

delete2024-06-01
delete2
PRE
AI
L
Long Dai
J
Jiarong Mao
L
Liaoran Xu
X
Xuefeng Fan
DOI:10.1016/j.csl.2023.101606delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
The popularity of ChatGPT demonstrates the immense commercial value of natural language processing (NLP) technology. However, NLP models like ChatGPT are vulnerable to piracy and redistribution, which can harm the economic interests of model owners. Existing NLP model watermarking schemes struggle to balance robustness and covertness. Typically, robust watermarks require embedding more information, which compromises their covertness; conversely, covert watermarks are challenging to embed more information, which affects their robustness. This paper is proposed to use multi-task learning (MTL) to address the conflict between robustness and covertness. Specifically, a covert trigger set is established to implement remote verification of the watermark model, and a covert auxiliary network is designed to enhance the watermark model's robustness. The proposed watermarking framework is evaluated on two benchmark datasets and three mainstream NLP models. Compared with existing schemes, the framework not only has excellent covertness and robustness but also has a lower false positive rate and can effectively resist fraudulent ownership claims by adversaries.
Keywords:
Natural language processing
NLP model security
Black-box watermarking
White-box watermarking

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

H
Hainan University
Scholars:
2.0W
Papers: 1.2W
Citations: 1.9W
Cited Papers

Cited Papers

errShare
errSave
A Backdoor Attack Against LSTM-Based Text Classification Systems
err2019-01-01
err133
errOAAI
errDai, Jiazhu; Chen, Chuanshuai; Li, Yufeng
errShare
errSave
Coming undone: hemiparasite presence and effects in a prairie grassland diminish over time
err2019-06-27
err0
PREAI
errVictoria A. Borowicz; Morgan R. Walder; Joseph E. Armstrong
errShare
errSave
Evolution of Organic Aerosols in the Atmosphere
err2009-12-11
err0
PREAI
errJ. L. Jimenez; M. R. Canagaratna; N. M. Donahue; A. S. H. Prevot; Q. Zhang; J. H. Kroll; P. F. DeCarlo; J. D. Allan; H. Coe; N. L. Ng; A. C. Aiken; K. S. Docherty; I. M. Ulbrich; A. P. Grieshop; A. L. Robinson; J. Duplissy; J. D. Smith; K. R. Wilson; V. A. Lanz; C. Hueglin; Y. L. Sun; J. Tian; A. Laaksonen; T. Raatikainen; J. Rautiainen; P. Vaattovaara; M. Ehn; M. Kulmala; J. M. Tomlinson; D. R. Collins; M. J. Cubison; J. Dunlea; J. A. Huffman; T. B. Onasch; M. R. Alfarra; P. I. Williams; K. Bower; Y. Kondo; J. Schneider; F. Drewnick; S. Borrmann; S. Weimer; K. Demerjian; D. Salcedo; L. Cottrell; R. Griffin; A. Takami; T. Miyoshi; S. Hatakeyama; A. Shimono; J. Y Sun; Y. M. Zhang; K. Dzepina; J. R. Kimmel; D. Sueper; J. T. Jayne; S. C. Herndon; A. M. Trimborn; L. R. Williams; E. C. Wood; A. M. Middlebrook; C. E. Kolb; U. Baltensperger; D. R. Worsnop
errShare
errSave
Molecular epidemiology of Newcastle disease in Republic of Korea
err2003-08-01
err0
PREAI
errHyuk-Joon Kwon; Sun-Hee Cho; Young-Jin Ahn; Seung-Hee Seo; Kang-Seuk Choi; Sun-Joong Kim
errShare
errSave
errShare
errSave
researcher View more