arrow
Return

De-END: Decoder-Driven Watermarking Network

delete2023-01-01
delete6
delete
OA
AI
H
Han Fang
Z
Zhaoyang Jia
Y
Yupeng Qiu
J
Jiyi Zhang
张卫明 (Weiming Zhang) *
E
Ee‐Chien Chang *
DOI:10.1109/TMM.2022.3223559delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep-learning-based watermarking technique is being extensively studied. Most existing approaches adopt a similar encoder-driven scheme which we name END (Encoder-NoiseLayer-Decoder) architecture. In this paper, we revamp the architecture and creatively design a decoder-driven watermarking network dubbed De-END which greatly outperforms the existing END-based methods. The motivation for designing De-END originated from the potential drawback we discovered in END architecture: The encoder may embed redundant features that are not necessary for decoding, limiting the performance of the whole network. We conducted a detailed analysis and found that such limitations are caused by unsatisfactory coupling between the encoder and decoder in END. De-END addresses such drawbacks by adopting a Decoder -Encoder-Noiselayer-Decoder architecture. In De-END, the host image is firstly processed by the decoder to generate a latent feature map instead of being directly fed into the encoder. This latent feature map is concatenated to the original watermark message and then processed by the encoder. This change in design is crucial as it makes the feature of encoder and decoder directly shared thus the encoder and decoder are better coupled. We conducted extensive experiments and the results show that this framework outperforms the existing state-of-the-art (SOTA) END-based deep learning watermarking both in visual quality and robustness. On the premise of the same decoder structure, the visual quality (measured by PSNR) of De-END improves by 1.6dB (45.16dB to 46.84dB), and extraction accuracy after JPEG compression (QF=50) distortion outperforms more than 4% (94.9% to 99.1%).
Keywords:
Decoding
Watermarking
Feature extraction
Robustness
Transform coding
Distortion
Visualization
Deep-learning Watermarking
decoder-driven

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

N
National University of Singapore
Scholars:
7.5W
Papers: 6.4W
Citations: 11.4W
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704