arrow
Return

A Super-Resolution-Based Feature Map Compression for Machine-Oriented Video Coding

delete2023-01-01
delete3
delete
OA
AI
J
JungHeum Kang
M
Muhammad Salman Ali
H
Hyewon Jeong
C
Chang-Kyun Choi
Y
Younhee Kim
S
Seyoon Jeong
S
Sung‐Ho Bae
H
Hui Yong Kim *
DOI:10.1109/ACCESS.2023.3260223delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, video and image compression methods using neural networks have received much attention. In MPEG standardization, Video Coding for Machine (VCM) is a newly arising topic which attempts to compress features/images for the purpose of machine vision tasks. Especially, compressing features has advantages in terms of privacy protection and computation off-loading. In this paper, we propose an effective feature compression method equipped with a super-resolution (SR) module for features. Our main motivation comes from the observation that features are somewhat robust to spatial distortions (e.g., AWGN, blur, quantization distortions, coding artifacts), which leads us to integrating an SR module into the compression framework. We also further explore the best training strategy of the proposed method, i.e., finding the best combination of various losses and proper input feature shapes. Our comprehensive experiments show that the proposed method outperforms the baseline in the original VCM anchor scenario on various QP values with Versatile Video Coding (VVC). Specifically, the proposed framework achieved up to 50% BD-rate reduction compared to the conventional P-layer feature map compression method for the object detection task on the OpenImage dataset.
Keywords:
Versatile video codec
video coding for machine
feature compression
deep neural network
super resolution

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
kyung hee university
Scholars:
2.3W
Papers: 2.2W
Citations: 234
Cited Papers

Cited Papers

Molecular conformation of estramustine and two analogues.
err1992-03-01
err0
PREAI
errJ S Punzi; W L Duax; P Strong; J F Griffin; M M Flocco; D E Zacharias; H L Carrell; K D Tew; J P Glusker
errShare
errSave
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
err2019-08-01
err1.2K
errOAAI
errZhou, Zhi; Chen, Xu; Li, En; Zeng, Liekang; Luo, Ke; Zhang, Junshan
errShare
errSave
One step synthesis of PANI/Fe2O3 nanocomposites and flexible film for enhanced NH3 sensing performance at room temperature
err2019-04-08
err0
PREAI
errChonghui Zhu; Umut Cakmak; Ommeaymen Sheikhnejad; Xiaoli Cheng; Xianfa Zhang; Yingming Xu; Shan Gao; Hui Zhao; Lihua Huo; Zoltán Major
errShare
errSave
Binary-Classifiers-Enabled Filters for Semi-Supervised Learning
err2021-01-01
err16
errOAAI
errKumar, Teerath; Park, Jinbae; Ali, Muhammad Salman; Uddin, A. F. M. Shahab; Ko, Jong Hwan; Bae, Sung-Ho
errShare
errSave
researcher View more