arrow
Return

Saving Bits Using Multi-Sensor Collaboration

delete2023-01-01
delete0
delete
OA
AI
Z
Zhe Ji
H
Hui Lan
C
Cheolkon Jung *
D
Dan Zou
李明 cover
李明 (Ming Li)
DOI:10.1109/ACCESS.2023.3234917delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a new video coding method that saves bits using multi-sensor collaboration. Traditional video coding methods have saved bits by removing redundancy in videos. Recently, multiple types of sensors are being deployed to many solutions and multi-sensor data have significant advantages over single sensor data. The proposed method suggests a new way of video compression that saves bits using multi-sensor collaboration. We apply multi-sensor collaboration to the 3D video coding based on color and depth sensors. Based on the correlation between color and depth images, we design two networks CNN-US and CNN-QE in the proposed video coding method to achieve up-sampling and quality enhancement, respectively. The proposed method combines CNN-US and CNN-QE with 3D-HEVC to save bits using multi-sensor collaboration. Compared with 3D-HEVC anchor, the proposed method achieves average 5.9%, 66.8%, and 71.0% BD-rate reductions for sampling factors 1, 2, and 4 on the depth videos of 3D-HEVC test dataset, respectively.
Keywords:
Collaboration
Convolutional neural networks
Image color analysis
Image coding
Sensors
Three-dimensional displays
VIdeo coding
3D-HEVC
convolutional neural network
multi-sensor collaboration
redundancy
video coding

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

Deep edge map guided depth super resolution
err2021-01-01
err18
errOAAI
errJiang, Zhongyu; Yue, Huanjing; Lai, Yu-Kun; Yang, Jingyu; Hou, Yonghong; Hou, Chunping
errShare
errSave
Retromer localizes to autophagosomes during HCV replication
err2017-04-13
err0
errOAAI
errPeiqi Yin; Zhi Hong; Leiliang Zhang; Youyang Ke
errShare
errSave
MPEG Immersive Video Coding Standard
err2021-09-01
err61
errOAAI
errBoyce, Jill M.; Dore, Renaud; Dziembowski, Adrian; Fleureau, Julien; Jung, Joel; Kroon, Bart; Salahieh, Basel; Vadakital, Vinod Kumar Malamal; Yu, Lu
errShare
errSave
Participatory budget in Southern Brazil
err2003-07-18
err0
PREAI
errCênio B. Weyh; Danilo B. Streck
errShare
errSave
CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks
err2018-04-01
err38
errOAAI
errChen, Honggang; He, Xiaohai; Ren, Chao; Qing, Linbo; Teng, Qizhi
errShare
errSave
Self-learning residual model for fast intra CU size decision in 3D-HEVC
err2020-02-01
err8
PREAI
errLi, Yue; Zhu, Ningbo; Yang, Gaobo; Zhu, Yapei; Ding, Xiangling
errShare
errSave
1013-2007
err
IF0
err2007-01-01
err0
PREAI
err
errShare
errSave
N-Doped Graphene-Supported PtRu Direct Methanol Fuel Cell Electrocatalysts
err2013-10-27
err0
errOAAI
errSvitlana Pylypenko; Kevin Nathaniel Wood; Alexey Serov; Plamen Atanassov; Ryan O'Hayre
errShare
errSave
researcher View more