arrow
返回

Deep Learning-Based Thermal Image Reconstruction and Object Detection

delete2021-01-01
delete25
delete
OA
AI
G
Ganbayar Batchuluun
J
Jin Kyu Kang
D
Dat Tien Nguyen *
T
Tuyen Danh Pham
M
Muhammad Arsalan
K
Kang Ryoung Park
DOI:10.1109/ACCESS.2020.3048437delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Recently, thermal cameras are being widely used in various fields, such as intelligent surveillance, biometrics, and health monitoring. However, the high cost of the thermal cameras poses a challenge in terms of purchase. Additionally, thermal images have an issue pertaining to blurring caused by object movement, camera movement, and camera focus settings. There have been very few studies on image restoration centered around thermal images to address such problems. Moreover, it is important to increase the processing speed of image restoration methods to jointly conduct with methods such as action recognition and object tracking that use temporal information from thermal videos. However, no study has been conducted on simultaneously performing super-resolution reconstruction and deblurring using thermal images. Furthermore, existing studies on object detection using thermal images have errors owing to the incapability in distinguishing reflections on the surrounding ground or wall due to the heat radiated from the object. To address such issues, this study proposes a deep learning-based thermal image restoration method that simultaneously performs super-resolution reconstruction and deblurring. According to recent development of deep learning, generative adversarial network (GAN)-based methods which have ability to preserve texture details in images, and yield sharper and more plausible textures than classical feed forward encoders show success in image-to-image translation tasks. Considering the advantages of GAN, we propose a deblur-SRRGAN for thermal image reconstruction. In addition, we propose a light-weighted Mask R-CNN for object detection in the reconstructed thermal image. For the input, we employ an image processing method that converts 1-channel thermal images (often used in the existing studies) into 3-channel images. The results of the experiments conducted using self-collected databases and an open database demonstrate that our method outperforms the state-of-the-art methods.
Keyword:
Reflection
Cameras
Object detection
Image restoration
Image reconstruction
Thermal conductivity
Thermal degradation
Thermal image
deep learning
super-resolution reconstruction
image deblurring
object and thermal reflection detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

D
Dongguk University
学者数:
8.2K
论文数: 9.3K
被引数: 1.0W
引用论文

引用论文

B-Cell Depletion Therapy in Systemic Sclerosis: Experimental Rationale and Update on Clinical Evidence
err2011-01-01
err0
errOAAI
errDimitrios Daoussis; Stamatis-Nick C. Liossis; Georgios Yiannopoulos; Andrew P. Andonopoulos
err分享
err收藏
err分享
err收藏
A Study on the Elimination of Thermal Reflections
err2019-01-01
err5
errOAAI
errBatchuluun, Ganbayar; Yoon, Hyo Sik; Nguyen, Dat Tien; Pham, Tuyen Danh; Park, Kang Ryoung
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Body-movement-based human identification using convolutional neural network
err2018-07-01
err29
PREAI
errBatchuluun, Ganbayar; Naqvi, Rizwan Ali; Kim, Wan; Park, Kang Ryoung
err分享
err收藏
Region-Based Removal of Thermal Reflection Using Pruned Fully Convolutional Network
err2020-01-01
err11
errOAAI
errBatchuluun, Ganbayar; Baek, Na Rae; Dat Tien Nguyen; Tuyen Danh Pham; Park, Kang Ryoung
err分享
err收藏
学者 查看更多内容