arrow
返回

Multimodal Face-Pose Estimation With Multitask Manifold Deep Learning

delete2019-07-01
delete262
delete
OA
AI
洪朝群 封面图
洪朝群 (Chaoqun Hong)
J
Jun Yu *
张
张剑 (Jian Zhang)
金雄男 封面图
金雄男 (Xiongnan Jin)
K
Kyong-Ho Lee
DOI:10.1109/TII.2018.2884211delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Face-pose estimation aims at estimating the gazing direction with two-dimensional face images. It gives important communicative information and visual saliency. However, it is challenging because of lights, background, face orientations, and appearance visibility. Therefore, a descriptive representation of face images and mapping it to poses are critical. In this paper, we use multimodal data and propose a novel face-pose estimation framework named multitask manifold deep learning ((MDL)-D-2). It is based on feature extractionwith improved convolutional neural networks (CNNs) and multimodal mapping relationship with multitask learning. In the proposed CNNs, manifold regularized convolutional layers learn the relationship between outputs of neurons in a low-rank space. Besides, in the proposed mapping relationship learning method, different modals of face representations are naturally combined by applying multitask learning with incoherent sparse and low-rank learning with a least-squares loss. Experimental results on three challenging benchmark datasets demonstrate the performance of (MDL)-D-2.
Keyword:
Convolutional neural networks (CNNs)
face-pose estimation
low-rank learning
multitask learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Industrial Informatics 封面图
IEEE Transactions on Industrial Informatics
IF:
9.9
论文数:
8.6K
被引数:
6.0W

机构

Z
zhejiang international studies university
学者数:
192
论文数: 206
被引数: 3
H
Hangzhou Dianzi University
学者数:
1.3W
论文数: 9.6K
被引数: 7.5K
X
Xiamen University of Technology
学者数:
3.9K
论文数: 2.5K
被引数: 5.1K
Y
Yonsei University
学者数:
4.8W
论文数: 4.6W
被引数: 5.2W
学者 查看更多机构
引用论文

引用论文

Effect of particle size on the suction mechanism in granular grippers
err2023-01-24
err0
errOAAI
errAngel Santarossa; Olfa D’Angelo; Achim Sack; Thorsten Pöschel
err分享
err收藏
Funnel-structured cascade for multi-view face detection with alignment awareness
err2017-01-01
err85
errOAAI
errWu, Shuzhe; Kan, Meina; He, Zhenliang; Shan, Shiguang; Chen, Xilin
err分享
err收藏
Wind Turbine Gearbox Failure Identification With Deep Neural Networks
err2017-06-01
err283
PREAI
errWang, Long; Zhang, Zijun; Long, Huan; Xu, Jia; Liu, Ruihua
err分享
err收藏
err分享
err收藏
Nanomaterials for decontamination of organophosphorus compounds in soil
err2021-01-01
err0
PREAI
errJeyabalan Sangeetha; Arun Kashivishwanath Shettar; Devarajan Thangadurai; Charles Oluwaseun Adetunji; Saher Islam; Abdel Rahman Mohammad Said Al-Tawaha
err分享
err收藏
Exploring Transfer Learning Approaches for Head Pose Classification from Multi-view Surveillance Images
err2013-12-24
err38
PREAI
errRajagopal, Anoop Kolar; Subramanian, Ramanathan; Ricci, Elisa; Vieriu, Radu L.; Lanz, Oswald; Kalpathi, Ramakrishnan R.; Sebe, Nicu
err分享
err收藏
Intelligent detection of loose fasteners in railway tracks using distributed acoustic sensing and machine learning
err2024-08-01
err0
PREAI
errChengjia Han; Shun Wang; Aayush Madan; Chaoyang Zhao; Lipi Mohanty; Yuguang Fu; Wei Shen; Ruihua Liang; Ean Seong Huang; Tony Zheng; Phui Kai Ong; Alvin Zhang; Khai Jhin Woon; Kai Xin Wong; Yaowen Yang
err分享
err收藏
学者 查看更多内容