arrow
Return

Generalized face super-resolution

delete2008-06-01
delete111
delete
OA
AI
K
Kui Jia *
S
Shaogang Gong
DOI:10.1109/TIP.2008.922421delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing learning-based face super-resolution (hallucination) techniques generate high-resolution images of a single facial modality (i.e., at a fixed expression, pose and illumination) given one or set of low-resolution face images as probe. Here, we present a generalized approach based on a hierarchical tensor (multilinear) space representation for hallucinating high-resolution face images across multiple modalities, achieving generalization to variations in expression and pose. In particular, we formulate a unified tensor which can be reduced to two parts: a global image-based tensor for modeling the mappings among different facial modalities, and a local patch-based multiresolution tensor for incorporating high-resolution image details. For realistic hallucination of unregistered low-resolution faces contained in raw images, we develop an automatic face alignment algorithm capable of pixel-wise alignment by iteratively warping the probing face to its projection in the space of training face images. Our experiments show not only performance superiority over existing benchmark face super-resolution techniques on single modal face hallucination, but also novelty of our approach in coping with multimodal hallucination and its robustness in automatic alignment under practical imaging conditions.
Keywords:
face hallucination
super-resolution
tensor

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

S
shenzhen institute of advanced technology, cas
Scholars:
5.6K
Papers: 4.5K
Citations: 7
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Learning low-level vision
err2000-01-01
err1.2K
PREAI
errFreeman, WT; Pasztor, EC; Carmichael, OT
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
SARS COV-2 anti-nucleocapsid and anti-spike antibodies in an emergency department healthcare worker cohort: September 2020 – April 2021
err2022-04-01
err0
errOAAI
errRalph C. Wang; Charles E. Murphy; Aaron E. Kornblith; Nicole A. Hohenstein; Cornelius M. Carter; Angela H.K. Wong; Theodore Kurtz; Michael A. Kohn
errShare
errSave
errShare
errSave
Profiling of genes associated with transcriptional responses in mouse hippocampus after transient forebrain ischemia using high-density oligonucleotide DNA array
err2004-02-01
err0
PREAI
errToshihito Nagata; Yasuo Takahashi; Megumi Sugahara; Akiko Murata; Yayoi Nishida; Koichi Ishikawa; Satoshi Asai
errShare
errSave
Phosphate Phosphors for Solid-State Lighting
err2012-01-01
err0
errOAAI
errKartik N. Shinde; S.J. Dhoble; H.C. Swart; Kyeongsoon Park
errShare
errSave
Face hallucination: Theory and practice
err2007-02-15
err345
PREAI
errLiu, Ce; Shum, Heung-Yeung; Freeman, William T.
errShare
errSave
researcher View more