Facial Expression Recognition with Active Local Shape Pattern and Learned-Size Block Representations

doi:10.1109/TAFFC.2020.2995432

2022-07-01

PRE

Md. Tauhid Bin Iqbal

Byungyong Ryu

Adıń Ramıŕez Rivera

Farkhod Makhmudkhujaev

Oksam Chae

Sung‐Ho Bae *

DOI：10.1109/TAFFC.2020.2995432

原文链接

原文求助

摘要

En 中文

Facial expression recognition has been studied broadly, and several works using local micro-pattern descriptors have obtained significant results. There are, however, open questions: how to design a discriminative and robust feature descriptor?, how to select expression-related most influential features?, and how to represent the face descriptor exploiting the most salient parts of the face? In this article, we address these three issues to achieve better performance in recognizing facial expressions. First, we propose a new feature descriptor, namely Local Shape Pattern (LSP), that describes the local shape structure of a pixel's neighborhood based on the prominent directional information by analyzing the statistics of the neighborhood gradient, which allows it to be robust against subtle local noise and distortion. Furthermore, we propose a selection strategy for learning the influential codes being active in the expression affiliated changes by selecting them exhibiting statistical dominance and high spatial variance. Lastly, we learn the size of the salient facial blocks to represent the facial description with the notion that changes in expressions vary in size and location. We conduct person-independent experiments in existing datasets after combining above three proposals, and obtain an improved performance for the facial expression recognition task.

Keyword:

Shape

Face

Histograms

Face recognition

Robustness

Feature extraction

Local shape pattern

LSP

orientlets

active codes

learned-size block representation