.png){kind=icon}
.png){kind=icon}
Return
HRTF2MESH: 3D Human Ear Mesh Reconstruction Using Commodity Acoustic Devices
.png){kind=icon}
PRE
AI
N
B
R
DOI：10.1109/tmc.2026.3692571.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Capturing fine-grained 3D shapes and anthropometric features of human ears is a non-trivial and yet important task in a variety of applications. Existing approaches relying on specialized equipment such as high-definition 3D scanners or photogrammetry from RGB(-D) cameras are laborious in data acquisition and post-processing, and may perform poorly in case of occlusions from face and head covering, accessories, and the complex geometry of pinnae. Recognizing the strong dependency of acoustic anatomical transfer functions called Head-Related Transfer Functions (HRTFs) on the morphological features of pinnae, we develop HRTF2Mesh, a novel acoustic-based method for 3D human ear mesh reconstruction using commodity devices – a pair of earphone microphones and a smartphone device. HRTF2Mesh takes sparse acoustic measurement data from a subject, estimates and encodes the HRTFs as low-dimension vectors and then generates 3D mesh representation of their ear with the help of 3D morphable ear models. HRTF2Mesh has been evaluated using both public datasets and data collected from a diverse set of volunteers. Experiment results show that HRTF2Mesh achieves an average ear mesh estimation errors of 0.92 mm for test subjects in public datasets, and 1.70 mm amongst the volunteers. The data acquisition process of HRTF2Mesh can be completed under 5 minutes by a single user.
Keywords:
Acoustic sensing
head-related transfer functions
3D morphable models
commodity devices
Journal
IF:
9.2
Papers:
5.6K
Citations:
1.8W
Organization
Cited Papers