arrow
Return

Gaze-guided CT image retargeting by multi-attribute binary hashing

delete2024-03-01
delete1
PRE
AI
L
Luming Zhang *
M
Ming Chen
G
Guifeng Wang
Z
Zhigeng Pan
R
Roger Zimmerman
DOI:10.1016/j.inffus.2023.101961delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Computed tomography (CT) imaging is pervasively utilized for detecting tumors and internal body injuries. CT image retargeting means to horizontally/vertically shrink the semantically non-salient regions (e.g, the normal organs) while preserving the salient ones (e.g., the diseased organs) inside a CT image, as exemplified in Fig. 1. In practice, retargeting can substantially facilitate CT image displaying, which can benefit the subsequent medical treatment. In this work, we propose a bio-inspired CT image retargeting pipeline by mimicking human gaze behavior. More specifically, for each CT image, we extract the gaze shifting path (GSP) to capture human gaze distribution during the visual perception toward each CT image. Afterward, a multi-attribute binary hashing (MABH) is formulated to exploit the semantics of these GSPs. Thereby, each graphlet can be converted into the binary hash codes. Finally, the hash codes corresponding to GSP from each CT image are quantized into a feature vector, which is leveraged to learn a Gaussian mixture model (GMM) that guides CT image shrinking. In the experiments, to evaluate how gaze allocation influencing CT image retargeting, a user study is designed to compare the GSPs produced by normal observers and Alzheimer's patients respectively. Besides, a comparative study has verified the superiority of our method.
Keywords:
Machine learning
Multi-attribute
CT image
Retargeting
Matrix factorization

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.1K
Citations:
2.7W

Organization

J
Jinhua Polytechnic
Scholars:
70
Papers: 59
Citations: 323