1
Return

BRAINHash: Brain-inspired Region-Aligned Interaction Network for unsupervised cross-modal hashing

delete2026-08-10
delete0
PRE
AI
H
Hao Fu
顾广华 (Guanghua Gu)
Y
Yunchao Wei
赵耀 (Yao Zhao)
DOI:10.1109/tip.2026.3719578delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unsupervised cross-modal hashing (UCMH) has attracted considerable attention owing to its minimal reliance on manual annotations and low retrieval latency. However, existing UCMH methods based on contrastive learning frameworks combined with multilayer perceptrons (MLPs) often suffer from two key limitations: the inherent challenge in constructing reliable positive-negative sample pairs under unsupervised settings, and the restricted representational capacity of static network architectures. Inspired by cognitive mechanisms observed in the human brain, where specialized regions support distinct roles in knowledge acquisition and error-driven learning, we propose a Brain-inspired Region-Aligned Interaction Network for unsupervised cross-modal Hashing (BRAINHash), which is a novel brain-inspired memory-based temporal modeling strategy. BRAINHash emulates several functional components of the brain through modular design choices: (1) diverse encoders approximate feature encoding akin to occipital lobe processing, (2) an error-aware optimization strategy models initial cross-modal association construction analogous to prefrontal cortex activity, (3) a teacher network serves as hippocampal-like memory storage capturing learned representations as persistent memory points, (4) we incorporate soft-target contrastive objectives alongside spiking neural network-based temporal modeling to simulate higher-order reasoning typically attributed to prefrontal decision-making circuits. To the best of our knowledge, BRAINHash represents the first integration of biologically inspired architectural principles with temporal dynamics into an unsupervised cross-modal hashing paradigm. Extensive evaluations conducted on five widely-used datasets demonstrate that our method outperforms fifteen state-of-the-art approaches. The implementation code is publicly available at https://github.com/YSU-ISU-Lab/BRAIN.
Keywords:
Unsupervised cross-modal hashing
spiking neural network
human cognitive learning
biological heuristic structure
soft-target contrastive learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

B
Beijing Jiaotong University
Scholars:
2.1W
Papers: 1.7W
Citations: 1.2W
Y
yanshan university
Scholars:
3.5K
Papers: 1.1K
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers