Enhancing Visual Coding Through Collaborative Perception

doi:10.1109/TCDS.2022.3203422

Enhancing Visual Coding Through Collaborative Perception

2023-12-01

1

OA

AI

DOI：10.1109/TCDS.2022.3203422

Original

Original request for help

Save

Abstract

En 中文

A central challenge facing the nature human-computer interaction involves understanding how neural circuits process visual perceptual information to improve the user's operation ability under complex tasks. Visual coding models aim to explore the biological characteristics of retinal ganglion cells to provide quantitative predictions of responses to a range of visual stimuli. The existing visual coding models lack adaptability in natural and complex scenes. Therefore this article proposes an enhanced visual coding model through collaborative perception. Our model first extracts the multimodal spatiotemporal features of the input video to simulate the retinal response characteristics adaptively. Second, it uses the basis function to compile the input stimulus into a multimodal stimulus matrix. Afterward, the upstream and downstream filters reform the stimulus matrix to generate the spike sequence. Experiments show that the proposed model reproduces the physiological characteristics of ganglion cells in the biological retina, leading to the high accuracy, good adaptability, and biological interpretability in comparison with its rivals.

Keywords:

Feature compilation

multimodal stimulus

nonlinearity

visual coding

Enhancing Visual Coding Through Collaborative Perception

Abstract

Journal

Organization