arrow
返回

Multi-scale graph feature extraction network for panoramic image saliency detection

delete2023-04-11
delete2
PRE
AI
R
Ripei Zhang
C
Chunyi Chen *
彭军 封面图
彭军 (Jun Peng)
DOI:10.1007/s00371-023-02825-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The geometric distortion in panoramic images significantly mediates the performance of saliency detection method based on traditional CNN. The strategy of dynamically expanding convolution kernel can achieve good results, but it also produces a lot of computational overhead in the process of reading the adjacency list, which decreases the computational efficiency. The appearance of graph convolution provides a new way to solve such problems. Although using graph convolution can effectively extract the structural features of the graph, it reduces the accuracy of the model resulting from ignoring the spatial features of the image signal. To this end, this paper proposes a construction method of the multi-scale graph structure of the panoramic image and a panoramic image saliency detection model composed of an image saliency feature extraction network and multi-scale saliency feature fusion network combining the image structure information and spatial information in the panoramic image. First, we establish a graph structure consisting of root and leaf nodes obtained by super-pixel segmentation at different scales and spherical Fibonacci sampling, respectively. Then, a feature extraction network composed of two graph convolution layers and two one-dimensional auto-encoders with the same parameterization is used to extract the salient features of the multi-scale graph structure. Finally, the U-Net network fuses the multi-scale saliency features to get the final saliencymap. The results show that the proposed model performs better than the state-of-the-art-models in terms of calculation speed and accuracy.
Keyword:
Panoramic image
Saliency detection
Graph convolution
Super-pixel segmentation
Multi-scale fusion

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.7K
被引数:
6.5K

机构

C
changchun university of science & technology
学者数:
6.7K
论文数: 4.2K
被引数: 3
引用论文

引用论文

err分享
err收藏
Distinctive biophysical features of human cell-types: insights from studies of neurosurgically resected brain tissue
err2025-08-20
err0
errOAAI
errHomeira Moradi Chameh; Madeleine Falby; Mandana Movahed; Keon Arbabi; Scott Rich; Liang Zhang; Jérémie Lefebvre; Shreejoy J. Tripathy; Maurizio De Pittà; Taufik A. Valiante
err分享
err收藏
The prediction of head and eye movement for 360 degree images
err2018-11-01
err103
PREAI
errZhu, Yucheng; Zhai, Guangtao; Min, Xiongkuo
err分享
err收藏
Genodermatoses with Malignant Potential
err1987-01-01
err0
PREAI
errSusan B. Mallory; Dowling B. Stough
err分享
err收藏
The art of obtaining a high yield of cell-free DNA from urine
err2020-04-06
err0
errOAAI
errElien Augustus; Kaat Van Casteren; Laure Sorber; Peter van Dam; Geert Roeyen; Marc Peeters; Alex Vorsters; An Wouters; Jo Raskin; Christian Rolfo; Karen Zwaenepoel; Patrick Pauwels
err分享
err收藏
学者 查看更多内容