返回
Multi-scale graph feature extraction network for panoramic image saliency detection
DOI:10.1007/s00371-023-02825-x.png)
摘要
En 中文
The geometric distortion in panoramic images significantly mediates the performance of saliency detection method based on traditional CNN. The strategy of dynamically expanding convolution kernel can achieve good results, but it also produces a lot of computational overhead in the process of reading the adjacency list, which decreases the computational efficiency. The appearance of graph convolution provides a new way to solve such problems. Although using graph convolution can effectively extract the structural features of the graph, it reduces the accuracy of the model resulting from ignoring the spatial features of the image signal. To this end, this paper proposes a construction method of the multi-scale graph structure of the panoramic image and a panoramic image saliency detection model composed of an image saliency feature extraction network and multi-scale saliency feature fusion network combining the image structure information and spatial information in the panoramic image. First, we establish a graph structure consisting of root and leaf nodes obtained by super-pixel segmentation at different scales and spherical Fibonacci sampling, respectively. Then, a feature extraction network composed of two graph convolution layers and two one-dimensional auto-encoders with the same parameterization is used to extract the salient features of the multi-scale graph structure. Finally, the U-Net network fuses the multi-scale saliency features to get the final saliencymap. The results show that the proposed model performs better than the state-of-the-art-models in terms of calculation speed and accuracy.
Keyword:
Panoramic image
Saliency detection
Graph convolution
Super-pixel segmentation
Multi-scale fusion
期刊
IF:
2.9
论文数:
4.7K
被引数:
6.5K
机构
引用论文
A comparative study on factors of social welfare service utilization between general and low-income group关于一般群体与低收入群体社会福利服务利用因素的比较研究
DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye FixationsDeepFix: 一种用于预测人眼注视的完全卷积神经网络

