arrow
Return

Image inpainting based on sparse representation using self-similar joint sparse coding

delete2023-01-10
delete4
PRE
AI
张磊 (Lei Zhang) *
M
Minhui Chang
R
Rui Chen
DOI:10.1007/s11042-023-14337-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In order to improve the sparse coding ability of over-complete dictionary and take advantage of the similarity between damaged pixels and their neighbors, we propose an inpainting method based on sparse representation using self-similar joint sparse coding. First, we perform singular value decomposition on the gradient vector of the image patches, and then divide the image patches into three categories: smooth patches, edge patches and texture patches according to the relationship between the primary direction and the secondary direction. Second, we use the KSVD method to train these three types of image patches respectively, and obtain three over-complete dictionaries that adapt to different local features. Third, we define a non-local self-similar matching function and use it to search for the most similar image patch to the current patch in the target region, and then use the similar patch and the current patch for joint sparse coding. Finally, we use the calculated sparse coding and the corresponding over-complete dictionary to reconstruct the current patch. A series of experimental results show that the self-similar joint sparse coding we proposed can not only improve the restoration effect of sparse representation methods to a certain extent, but also has good adaptability and can be combined with other sparse representation methods to improve their restoration effect.
Keywords:
Image inpainting
Sparse representation
Self-similar
Joint sparse coding

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
1.9W
Citations:
3.2W

Organization

Y
Yuncheng University
Scholars:
352
Papers: 273
Citations: 0
Z
Zhengzhou University of Light Industry
Scholars:
6.4K
Papers: 4.0K
Citations: 5.4K