.png){kind=icon}
.png){kind=icon}
Return
Portrait matting using an attention-based memory network
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-023-03061-z.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose a novel network to perform auxiliary-free video matting task. Unlike most existing approaches that require trimaps or pre-captured backgrounds as auxiliary inputs, our method uses binary segmentation masks as priors and realizes the auxiliary-free matting. Furthermore, we design the attention-based memory block by combining the idea of the memory network and self-attention to compute pixel-level temporal coherence among video frames to enhance the overall performance. Moreover, we also provide direct supervision for the temporal-guided memory module to boost the network's robustness. The validation results on various testing datasets show that our method outperforms several state-of-the-art auxiliary-free matting methods in terms of the alpha and foreground prediction quality and temporal consistency.
Keywords:
Auxiliary-free matting
Attention-based memory block
Self-attention
Memory network
Direct supervision
Journal
IF:
2.9
Papers:
4.6K
Citations:
6.5K