arrow
返回

Portrait matting using an attention-based memory network

delete2023-09-11
delete1
PRE
AI
S
Shufeng Song
L
Lap‐Pui Chau *
Z
Zhiping Lin
DOI:10.1007/s00371-023-03061-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a novel network to perform auxiliary-free video matting task. Unlike most existing approaches that require trimaps or pre-captured backgrounds as auxiliary inputs, our method uses binary segmentation masks as priors and realizes the auxiliary-free matting. Furthermore, we design the attention-based memory block by combining the idea of the memory network and self-attention to compute pixel-level temporal coherence among video frames to enhance the overall performance. Moreover, we also provide direct supervision for the temporal-guided memory module to boost the network's robustness. The validation results on various testing datasets show that our method outperforms several state-of-the-art auxiliary-free matting methods in terms of the alpha and foreground prediction quality and temporal consistency.
Keyword:
Auxiliary-free matting
Attention-based memory block
Self-attention
Memory network
Direct supervision

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Edge-Sensitive Human Cutout With Hierarchical Granularity and Loopy Matting Guidance
err2020-01-01
err11
PREAI
errYe, Jingwen; Jing, Yongcheng; Wang, Xinchao; Ou, Kairi; Tao, Dacheng; Song, Mingli
err分享
err收藏
err分享
err收藏
Vitamin D deficiency and exercise-induced laryngospasm in young competitive rowers
err2016-07-01
err0
PREAI
errEnrico Heffler; Matteo Bonini; Luisa Brussino; Paolo Solidoro; Giuseppe Guida; Monica Boita; Giuliana Nicolosi; Caterina Bucca
err分享
err收藏
Symbolic Interaction Theory and Architecture
err2011-12-22
err0
errOAAI
errRonald W. Smith; Valerie Bugni
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容