.png){kind=icon}
返回
Live Intrinsic Video
.png){kind=icon}
OA
AI
DOI：10.1145/2897824.2925907.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Intrinsic video decomposition refers to the fundamentally ambiguous task of separating a video stream into its constituent layers, in particular reflectance and shading layers. Such a decomposition is the basis for a variety of video manipulation applications, such as realistic recoloring or retexturing of objects. We present a novel variational approach to tackle this underconstrained inverse problem at real-time frame rates, which enables on-line processing of live video footage. The problem of finding the intrinsic decomposition is formulated as a mixed variational l(2)-l(p)-optimization problem based on an objective function that is specifically tailored for fast optimization. To this end, we propose a novel combination of sophisticated local spatial and global spatio-temporal priors resulting in temporally coherent decompositions at real-time frame rates without the need for explicit correspondence search. We tackle the resulting high-dimensional, non-convex optimization problem via a novel data-parallel iteratively reweighted least squares solver that runs on commodity graphics hardware. Real-time performance is obtained by combining a local-global solution strategy with hierarchical coarse-to-fine optimization. Compelling real-time augmented reality applications, such as recoloring, material editing and retexturing, are demonstrated in a live setup. Our qualitative and quantitative evaluation shows that we obtain high-quality real-time decompositions even for challenging sequences. Our method is able to outperform state-of-the-art approaches in terms of runtime and result quality - even without user guidance such as scribbles.
Keyword:
intrinsic decomposition
reflectance
shading
p-norm
real time
data-parallel optimization
recoloring
retexturing
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.5
论文数:
4.7K
被引数:
3.6W
机构
引用论文
.png){kind=icon}
分享收藏分享收藏Neighbourhood Regeneration by Facade Redesign: A Visual Experiment on Energy Efficiency and Aesthetics通过立面重新设计进行邻里再生: 关于能源效率和美学的视觉实验
OAAI
OAAI分享收藏Multiview Intrinsic Images of Outdoors Scenes with an Application to Relighting户外场景的多视图固有图像及其重新启动的应用OAAI
OAAI分享收藏
查看更多内容