arrow
返回

Incorporating physics into data-driven computer vision

delete2023-06-01
delete8
PRE
AI
A
Achuta Kadambi *
C
Celso P. de Melo
C
Cho‐Jui Hsieh
M
Mani Srivastava
S
Stefano Soatto
DOI:10.1038/s42256-023-00662-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many computer vision techniques infer properties of our physical world from images. Although images are formed through the physics of light and mechanics, computer vision techniques are typically data driven. This trend is mostly performance related: classical techniques from physics-based vision often score lower on metrics compared with modern deep learning. However, recent research, covered in this Perspective, has shown that physical models can be included as a constraint into data-driven pipelines. In doing so, one can combine the performance benefits of a data-driven method with advantages offered from a physics-based method, such as intepretability, falsifiability and generalizability. The aim of this Perspective is to provide an overview into specific approaches for integrating physical models into artificial intelligence pipelines, referred to as physics-based machine learning. We discuss technical approaches that range from modifications to the dataset, network design, loss functions, optimization and regularization schemes. Although computer vision techniques are often data-driven, they can be enhanced by including the physical models underlying image formation as constraints. Achuta Kadambi et al. provide an overview of various techniques to incorporate physics into data-driven vision pipelines.

期刊

Nature Machine Intelligence 封面图
Nature Machine Intelligence
IF:
23.9
论文数:
1.3K
被引数:
1.5W

机构

U
university of california los angeles
学者数:
5.3W
论文数: 4.2W
被引数: 89
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

In SituRhamnolipid Production at an Abandoned Petroleum Refinery
err2010-06-24
err0
PREAI
errDaniel P. Cassidy; Andrew J. Hudak; D. Dale Werkema; Estella A. Atekwana; Silvia Rossbach; Joseph W. Duris; Eliot A. Atekwana; and William A. Sauck
err分享
err收藏
Influence of duration of focal cerebral ischemia and neuronal nitric oxide synthase on translocation of apoptosis-inducing factor to the nucleus
err2007-01-01
err0
errOAAI
errX. Li; M. Nemoto; Z. Xu; S.-W. Yu; M. Shimoji; S.A. Andrabi; J.-F. Haince; G.G. Poirier; T.M. Dawson; V.L. Dawson; R.C. Koehler
err分享
err收藏
Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
err分享
err收藏
err分享
err收藏
Large volume visualization of compressed time-dependent datasets on GPU clusters
err2005-02-01
err0
errOAAI
errM. Strengert; M. Magallón; D. Weiskopf; Stefan Guthe; T. Ertl
err分享
err收藏
学者 查看更多内容