arrow
返回

Predicting Visual Fixations

delete2023-09-15
delete11
delete
OA
AI
M
Matthias Kümmerer *
M
Matthias Bethge
DOI:10.1146/annurev-vision-120822-072528delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As we navigate and behave in the world, we are constantly deciding, a few times per second, where to look next. The outcomes of these decisions in response to visual input are comparatively easy to measure as trajectories of eye movements, offering insight into many unconscious and conscious visual and cognitive processes. In this article, we review recent advances in predicting where we look. We focus on evaluating and comparing models: How can we consistently measure how well models predict eye movements, and how can we judge the contribution of different mechanisms? Probabilistic models facilitate a unified approach to fixation prediction that allows us to use explainable information explained to compare different models across different settings, such as static and video saliency, as well as scanpath prediction. We review how the large variety of saliency maps and scanpath models can be translated into this unifying framework, how much different factors contribute, and how we can select the most informative examples for model comparison. We conclude that the universal scale of information gain offers a powerful tool for the inspection of candidate mechanisms and experimental design that helps us understand the continual decision-making process that determines where we look.
Keyword:
xations
eye movements
saliency
model comparison
information theory
benchmarking
transfer learning
unifying framework
taxonomy

期刊

Annual Review of Marine Science 封面图
Annual Review of Marine Science
IF:
18.9
论文数:
403
被引数:
7.0K

机构

E
eberhard karls university of tubingen
学者数:
3.3W
论文数: 2.5W
被引数: 38
引用论文

引用论文

cDNA expressed sequence tags of Trypanosoma brucei rhodesiense provide new insights into the biology of the parasite
err1995-07-01
err0
PREAI
errNajib M.A. El-Sayed; Clara M. Alarcon; John C. Beck; Val C. Sheffield; John E. Donelson
err分享
err收藏
err分享
err收藏
Asymmetrical Distribution of Brain Interleukin-6 Depends on Lateralization in Mice
err2005-05-17
err0
PREAI
errYan-Qin Shen; Guillaume Hébert; Elisabeth Moze; Kang-Sheng Li; Pierre J. Neveu
err分享
err收藏
err分享
err收藏
Assessing the Thermal Performance of Temporary Shelters
err2016-01-01
err0
errOAAI
errYing Yu; Enshen Long; Yuan Shen; Hongxing Yang
err分享
err收藏
学者 查看更多内容