arrow
Return

Predicting Visual Fixations

delete2023-09-15
delete11
delete
OA
AI
M
Matthias Kümmerer *
M
Matthias Bethge
DOI:10.1146/annurev-vision-120822-072528delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As we navigate and behave in the world, we are constantly deciding, a few times per second, where to look next. The outcomes of these decisions in response to visual input are comparatively easy to measure as trajectories of eye movements, offering insight into many unconscious and conscious visual and cognitive processes. In this article, we review recent advances in predicting where we look. We focus on evaluating and comparing models: How can we consistently measure how well models predict eye movements, and how can we judge the contribution of different mechanisms? Probabilistic models facilitate a unified approach to fixation prediction that allows us to use explainable information explained to compare different models across different settings, such as static and video saliency, as well as scanpath prediction. We review how the large variety of saliency maps and scanpath models can be translated into this unifying framework, how much different factors contribute, and how we can select the most informative examples for model comparison. We conclude that the universal scale of information gain offers a powerful tool for the inspection of candidate mechanisms and experimental design that helps us understand the continual decision-making process that determines where we look.
Keywords:
xations
eye movements
saliency
model comparison
information theory
benchmarking
transfer learning
unifying framework
taxonomy

Journal

Annual Review of Marine Science cover
Annual Review of Marine Science
IF:
18.9
Papers:
403
Citations:
7.0K

Organization

E
eberhard karls university of tubingen
Scholars:
3.3W
Papers: 2.5W
Citations: 38
Cited Papers

Cited Papers

cDNA expressed sequence tags of Trypanosoma brucei rhodesiense provide new insights into the biology of the parasite
err1995-07-01
err0
PREAI
errNajib M.A. El-Sayed; Clara M. Alarcon; John C. Beck; Val C. Sheffield; John E. Donelson
errShare
errSave
errShare
errSave
Asymmetrical Distribution of Brain Interleukin-6 Depends on Lateralization in Mice
err2005-05-17
err0
PREAI
errYan-Qin Shen; Guillaume Hébert; Elisabeth Moze; Kang-Sheng Li; Pierre J. Neveu
errShare
errSave
errShare
errSave
Assessing the Thermal Performance of Temporary Shelters
err2016-01-01
err0
errOAAI
errYing Yu; Enshen Long; Yuan Shen; Hongxing Yang
errShare
errSave
researcher View more