arrow
Return

Mobile Eye-Tracking Data Analysis Using Object Detection via YOLO v4

delete2021-11-18
delete17
delete
OA
AI
N
Niharika Kumari
V
Verena Ruf
S
Sergey Mukhametov
A
Albrecht Schmidt
J
Jochen Kühn
S
Stefan Küchemann *
DOI:10.3390/s21227668delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Remote eye tracking has become an important tool for the online analysis of learning processes. Mobile eye trackers can even extend the range of opportunities (in comparison to stationary eye trackers) to real settings, such as classrooms or experimental lab courses. However, the complex and sometimes manual analysis of mobile eye-tracking data often hinders the realization of extensive studies, as this is a very time-consuming process and usually not feasible for real-world situations in which participants move or manipulate objects. In this work, we explore the opportunities to use object recognition models to assign mobile eye-tracking data for real objects during an authentic students' lab course. In a comparison of three different Convolutional Neural Networks (CNN), a Faster Region-Based-CNN, you only look once (YOLO) v3, and YOLO v4, we found that YOLO v4, together with an optical flow estimation, provides the fastest results with the highest accuracy for object detection in this setting. The automatic assignment of the gaze data to real objects simplifies the time-consuming analysis of mobile eye-tracking data and offers an opportunity for real-time system responses to the user's gaze. Additionally, we identify and discuss several problems in using object detection for mobile eye-tracking data that need to be considered.
Keywords:
eye movements
eye tracking
object detection
YOLO
Faster R-CNN
physics experiments
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

U
University of Munich
Scholars:
5.7W
Papers: 4.2W
Citations: 68
University of Kaiserslautern cover
University of Kaiserslautern
Scholars:
3.9K
Papers: 3.3K
Citations: 4.3K