arrow
返回

Mobile Eye-Tracking Data Analysis Using Object Detection via YOLO v4

delete2021-11-18
delete17
delete
OA
AI
N
Niharika Kumari
V
Verena Ruf
S
Sergey Mukhametov
A
Albrecht Schmidt
J
Jochen Kühn
S
Stefan Küchemann *
DOI:10.3390/s21227668delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Remote eye tracking has become an important tool for the online analysis of learning processes. Mobile eye trackers can even extend the range of opportunities (in comparison to stationary eye trackers) to real settings, such as classrooms or experimental lab courses. However, the complex and sometimes manual analysis of mobile eye-tracking data often hinders the realization of extensive studies, as this is a very time-consuming process and usually not feasible for real-world situations in which participants move or manipulate objects. In this work, we explore the opportunities to use object recognition models to assign mobile eye-tracking data for real objects during an authentic students' lab course. In a comparison of three different Convolutional Neural Networks (CNN), a Faster Region-Based-CNN, you only look once (YOLO) v3, and YOLO v4, we found that YOLO v4, together with an optical flow estimation, provides the fastest results with the highest accuracy for object detection in this setting. The automatic assignment of the gaze data to real objects simplifies the time-consuming analysis of mobile eye-tracking data and offers an opportunity for real-time system responses to the user's gaze. Additionally, we identify and discuss several problems in using object detection for mobile eye-tracking data that need to be considered.
Keyword:
eye movements
eye tracking
object detection
YOLO
Faster R-CNN
physics experiments
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.1W
被引数:
20.9W

机构

U
University of Munich
学者数:
5.7W
论文数: 4.2W
被引数: 68
University of Kaiserslautern 封面图
University of Kaiserslautern
学者数:
3.9K
论文数: 3.3K
被引数: 4.3K