arrow
Return

Study on eye-gaze input interface based on deep learning using images obtained by multiple cameras

delete2022-07-01
delete3
PRE
AI
S
Shenglin Mu *
S
Satoru SHIBATA
K
Kuo-chun Chiu
T
Tomonori YAMAMOTO
T
Tung-Kuan Liu
DOI:10.1016/j.compeleceng.2022.108040delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this research, an eye-gaze input interface with features of high accuracy, simplicity, low cost, and almost no possibilities in causing illness or damages to user's eyes is proposed using commercial web cameras in natural light environment. The system employs the Haar-like function in OpenCV library to detect the user's face and eyes. Following the preprocessing of grayscale and histogram equalization, the processed eye images of the user are applied to train the proposed Convolutional Neural Network (CNN) for the estimation of user's eye-gaze direction. Six types of camera layouts have been investigated in this research. The images from different camera layouts are merged and processed for the CNN training to estimate eye-gaze direction. According to experimental study using the proposed method, the improvement in accuracy confirmed. Meanwhile, the layout with highest accuracy and effectiveness among the proposed six layouts was confirmed.
Keywords:
Communication assistance
Eye-gaze input interface
Image processing
Convolutional neural network
Deep learning

Journal

C
Computers and Electrical Engineering
IF:
4.9
Papers:
6.7K
Citations:
1.3W

Organization

N
national kaohsiung university of science & technology
Scholars:
4.3K
Papers: 4.8K
Citations: 3
E
Ehime University
Scholars:
6.1K
Papers: 5.0K
Citations: 4.2K