.png){kind=icon}
返回
Smartphone-based eye tracking system using edge intelligence and model optimisation
.png){kind=icon}
OA
AI
DOI：10.1016/j.iot.2024.101481.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A significant limitation of current smartphone-based eye-tracking algorithms is their low accuracy when applied to video-type visual stimuli, as they are typically trained on static images. Also, the increasing demand for real-time interactive applications like games, VR, and AR on smartphones requires overcoming the limitations posed by resource constraints such as limited computational power, battery life, and network bandwidth. Therefore, we developed two new smartphone eye-tracking techniques for video-type visuals by combining Convolutional Neural Networks (CNN) with two different Recurrent Neural Networks (RNN), namely Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU). Our CNN+LSTM and CNN+GRU models achieved an average Root Mean Square Error of 0.955 cm and 1.091 cm, respectively. To address the computational constraints of smartphones, we developed an edge intelligence architecture to enhance the performance of smartphone-based eye tracking. We applied various optimisation methods like quantisation and pruning to deep learning models for better energy, CPU, and memory usage on edge devices, focusing on real-time processing. Using model quantisation, the model inference time in the CNN+LSTM and CNN+GRU models was reduced by 21.72% and 19.50%, respectively, on edge devices.
Keyword:
Eye tracking
Edge intelligence
Deep learning
Quantisation
Pruning
Energy consumption
Memory usage
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
2.0K
被引数:
6.9K
机构
引用论文
Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM使用MobileNet V2和LSTM的深度学习神经网络对皮肤病进行分类.png)
SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏SBA-15:TiO2 nanocomposites: II. Direct and post-synthesis using acetylacetoneSBA-15:TiO2纳米复合材料: II。使用乙酰丙酮的直接和后合成
PREAI
分享收藏An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices注视估计的端到端综述及其在手持移动设备上的交互式应用
OAAI
OAAI分享收藏A Novel CNN-GRU-Based Hybrid Approach for Short-Term Residential Load Forecasting基于cnn-gru的短期住宅负荷预测新方法IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏
查看更多内容