arrow
返回

Self-supervised Learning for Reading Activity Classification

delete2021-09-14
delete5
delete
OA
AI
M
Md. Rabiul Islam *
S
Shuji Sakamoto
Y
Yoshihiro Yamada
A
Andrew Vargo
M
Motoi Iwata
M
Masakazu Iwamura
K
Koichi Kise
DOI:10.1145/3478088delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reading analysis can relay information about user's confidence and habits and can be used to construct useful feedback. A lack of labeled data inhibits the effective application of fully-supervised Deep Learning (DL) for automatic reading analysis. We propose a Self-supervised Learning (SSL) method for reading analysis. Previously, SSL has been effective in physical human activity recognition (HAR) tasks, but it has not been applied to cognitive HAR tasks like reading. We first evaluate the proposed method on a four-class classification task on reading detection using electrooculography datasets, followed by an evaluation of a two-class classification task of confidence estimation on multiple-choice questions using eye-tracking datasets. Fully-supervised DL and support vector machines (SVMs) are used as comparisons for the proposed SSL method. The results show that the proposed SSL method is superior to the fully-supervised DL and SVM for both tasks, especially when training data is scarce. This result indicates the proposed method is the superior choice for reading analysis tasks. These results are important for informing the design of automatic reading analysis platforms.
Keyword:
Self-supervised learning
reading detection
confidence estimation
reading analysis
fully-supervised deep learning

期刊

P
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
IF:
4.5
论文数:
1.1K
被引数:
7.2K

机构

G
gopalganj science & technology university (gstu)
学者数:
488
论文数: 271
被引数: 0
引用论文

引用论文

Ghost target identification by analysis of the Doppler distribution in automotive scenarios
err2017-06-01
err0
errOAAI
errFabian Roos; Mohammadreza Sadeghi; Jonathan Bechter; Nils Appenrodt; Jurgen Dickmann; Christian Waldschmidt
err分享
err收藏
SEPARATION OF THE METALLIC AND DIELECTRIC LOSSES OF TUNABLE FERROELECTRIC CAPACITORS UNDER CONTROL DC VOLTAGE在受控直流电压下可调铁电电容器的金属和介电损耗的分离
err2018-01-01
err0
errOAAI
errIgor V. Kotelnikov; Vitaly N. Osadchy; Roman Andreevich Platonov; Andrey G. Altynnikov; Valentina V. Medvedeva; Anatoly K. Mikhailov; Aleksandr G. Gagarin; Andrey V. Tumarkin; Andrey B. Kozyrev
err分享
err收藏
Multicenter Phase II Study of Bimonthly High-Dose Leucovorin, Fluorouracil Infusion, and Oxaliplatin for Metastatic Colorectal Cancer Resistant to the Same Leucovorin and Fluorouracil Regimen
err1999-11-01
err0
PREAI
errThierry André; Mohamed A. Bensmaine; Christophe Louvet; Eric François; Virginie Lucas; Françoise Desseigne; Karine Beerblock; Olivier Bouché; Elisabeth Carola; Yacine Merrouche; François Morvan; Ghislaine Dupont-André; Aimery de Gramont
err分享
err收藏
Improving robot navigation through self-supervised Online learning
err2007-01-23
err60
errOAAI
errSofman, Boris; Lin, Ellie; Bagnell, J. Andrew; Cole, John; Vandapel, Nicolas; Stentz, Anthony
err分享
err收藏
学者 查看更多内容