Paper
29 April 2022 LSTM-based eye-movement trajectory analysis for reading behavior classification
Ahmad Hassan, Wei Fan, Xiaoyu Hu, Wenhao Wang, Hanxi Li
Author Affiliations +
Proceedings Volume 12247, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2022); 1224715 (2022) https://doi.org/10.1117/12.2636952
Event: 2022 International Conference on Image, Signal Processing, and Pattern Recognition, 2022, Guilin, China
Abstract
Studying eye movement trajectory through eye tracker can provide insights into classification mechanism of memory and reasoning. For the given text or images, memory and reasoning based observations are useful in multiple key areas of psychology, cognition and related fields. For our project, the EyeLink 1000 Plus is used to inspect and capture fixation, saccades, blinks etc. in eye tracking protocols of each participant during trials. Based on fixation sequence of each participant our trained deep recurrent neural network architecture–LSTM classifies whether a participant is performing the given text-based task by memorizing it or by inference. To set trial sentences, syllogism– deductive reasoning type is followed. Sixty university students (mature readers) participated in both memory and reasoning-based trials. Participants were then divided into two equal groups and of which one group was instructed to perform memory task first while the second group was instructed to perform reasoning based task first and then their order of performing the given task was changed. From sixty-one different sentences, sixty randomly selected sentences were presented to each participant. Sequential signals from fixation of each participant were then processed to get the results. Our trained LSTM model’s high accuracy to classify the memory and the reasoning based reading of participants ensures the significance of our work which will provide a solid base for future works on eye movements to build intelligent techniques in the field of A.I backed psychology, healthcare and neuro-marketing. Our trained model has the potential for (a) achieving very high accuracy for memory and reasoning classification, (b) for data learning, it saves enormous time, (c) Economical and comfortable for trials to record data via EyeLink 1000 plus (d) and finally, possible future work opportunities are enlisted.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ahmad Hassan, Wei Fan, Xiaoyu Hu, Wenhao Wang, and Hanxi Li "LSTM-based eye-movement trajectory analysis for reading behavior classification", Proc. SPIE 12247, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2022), 1224715 (29 April 2022); https://doi.org/10.1117/12.2636952
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Eye models

Psychology

Information visualization

Visualization

Optical tracking

Signal processing

RELATED CONTENT

New sensor for automatic guidance
Proceedings of SPIE (October 01 1990)
A perceptual preprocess method for 3D-HEVC
Proceedings of SPIE (August 05 2015)
Limiting human perception for image sequences
Proceedings of SPIE (April 22 1996)
A visualization framework for design and evaluation
Proceedings of SPIE (January 16 2006)
Color stabilizes textbook visual processing
Proceedings of SPIE (May 06 2011)

Back to Top