Online Detection of Attentiveness of Students with Special Needs

ABSTRACT

In this COVID-19 pandemic era, students with Autism Spectrum Disorder (ASD) are struggling to adapt to classes in the online environment using Google Meet or Zoom. Failing to keep sustained attention in the class is a common problem for students with ASD. In face-to-face classes, teachers can track a student's behavior and activity to infer the student's attentiveness level and act accordingly. However, it becomes difficult for a teacher to monitor the attentiveness level of multiple students simultaneously on online platforms like Zoom. Detecting the attentiveness level of a student and notifying the teacher in an automated way can play a crucial role in improving the learning outcome. In this paper, we propose the first deep learning based attentiveness level prediction technique for students with ASD. Our model detects the behavior (e.g., unusual movement, gaze etc.) and activities from real-time videos and uses them as features to classify the attentiveness level as low, mid and high. Existing state-of-the-art techniques to detect the attentiveness level of typically developed students using gaze or facial expression cannot be trivially extended for students with ASD as they do not exhibit regular and consistent behavior. We collect video data belonging to different classes covering various types of activities over a long period, train our classifier, and run extensive experiments to validate the prediction performance. Our solution outperforms existing baselines by a large margin.