Hand Gesture Controlled Presentation Viewer with AI Virtual Painter

ABSTRACT

Online teaching has been encouraged for many years but the COVID-19 pandemic has promoted it to an even greater extent. Teachers had to quickly shift to online teaching methods and processes and conduct all the classroom activities online. The global pandemic has accelerated the transition from chalk and board learning to mouse and click - digital learning. Even though there are online whiteboards available for teaching, teachers often find it difficult to draw using a mouse. A solution for this would be to get an external digital board and stylus but not everyone would be able to afford it. The Hand-Gesture Controlled Presentation Viewer With AI Virtual Painter is a project where one can navigate through the presentation slides and draw anything on them just like how one would on a normal board, just by using their fingers. This project aims to digitalise the traditional blackboard-chalk system and eliminate the need for using a mouse or keyboard while taking classes. Hand-Gesture controlled devices especially laptops and computers have recently gained a lot of attraction. This system works by detecting landmarks on one’s hand to recognise the gestures. The project recognises five hand gestures. It uses a thumb finger for moving to the next slide, a little finger for moving to the previous slide, two fingers for displaying the pointer, one finger for drawing on the screen and three fingers for erasing whatever has been drawn. The infrastructure is provided between the user and the system using only a camera. The camera’s output will be presented on the system’s screen so that the user can further calibrate it. © 2022 University of Stockholm. All rights reserved.