VR Karaoke Using Expressive 3D Avatars

ABSTRACT

Because of COVID-19’s social isolation, it’s difficult to go to karaoke. Singing songs with other people in a karaoke room is prohibited. As a result of these circumstances, we created a virtual reality (VR) platform that allows users to enjoy karaoke at home or in a private setting. The platform is designed to analyze and score users’ singing performances in real time, as well as incorporate emotional 3D avatar reactions to give users the impression of being in a karaoke room with other people. Our platform assesses the user’s singing voice based on the beat, notes, and lyrics. We were successful in achieving the desired outcome. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.