ABSTRACT
To test and evaluate the second installment of DENTIFY, a virtual reality haptic simulator for Operative Dentistry (OD), on preclinical dental students, by focusing on user performance and self-assessment. Twenty voluntary unpaid preclinical dental students, with different background experience, were enrolled for this study. After the completion of an informed consent, a demographic questionnaire, and being introduced to the prototype (on the first testing session), three testing sessions followed (S1, S2, S3). Each session involved the following steps: (I) free experimentation; (II) task execution; S3 also included (III) completion of questionnaires associated with the experiment (total of 8 Self-Assessment Questions (SAQ)); and (IV) guided interview. As expected, drill time decreased steadily for all tasks when increasing prototype use, verified by RM ANOVA. Regarding performance metrics (Comparisons by Student's t-test and ANOVA) recorded at S3, in overall, a higher performance was verified for participants with the following characteristics: female, non-gamer, no previous VR experience and with over 2 semesters of previous experience of working on phantom models. The correlation between the participants' performance (drill time), for the four tasks, and user self-assessment evaluation, verified by Spearman's rho analysis, allowed to conclude that a higher performance was observed in students who responded that DENTIFY improved their self perception of manual force applied. Regarding the questionnaires, Spearman's rho analysis showed a positive correlation between the improvement DENTIFY inputs on conventional teaching sensed by students, also enhancing their interest in learning OD, their desire to have more simulator hours and the improvement sensed on manual dexterity. All participating students adhered well to the DENTIFY experimentation. DENTIFY allows for student self-assessment and contributes to improving student performance. Simulators with VR and haptic pens for teaching in OD should be designed as a consistent and gradual teaching strategy, allowing multiplicity of simulated scenarios, bimanual manipulation, and the possibility of real-time feedback to allow for the student's immediate self-assessment. Additionally, they should create performance reports per student to ensure self-perception/criticism of their evolution over longer periods of learning time.
