ABSTRACT
This study aimed to describe the process of construction, validation, and usability of the chatbot ESTOMABOT to assist in the self-care of patients with intestinal ostomies. Methodological research was conducted in three phases: construction, validation, and usability. The first stage corresponded to the elaboration of a script through a literature review, and the second stage corresponded to face and content validation through a panel of enterostomal therapy nurses. In the third phase, the usability of ESTOMABOT was assessed with the participation of surgical clinic nurses, patients with intestinal elimination ostomies, and information technology professionals, using the System Usability Scale. The ESTOMABOT content reached excellent criteria of adequacy, with percentages of agreement equal to or greater than 90%, which were considered adequate, relevant, and representative. The evaluation of the content validity of the script using the scale content validity index/average proportion method reached a result above 0.90, and the Fleiss κ was excellent ( P < .05). The overall usability score of the chatbot was 81.5, demonstrating excellent usability. The script, developed and incorporated into the ESTOMABOT prototype, achieved satisfactory content validity. The usability of the chatbot was considered to be good, thereby increasing the credibility of the instrument.
Subject(s)
Ostomy , Self Care , Humans , Research DesignABSTRACT
This article describes the process of developing and validating a virtual assistant to perform vaccine pharmacovigilance. We performed a pilot study with a panel of 22 healthcare professionals who performed content validation of the virtual assistant prototype. Usability was tested with 126 users, using the System Usability Scale. The data analysis was performed by the agreement rate and content validity index, and the κ test was used to verify the agreement between the evaluators. The content domains of the virtual assistant achieved excellent suitability, relevance, and representativeness criteria, all greater than 86%; the content validity index ranged from 0.81 to 0.98, with an average of 0.90 and an interrater reliability index of 1.00. There was excellent interrater agreement (average κ value, 0.76). The total usability score among users was 80.1, ranging from 78.2 in group 1 (users without reactions to vaccines) to 82.1 in group 2 (users with reactions) ( P = .002). The virtual assistant for vaccine pharmacovigilance obtained a satisfactory level of content validity and usability, giving greater credibility to the claim that this device provides greater surveillance and safety for patients.
Subject(s)
Pharmacovigilance , Humans , Reproducibility of Results , Pilot ProjectsABSTRACT
This study aimed to describe the development process, content validation, and usability of a COVID-19 screening system incorporated into a chatbot-type intelligent virtual assistant (CoronaBot). This is a methodological research carried out in three phases. The first corresponded to the development of the flowchart and content of the virtual assistant, the second phase consisted of the implementation of the content in chatbot, and the third phase consisted of content validation. Data analysis was performed by agreement rate, content validity index, and kappa statistical test. Finally, in the third phase, the chatbot's usability was analyzed using the System Usability Scale, by 10 users. The CoronaBot content presented domains with agreement rate above 87.5%, and its items referring to symptomatological scores and interface screens had values of content validity index with a mean of 0.96, kappa test with values from 0.70 to 0.76, and interspecialist agreement of 1.00, demonstrating excellence of prototype content. The global usability score was 80.1. The script developed and incorporated into the chatbot prototype achieved a satisfactory level of content validity. The usability of the chatbot was considered good, adding to the credibility of the device.
