Content and Usability Validation of an Intelligent Virtual Conversation Assistant Used for Virtual Triage During the COVID-19 Pandemic in Brazil.

This study aimed to describe the development process, content validation, and usability of a COVID-19 screening system incorporated into a chatbot-type intelligent virtual assistant (CoronaBot). This is a methodological research carried out in three phases. The first corresponded to the development of the flowchart and content of the virtual assistant, the second phase consisted of the implementation of the content in chatbot, and the third phase consisted of content validation. Data analysis was performed by agreement rate, content validity index, and kappa statistical test. Finally, in the third phase, the chatbot's usability was analyzed using the System Usability Scale, by 10 users. The CoronaBot content presented domains with agreement rate above 87.5%, and its items referring to symptomatological scores and interface screens had values of content validity index with a mean of 0.96, kappa test with values from 0.70 to 0.76, and interspecialist agreement of 1.00, demonstrating excellence of prototype content. The global usability score was 80.1. The script developed and incorporated into the chatbot prototype achieved a satisfactory level of content validity. The usability of the chatbot was considered good, adding to the credibility of the device.
(Copyright © 2022 Wolters Kluwer Health, Inc. All rights reserved.)