User-Initiated Symptom Assessment With an Electronic Symptom Checker: Protocol for a Mixed Methods Validation Study.

BACKGROUND: The national Omaolo digital social welfare and health care service of Finland provides a symptom checker, Omaolo, which is a medical device (based on Duodecim Clinical Decision Support EBMEDS software) with a CE marking (risk class IIa), manufactured by the government-owned DigiFinland Oy. Users of this service can perform their triage by using the questions in the symptom checker. By completing the symptom checker, the user receives a recommendation for action and a service assessment with appropriate guidance regarding their health problems on the basis of a selected specific symptom in the symptom checker. This allows users to be provided with appropriate health care services, regardless of time and place. OBJECTIVE: This study describes the protocol for the mixed methods validation process of the symptom checker available in Omaolo digital services. METHODS: This is a mixed methods study using quantitative and qualitative methods, which will be part of the clinical validation process that takes place in primary health care centers in Finland. Each organization provides a space where the study and the nurse triage can be done in order to include an unscreened target population of users. The primary health care units provide walk-in model services, where no prior phone call or contact is required. For the validation of the Omaolo symptom checker, case vignettes will be incorporated to supplement the triage accuracy of rare and acute cases that cannot be tested extensively in real-life settings. Vignettes are produced from a variety of clinical sources, and they test the symptom checker in different triage levels by using 1 standardized patient case example. RESULTS: This study plan underwent an ethics review by the regional permission, which was requested from each organization participating in the research, and an ethics committee statement was requested and granted from Pirkanmaa hospital district's ethics committee, which is in accordance with the University of Tampere's regulations. Of 964 clinical user-filled symptom checker assessments, 877 cases were fully completed with a triage result, and therefore, they met the requirements for clinical validation studies. The goal for sufficient data has been reached for most of the chief symptoms. Data collection was completed in September 2019, and the first feasibility and patient experience results were published by the end of 2020. Case vignettes have been identified and are to be completed before further testing the symptom checker. The analysis and reporting are estimated to be finalized in 2024. CONCLUSIONS: The primary goals of this multimethod electronic symptom checker study are to assess safety and to provide crucial information regarding the accuracy and usability of the Omaolo electronic symptom checker. To our knowledge, this will be the first study to include real-life clinical cases along with case vignettes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/41423.

How Does Triage by an Electronic Symptom Checker Match with Triage by a Nurse?

Omaolo© electronic symptom checkers (ESCs) have been developed to make triage for primary health care patients in Finland. Based on the analysis of the patient's responses to a set of questions, the ESC classifies him/her as emergent, urgent, not urgent, or advices on self-care. In this study the user answered the questions posed by the electronic symptom checker, after which a nurse assessed the urgency of the same user's symptom. The triage nurse was not allowed to know the result of the electronic symptom assessment until he or she had assessed the patient's condition. The level of triage was compared between ESC and nurse in each individual case. Findings from 825 individual cases were analyzed. The mean "exactly matched" for all symptom estimates was 52.6%. The mean "exactly matched" or "overconservative but suitable" for all symptom assessments was 66.6%. Safe assessments of electronic symptom checkers accounted for 98.6% of all assessments. A case was defined as "safe" if the recommendation for action given by the symptom assessment was at most one level less urgent than the nurse's triage assessment of the same case. The findings show that electronic symptom assessments are safe compared to the assessment of an experienced nurse.

In vitro humanized 3D microfluidic chip for testing personalized immunotherapeutics for head and neck cancer patients.

OBJECTIVES: Immunotherapy and personalized medicine therapeutics are emerging as promising approaches in the management of head and neck squamous cell carcinoma (HNSCC). In spite of that, there is yet no assay that could predict individual response to immunotherapy. METHODS: We manufactured an in vitro 3D microfluidic chip to test the efficacy of immunotherapy. The assay was first tested using a tongue cancer cell line (HSC-3) embedded in a human tumour-derived matrix "Myogel/fibrin" and immune cells from three healthy donors. Next, the chips were used with freshly isolated cancer cells, patients' serum and immune cells. Chips were loaded with different immune checkpoint inhibitors, PD-L1 antibody and IDO 1 inhibitor. Migration of immune cells towards cancer cells and the cancer cell proliferation rate were evaluated. RESULTS: Immune cell migration towards HSC-3 cells was cancer cell density dependent. IDO 1 inhibitor induced immune cells to migrate towards cancer cells both in HSC-3 and in two HNSCC patient samples. Efficacy of PD-L1 antibody and IDO 1 inhibitor was patient dependent. CONCLUSION: We introduced the first humanized in vitro microfluidic chip assay to test immunotherapeutic drugs against HNSCC patient samples. This assay could be used to predict the efficacy of immunotherapeutic drugs for individual patients.