Evaluate underdiagnosis and overdiagnosis bias of deep learning model on primary open-angle glaucoma diagnosis in under-served populations.

In the United States, primary open-angle glaucoma (POAG) is the leading cause of blindness, especially among African American and Hispanic individuals. Deep learning has been widely used to detect POAG using fundus images as its performance is comparable to or even surpasses diagnosis by clinicians. However, human bias in clinical diagnosis may be reflected and amplified in the widely-used deep learning models, thus impacting their performance. Biases may cause (1) underdiagnosis, increasing the risks of delayed or inadequate treatment, and (2) overdiagnosis, which may increase individuals' stress, fear, well-being, and unnecessary/costly treatment. In this study, we examined the underdiagnosis and overdiagnosis when applying deep learning in POAG detection based on the Ocular Hypertension Treatment Study (OHTS) from 22 centers across 16 states in the United States. Our results show that the widely-used deep learning model can underdiagnose or overdiagnose under-served populations. The most underdiagnosed group is female younger (< 60 yrs) group, and the most overdiagnosed group is Black older (≥ 60 yrs) group. Biased diagnosis through traditional deep learning methods may delay disease detection, treatment and create burdens among under-served populations, thereby, raising ethical concerns about using deep learning models in ophthalmology clinics.

Developing Population Health Surveillance Using mHealth in Low-Resource Settings: Qualitative Assessment and Pilot Evaluation.

BACKGROUND: Population surveillance data are essential for understanding population needs and evaluating health programs. Governmental and nongovernmental organizations in western Myanmar did not previous have means for conducting robust, electronic population health surveillance. OBJECTIVE: This study involved developing mobile health (mHealth)-based population health surveillance in a rural, low-resource setting with minimal cellular infrastructure in western Myanmar. This was an early formative study in which our goal was to establish the initial feasibility of conducting mHealth population health surveillance, optimizing procedures, and building capacity for future work. METHODS: We used an iterative design process to develop mHealth-based population health surveillance focused on general demographics (eg, total census, age category, sex, births, and deaths). Interviews were conducted with international consultants (nurse midwives) and local clinicians (nurses and physicians) in Myanmar. Our analytic approach was informed by the Systems Engineering Initiative for Patient Safety work systems model to capture the multilevel user needs for developing health interventions, which was used to create a prototype data collection tool. The prototype was then pilot-tested in 33 villages to establish an initial proof of concept. RESULTS: We conducted 7 interviews with 5 participants who provided feedback regarding the domains of the work system, including environmental, organizational, sociocultural, technological, informational, and task- and people-based considerations, for adapting an mHealth tool. Environmental considerations included managing limited electricity and internet service. Organizational needs involved developing agreements to work within existing government infrastructure as well as leveraging the communal nature of societies to describe the importance of surveillance data collection and gain buy-in. Linguistic diversity and lack of experience with technology were both cited as people- and technology-based aspects to inform prototype design. The use of mobile tools was also viewed as a means to improve the quality of the data collected and as a feasible option for working in settings with limited internet access. Following the prototype design based on the findings of initial interviews, the mHealth tool was piloted in 33 villages, allowing our team to collect census data from 11,945 people for an initial proof of concept. We also detected areas of potentially missing data, which will need to be further investigated and mitigated in future studies. CONCLUSIONS: Previous studies have not focused heavily on the early stages of developing population health surveillance capacity in low- and middle-income countries. Findings related to key design considerations using a work systems lens may be informative to others developing technology-based solutions in extremely low-resource settings. Future work will involve collecting additional health-related data and further evaluating the quality of the data collected. Our team established an initial proof of concept for using an mHealth tool to collect census-related information in a low-resource, extremely rural, and low-literacy environment.