Comparison of Methods of Clinical Trial Emulation Utilizing Data From the Comparison of AMD Treatment Trial (CATT) and the IRIS® Registry.

Purpose: We used exact matching and inverse propensity score weighting (IPSW) using real-world data (RWD) from the American Academy of Ophthalmology IRIS® Registry (Intelligent Research in Sight) to emulate the 2 pro re nata (prn) treatment arms from the Comparison of AMD Treatment Trial (CATT) and to compare the outcomes of the RWD arms to the 2 monthly treatment arms from the clinical trial. Design: Retrospective cohort study utilizing deidentified electronic health record registry data and patient-level deidentified clinical trial data. Subjects: All treatment-naive patient eyes with neovascular age-related macular degeneration treated with ranibizumab or bevacizumab only for 1 year from either the CATT or the IRIS Registry. Methods: Patients were identified in the IRIS Registry between October 1, 2015 and December 31, 2019. After all nonimaging-based inclusion and exclusion criteria from the CATT were applied, patient eyes receiving bevacizumab or ranibizumab only on a prn basis were identified as the eligible cohort. Exact matching and ISPW was applied based on age, gender, and baseline visual acuity. Main Outcome Measures: Mean change in visual acuity, in approximated ETDRS letters, between baseline and 1 year for the IRIS Registry prn treatment arms generated by exact matching and IPSW. Results: We identified 427 eyes treated with ranibizumab prn and 771 eyes treated with bevacizumab prn. Using exact matching, 98% (n = 281) of CATT patient eyes in the bevacizumab monthly treatment arm and 87% (n = 261) of CATT patient eyes in the ranibizumab monthly treatment arm were matched to a patient eye in the IRIS Registry. For the ranibizumab prn treatment arm, patient eyes generated using exact matching gained 1.9 letters and those generated using IPSW gained 2.8 letters (exact matching: 1.9 letters ± 14.0 vs. IPSW: 2.8 letters ± 15.0 letters, P = 0.43). For the bevacizumab prn treatment arm, patient eyes generated using exact matching gained 2.4 letters and those generated using IPSW gained 2.1 letters (exact matching: 2.4 letters ± 15.4 vs. IPSW: 2.1 letters ± 16.0 letters, P = 0.79). Conclusions: Both exact matching and IPSW produced similar results in emulating the prn treatment arms of the CATT using IRIS Registry data and patient-level clinical trial data. Similar to prior real-world studies, the clinical outcomes were significantly worse in the IRIS Registry treatment arms compared with the clinical trial. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Multi-registry analysis of patients with multiple sclerosis and neuromyelitis optica to improve capture of demographic data and compare visual outcomes.

IMPORTANCE: The American Academy of Neurology Axon Registry® provides real-world data for patients with multiple sclerosis and neuro-myelitis optica. However, some data are incomplete (e.g. demographics) and some relevant outcomes are not systematically captured in neurology documentation (e.g. visual acuity). The American Academy of Ophthalmology IRIS® Registry (Intelligent Research in Sight) contains demographic and visual function data that may complement Axon Registry-derived data to enhance understanding of real-world visual outcomes in neurological disease. OBJECTIVE: To combine Axon Registry and IRIS Registry data to reduce missingness of demographic information and characterize visual outcomes in patients with multiple sclerosis and neuro-myelitis optica. DESIGN: Cross-sectional study. SETTING: Outpatient neurology and ophthalmology clinical practices. PARTICIPANTS: Patients participating in both registries between January 1, 2014 through December 10, 2021 were included if they had repeat ICD-9/10 codes for with multiple sclerosis or neuro-myelitis optica in the Axon registry. EXPOSURE: Diagnosis (multiple sclerosis or neuro-myelitis optica). MAIN OUTCOME AND MEASURE: Age, sex, race and ethnicity were assessed in the individual registries and classified as conflicting, missing, or not missing in the combined data set. The IRIS Registry contributed visual acuity data. RESULTS: Among 60,316 patients with multiple sclerosis and 1,068 patients with neuro-myelitis optica in the Axon Registry, 14,085 and 252 had temporal overlap in the IRIS Registry. Combining data reduced missing or conflicting data for race and ethnicity by 15-19 % (absolute reduction, all p ≤ 0.0005), but not age (p = 1.0) or gender (p = 0.08). 10,907 patients with MS and 142 with NMO had visual acuity data in the IRIS Registry. Visual acuity averaged between eyes was worse in patients with NMO after adjusting for age and gender (0.17 logMAR, 95 %CI 0.12,0.21, p < 0.0005). CONCLUSION AND RELEVANCE: Using data from two registries reduced missing data for race and ethnicity and enabled examination of outcomes captured in the IRIS Registry for conditions that are diagnosed more frequently in the Axon Registry, demonstrating the utility of a multi-registry analysis.

Feasibility of cross-vendor linkage of ophthalmic images with electronic health record data: an analysis from the IRIS Registry®.

Purpose: To link compliant, universal Digital Imaging and Communications in Medicine (DICOM) ophthalmic imaging data at the individual patient level with the American Academy of Ophthalmology IRIS® Registry (Intelligent Research in Sight). Design: A retrospective study using de-identified EHR registry data. Subjects Participants Controls: IRIS Registry records. Materials and Methods: DICOM files of several imaging modalities were acquired from two large retina ophthalmology practices. Metadata tags were extracted and harmonized to facilitate linkage to the IRIS Registry using a proprietary, heuristic patient-matching algorithm, adhering to HITRUST guidelines. Linked patients and images were assessed by image type and clinical diagnosis. Reasons for failed linkage were assessed by examining patients' records. Main Outcome Measures: Success rate of linking clinicoimaging and EHR data at the patient level. Results: A total of 2 287 839 DICOM files from 54 896 unique patients were available. Of these, 1 937 864 images from 46 196 unique patients were successfully linked to existing patients in the registry. After removing records with abnormal patient names and invalid birthdates, the success linkage rate was 93.3% for images. 88.2% of all patients at the participating practices were linked to at least one image. Conclusions and Relevance: Using identifiers from DICOM metadata, we created an automated pipeline to connect longitudinal real-world clinical data comprehensively and accurately to various imaging modalities from multiple manufacturers at the patient and visit levels. The process has produced an enriched and multimodal IRIS Registry, bridging the gap between basic research and clinical care by enabling future applications in artificial intelligence algorithmic development requiring large linked clinicoimaging datasets.

Drug development for major chronic health conditions-aligning with growing public health needs: Proceedings from a multistakeholder think tank.

The global pharmaceutical industry portfolio is skewed towards cancer and rare diseases due to more predictable development pathways and financial incentives. In contrast, drug development for major chronic health conditions that are responsible for a large part of mortality and disability worldwide is stalled. To examine the processes of novel drug development for common chronic health conditions, a multistakeholder Think Tank meeting, including thought leaders from academia, clinical practice, non-profit healthcare organizations, the pharmaceutical industry, the Food and Drug Administration (FDA), payors as well as investors, was convened in July 2022. Herein, we summarize the proceedings of this meeting, including an overview of the current state of drug development for chronic health conditions and key barriers that were identified. Six major action items were formulated to accelerate drug development for chronic diseases, with a focus on improving the efficiency of clinical trials and rapid implementation of evidence into clinical practice.

Vitreoretinal Specialist Use of Ancillary Testing: An IRIS® Registry Analysis.

Purpose: To investigate patterns of ancillary imaging testing among vitreoretinal specialists for patients with vitreoretinal disease in the United States (US). Methods: Optical coherence tomography (OCT), color fundus photography (CFP), and fluorescein angiography (FA), ordered by vitreoretinal specialists and documented within the American Academy of Ophthalmology IRIS® Registry (Intelligent Research in Sight) between 01 January 2018 and 31 December 2020, were retrospectively assessed. Trends in imaging modality choice were analyzed by payer type, geographic region, and practice type. Sub-analyses were conducted according to categorization of vitreoretinal specialists into those treating a high versus low volume of patients with neovascular age-related macular degeneration (nAMD). Results: OCT was the most common imaging modality used, followed by CFP and FA. Following normalization, the highest volume of OCT procedures performed were identified among Medicare Advantage and Medicare Fee-for-Service beneficiaries, within the South of the US, and at medium and large practices. Minimal differences were observed for CFP and FA volume across payer types and regions. Across practice types, the largest volume of CFP and FA procedures were identified in small and private equity owned practices, respectively. Vitreoretinal specialists with a high nAMD volume more frequently performed OCT than those with a low nAMD volume. Conclusion: Vitreoretinal specialists demonstrated a strong preference for OCT, with real-world associations according to payer type, geographic location, and practice type. Volume of nAMD patients seen impacted the likelihood of specialists ordering OCTs.

Identifying the mechanism of missingness for unspecified diabetic retinopathy disease severity in the electronic health record: an IRIS® Registry analysis.

Observational studies of diabetic retinopathy (DR) using electronic health record data often determine disease severity using International Classification of Disease (ICD) codes. We investigated the mechanism of missingness for DR severity based on ICD coding using the American Academy of Ophthalmology IRIS® Registry. We included all patient encounters in the registry with a DR ICD-9 or ICD-10 code between January 1, 2014 and June 30, 2021. Demographic, clinical, and practice-level characteristics were compared between encounters with specified and unspecified disease severity. Practices were divided into quartiles based on the proportion of clinical encounters with unspecified DR severity. Encounters with unspecified disease severity were associated with significantly older patient age, better visual acuity, and lower utilization of ophthalmic procedures. Higher volume practices and retina specialist practices had lower proportions of clinical encounters with unspecified disease severity. Results strongly suggest that DR disease severity related to ICD coding is missing not at random.

Emulating VIEW 1 and VIEW 2 Clinical Trial Outcome Data Using the American Academy of Ophthalmology IRIS Registry.

BACKGROUND AND OBJECTIVE: A retrospective, noninterventional cohort study of the American Academy of Ophthalmology IRIS Registry, an electronic health record (EHR)-based comprehensive eye disease and condition registry, intended to assess whether the IRIS® Registry (Intelligent Research in Sight) could emulate the VIEW randomized clinical trials (VIEW RCTs) eligibility criteria, treatment protocol regimen, and primary endpoint. PATIENTS AND METHODS: Deidentified patients having an anti-VEGF injection of aflibercept or ranibizumab between January 1, 2013, and December 31, 2018, from the IRIS Registry. Patients were treated in accordance with one of three treatment regimens from the VIEW RCT: monthly intravitreal aflibercept injection (IAI 2Q4), intravitreal aflibercept every 2 months after 3 initial monthly doses (IAI 2Q8), or monthly ranibizumab (RQ4) injection. The main outcome measures are the number and proportion of patients meeting VIEW RCT eligibility and treatment group criteria, demographic, and clinical differences between IRIS Registry treatment groups, mean change in best documented visual acuity at one year, and evaluation of the primary endpoint of the VIEW RCT: difference in the proportion of patients maintaining vision. RESULTS: Among the 90,900 patients who met VIEW RCT eligibility criteria, 4,457 (4.85%) met treatment group criteria. The percentage of patients maintaining vision at one year was over 90%. No statistically significant difference was observed when comparing the proportion of patients maintaining vision among the RQ4 treatment group to the IAI 2Q4 or IAI 2Q8 treatment group. CONCLUSIONS: A small percentage of real-world patients met VIEW RCT study eligibility criteria and treatment protocol regimen. Among patients meeting all available criteria, the primary endpoint interpretation yielded by an observational EHR-based dataset suggested comparable results to the VIEW RCT. [Ophthalmic Surg Lasers Imaging Retina 2023;54:6-14.].

Health Care Disparities in Diabetes and Diabetic Retinopathy.

PURPOSE: To investigate prevalence of diabetes (DM), diabetic retinopathy (DR), and areas with highest rates of undetected DR. To quantify and map locations of disparities as they relate to poverty and minority populations. METHODS: Retrospective cohort study from large regional health data repository (HealthLNK). Geographic Information System (GIS) analysis mapped rates of DM and DR in Chicago area ZIP Codes. RESULTS: Of 1,086,921 adults who met the inclusion criteria, 143,790 with DM were identified. ZIP Codes with higher poverty rates were correlated with higher prevalence of DM and DR (Pearson's correlation coefficient 0.614, p < .05, 0.333, p < .05). Poverty was negatively correlated with likelihood of DR diagnosis (-0.638, p < .05). Relative risks of DM and DR were calculated in each ZIP Code and compared to actual rates. 36 high-risk ZIP Codes had both high-risk of DM and low DR detection. In high-risk ZIP Codes 85.4% of households self-identified as ethnic minority and 33.0% were below the Federal Poverty Level (FPL). Both percentages were significantly higher than the Chicago average of 50.5% minority and 19.9% below FPL (p < .05). 67 ideal ZIP Codes had both low risk of DM and high DR detection. In ideal ZIP Codes 32.6% of households self-identified as minority, and 10.2% were below the FPL (p < .05). CONCLUSIONS: A health care disparity exists with regards to DM and DR. High-risk ZIP Codes are associated with higher poverty and higher minority population, and they are highly concentrated in just 17% of the ZIP codes in the Chicago area.

Correlation between Frozen Section and Permanent Histopathologic Diagnoses in Adult Orbital Lesions.

Introduction: When indicated, intraoperative use of frozen sections may assist in determining the surgical course or appropriate processing of surgical specimens. Knowing the accuracy of a preliminary frozen section diagnosis is important. The purpose of this study is to determine the rate of correlation between frozen and permanent histopathologic diagnoses of adult orbital lesions, analyze characteristics of discordant cases, and examine the effects of discordance on surgical decision-making. Methods: A 15-year retrospective chart review was conducted at a tertiary care center of all adult patients with orbital lesions for which frozen section and corresponding permanent section tissue diagnoses were obtained. Results: Sixty-five orbital surgeries were performed with a total of 89 frozen sections sampled. In 63 surgeries (96.9%), at least 1 frozen section diagnosis matched the final permanent section diagnosis. Overall, frozen section diagnosis corresponded with permanent section diagnosis in 81 of 89 (91.0%) specimens. Of the 8 (9.0%) specimens from 5 unique patients that did not correlate, the final diagnoses on permanent sections were amyloidosis (5), margin-positive infiltrating breast carcinoma (2), and lymphoid hyperplasia (1). The discrepancy between frozen and permanent sections did not alter care in any patient. Conclusion: Frozen section diagnoses correlate with permanent histopathologic tissue diagnosis in adult orbital biopsies in greater than 90% of cases. Among non-correlated specimens, amyloidosis was the most common diagnosis. Although rare, orbital amyloid disorders may be considered in the differential diagnosis of cases of orbital biopsies with nonspecific findings on a frozen section.

Inclusion and diversity in clinical trials: Actionable steps to drive lasting change.

BACKGROUND: Improving diversity in clinical trials is essential in order to produce generalizable results. Although the importance of representation has become increasingly recognized, identifying strategies to approach this work remains elusive. This article reviews the proceedings of a multi-stakeholder conference about the current state of diversity in clinical trials and outlines actionable steps for improvement. METHODS: Conference attendees included representatives from the United States Food and Drug Administration (FDA), National Institutes of Health (NIH), practicing clinical investigators, pharmaceutical and device companies, community-based organizations, data analytics companies, and patient advocacy groups. At this virtual event, attendees were asked to consider key questions around best practices for engagement of underrepresented populations. RESULTS: Community engagement is an integral part of recruitment and retention of underrepresented groups. Decentralization of sites and use of digital tools can enhance the accessibility of clinical research. Finally, improving representation among investigators and clinical research staff may translate to diverse clinical trial participants. CONCLUSION: Improving diversity in clinical trials is an ethical and scientific imperative, which requires a multifaceted approach.

Payment Reform Needed to Address Health Disparities of Undiagnosed Diabetic Retinopathy in the City of Chicago.

INTRODUCTION: The Affordable Care Act (ACA) has expanded health coverage for thousands of Illinois residents. Expanded coverage, however, does not guarantee appropriate health care. Diabetes and its ocular complications serve as an example of how providers in underserved urban areas may not be able to keep up with new demand for labor- and technology-intensive health care unless changes in reimbursement policies are instituted. METHODS: A retrospective cohort study was conducted using medical encounter information from the Chicago HealthLNK Data Repository (HDR), an assembly of non-duplicated and de-identified patient medical records. We used a method of estimating the geographic distribution of undiagnosed diabetic retinopathy in the city of Chicago to illustrate the magnitude of potentially preventable eye disease. All rates were calculated for all ZIP Codes within Chicago (Cook County), and statistical differences between observed and geographically adjusted expected rates (p < 0.10, p < 0.05, p < 0.01) were highlighted as underserved areas. RESULTS: This analysis included 150,661 patients with diabetes identified from a total of nearly two million patients in Chicago. High rates of undetected diabetic retinopathy were found in low-income and minority areas. Within these areas, 37% of the identified diabetics were uninsured, with rates ranging widely from 20% to 68.6%. Among those with insurance, 32.8% were covered by Medicare and only 10% by Medicaid. Most patients with untreated diabetic retinopathy were found to reside in areas where primary health care is provided through Federally Qualified Health Centers. CONCLUSIONS: With 150,661 diabetics identified in the city of Chicago, and this number continuing to rise each year, a manpower approach with ophthalmologist screening for diabetic retinopathy is not realistic. The ability to identify the growing number of diabetic patients with retinopathy in low-income areas will likely require the adoption of cost-effective screening technologies that are currently not funded by Medicare and Medicaid.

Performance of an electronic health record-based phenotype algorithm to identify community associated methicillin-resistant Staphylococcus aureus cases and controls for genetic association studies.

BACKGROUND: Community associated methicillin-resistant Staphylococcus aureus (CA-MRSA) is one of the most common causes of skin and soft tissue infections in the United States, and a variety of genetic host factors are suspected to be risk factors for recurrent infection. Based on the CDC definition, we have developed and validated an electronic health record (EHR) based CA-MRSA phenotype algorithm utilizing both structured and unstructured data. METHODS: The algorithm was validated at three eMERGE consortium sites, and positive predictive value, negative predictive value and sensitivity, were calculated. The algorithm was then run and data collected across seven total sites. The resulting data was used in GWAS analysis. RESULTS: Across seven sites, the CA-MRSA phenotype algorithm identified a total of 349 cases and 7761 controls among the genotyped European and African American biobank populations. PPV ranged from 68 to 100% for cases and 96 to 100% for controls; sensitivity ranged from 94 to 100% for cases and 75 to 100% for controls. Frequency of cases in the populations varied widely by site. There were no plausible GWAS-significant (p < 5 E -8) findings. CONCLUSIONS: Differences in EHR data representation and screening patterns across sites may have affected identification of cases and controls and accounted for varying frequencies across sites. Future work identifying these patterns is necessary.

Creation of an Accurate Algorithm to Detect Snellen Best Documented Visual Acuity from Ophthalmology Electronic Health Record Notes.

BACKGROUND: Visual acuity is the primary measure used in ophthalmology to determine how well a patient can see. Visual acuity for a single eye may be recorded in multiple ways for a single patient visit (eg, Snellen vs. Jäger units vs. font print size), and be recorded for either distance or near vision. Capturing the best documented visual acuity (BDVA) of each eye in an individual patient visit is an important step for making electronic ophthalmology clinical notes useful in research. OBJECTIVE: Currently, there is limited methodology for capturing BDVA in an efficient and accurate manner from electronic health record (EHR) notes. We developed an algorithm to detect BDVA for right and left eyes from defined fields within electronic ophthalmology clinical notes. METHODS: We designed an algorithm to detect the BDVA from defined fields within 295,218 ophthalmology clinical notes with visual acuity data present. About 5668 unique responses were identified and an algorithm was developed to map all of the unique responses to a structured list of Snellen visual acuities. RESULTS: Visual acuity was captured from a total of 295,218 ophthalmology clinical notes during the study dates. The algorithm identified all visual acuities in the defined visual acuity section for each eye and returned a single BDVA for each eye. A clinician chart review of 100 random patient notes showed a 99% accuracy detecting BDVA from these records and 1% observed error. CONCLUSIONS: Our algorithm successfully captures best documented Snellen distance visual acuity from ophthalmology clinical notes and transforms a variety of inputs into a structured Snellen equivalent list. Our work, to the best of our knowledge, represents the first attempt at capturing visual acuity accurately from large numbers of electronic ophthalmology notes. Use of this algorithm can benefit research groups interested in assessing visual acuity for patient centered outcome. All codes used for this study are currently available, and will be made available online at https://phekb.org.

Unsuspected Ganglioneuroma of the Choroid Diagnosed after Enucleation.

We report a case of an unsuspected ganglioneuroma of the choroid in a patient with neurofibromatosis type 1. A 5-year-old girl presented from an outside institution with right proptosis and glaucoma since birth. Magnetic resonance imaging was obtained and showed a cavernous sinus mass extending into the right orbit and multiple orbital lesions. Additionally, increased signal in the posterior globe of the right eye was noted, but its etiology was unclear at the time. She was lost to follow-up for 3 years and later returned with a blind painful eye. Enucleation was performed, and histopathology was significant for diffuse choroidal ganglioneuroma and advanced glaucoma. We report the atypical history, examination findings, and histopathology to support the diagnosis.

Comparison of automated and human assignment of MeSH terms on publicly-available molecular datasets.

Publicly available molecular datasets can be used for independent verification or investigative repurposing, but depends on the presence, consistency and quality of descriptive annotations. Annotation and indexing of molecular datasets using well-defined controlled vocabularies or ontologies enables accurate and systematic data discovery, yet the majority of molecular datasets available through public data repositories lack such annotations. A number of automated annotation methods have been developed; however few systematic evaluations of the quality of annotations supplied by application of these methods have been performed using annotations from standing public data repositories. Here, we compared manually-assigned Medical Subject Heading (MeSH) annotations associated with experiments by data submitters in the PRoteomics IDEntification (PRIDE) proteomics data repository to automated MeSH annotations derived through the National Center for Biomedical Ontology Annotator and National Library of Medicine MetaMap programs. These programs were applied to free-text annotations for experiments in PRIDE. As many submitted datasets were referenced in publications, we used the manually curated MeSH annotations of those linked publications in MEDLINE as "gold standard". Annotator and MetaMap exhibited recall performance 3-fold greater than that of the manual annotations. We connected PRIDE experiments in a network topology according to shared MeSH annotations and found 373 distinct clusters, many of which were found to be biologically coherent by network analysis. The results of this study suggest that both Annotator and MetaMap are capable of annotating public molecular datasets with a quality comparable, and often exceeding, that of the actual data submitters, highlighting a continuous need to improve and apply automated methods to molecular datasets in public data repositories to maximize their value and utility.

Assessing the quality of annotations in asthma gene expression experiments.

BACKGROUND: The amount of data deposited in the Gene Expression Omnibus (GEO) has expanded significantly. It is important to ensure that these data are properly annotated with clinical data and descriptions of experimental conditions so that they can be useful for future analysis. This study assesses the adequacy of documented asthma markers in GEO. Three objective measures (coverage, consistency and association) were used for evaluation of annotations contained in 17 asthma studies. RESULTS: There were 918 asthma samples with 20,640 annotated markers. Of these markers, only 10,419 had documented values (50% coverage). In one study carefully examined for consistency, there were discrepancies in drug name usage, with brand name and generic name used in different sections to refer to the same drug. Annotated markers showed adequate association with other relevant variables (i.e. the use of medication only when its corresponding disease state was present). CONCLUSIONS: There is inadequate variable coverage within GEO and usage of terms lacks consistency. Association between relevant variables, however, was adequate.