Accuracy of retinopathy of prematurity image-based diagnosis by pediatric ophthalmology fellows: implications for training.

PURPOSE: To measure the accuracy of image-based retinopathy of prematurity (ROP) diagnosis by pediatric ophthalmology fellows. METHODS: This was a comparative case series of expert versus nonexpert clinicians in image-based ROP diagnosis. An atlas of 804 retinal images was captured from 248 eyes of 67 premature infants with a wide-angle camera (RetCam-II, Clarity Medical Systems, Pleasanton, CA). Images were uploaded to a study website from which an expert pediatric retinal specialist and five pediatric ophthalmology fellows independently provided a diagnosis (no ROP, mild ROP, type 2 ROP, or treatment-requiring ROP) for each eye. Two different retinal specialists experienced in ROP examination served as additional controls. Primary outcome measures were sensitivity and specificity of image-based ROP diagnosis by fellows compared to a reference standard of image-based interpretation by the expert pediatric retinal specialist. Secondary outcome measure was intraphysician reliability. RESULTS: For detection of mild or worse ROP, the mean (range) sensitivity among the five fellows was 0.850 (0.670-0.962) and specificity was 0.919 (0.832-0.964). For detection of type 2 or worse ROP by fellows, mean (range) sensitivity was 0.527 (0.356-0.709) and specificity was 0.938 (0.777-1.000). For detection of treatment-requiring ROP, mean (range) sensitivity was 0.515 (0.267-0.765) and specificity was 0.949 (0.805-1.00). CONCLUSIONS: Pediatric ophthalmology fellows in this study demonstrated high diagnostic specificity in image-based ROP diagnosis; however, sensitivity was lower, particularly for clinically significant disease.

Plus disease in retinopathy of prematurity: quantitative analysis of vascular change.

PURPOSE: To examine the relationship between rate of vascular change and plus disease diagnosis. DESIGN: Retrospective observational case-control study. METHODS: Wide-angle images were taken bilaterally from 37 infants at 31 to 33 weeks and 35 to 37 weeks postmenstrual age (PMA). The semi-automated Retinal Image multiScale Analysis system was used to measure parameters for all arteries and veins: integrated curvature, diameter, and tortuosity index. A reference standard diagnosis (plus vs not plus) was defined for each eye by consensus of 5 experts at 35 to 37 weeks PMA. Weekly rate of change in parameters was compared in eyes with plus vs not plus disease. Receiver operating characteristic area under the curve (AUC) was calculated for plus disease detection based on 1) weekly rates of parameter change between 31 to 33 weeks and 35 to 37 weeks PMA and 2) parameter values at 35 to 37 weeks only. RESULTS: Weekly rates of change in all venous parameters were significantly different in eyes with plus vs not plus disease, particularly for tortuosity index (P < .0004) and diameter (P = .018). Using weekly rate of change, AUC for plus disease detection was highest for venous tortuosity index (0.819) and venous diameter (0.712). Using the 35 to 37-week PMA image only, AUC was highest for venous integrated curvature (0.952) and diameter (0.789). CONCLUSION: Rate of change in venous, but not arterial, parameters is correlated with plus disease development in this data set. This did not appear to contribute information beyond analysis of an image at 35 to 37 weeks PMA only.

Accuracy of retinopathy of prematurity diagnosis by retinal fellows.

PURPOSE: The purpose of this study was to measure the accuracy of retinopathy of prematurity (ROP) diagnosis by retinal fellows. METHODS: An atlas of 804 retinal images was captured from 248 eyes of 67 premature infants with a wide-angle camera (RetCam-II, Clarity Medical Systems, Pleasanton, CA). Images were uploaded to a study Web site, from which an expert pediatric retinal specialist and 7 retinal fellows independently provided a diagnosis (no ROP, mild ROP, type 2 ROP, or treatment-requiring ROP) for each eye. The sensitivity and specificity of each retinal fellow were calculated and subsequently compared with a reference standard of diagnosis by an expert pediatric retinal specialist. RESULTS: For detection of type 2 or worse ROP by fellows, mean (range) sensitivity was 0.751 (0.512-0.953), and specificity was 0.841 (0.707-0.976). For detection of treatment-requiring ROP, mean (range) sensitivity was 0.914 (0.667-1.000), and specificity was 0.871 (0.678-0.987). CONCLUSION: In general, fellows showed high accuracy for detecting ROP. However, 3 of 7 fellows achieved <80% sensitivity for diagnosis of type 2 or worse ROP, and 2 of 7 achieved <90% sensitivity for diagnosis of treatment-requiring ROP. This could lead to undermanagement and undertreatment of clinically significant disease and raises potential concerns about the quality of ROP screening examinations performed by less-experienced examiners.

Telemedical diagnosis of retinopathy of prematurity: accuracy of expert versus non-expert graders.

BACKGROUND/AIMS: To assess accuracy of telemedical retinopathy of prematurity (ROP) diagnosis by trained non-expert graders compared with expert graders. METHODS: Eye examinations (n=248) from 67 consecutive infants were captured using wide-angle retinal photography (RetCam-II, Clarity Medical Systems, Pleasanton, California, USA). Non-expert graders attended two 1-h training sessions on image-based ROP diagnosis. Using a web-based telemedicine system, 14 non-expert and three expert graders provided a diagnosis for each eye: no ROP, mild ROP, type 2 pre-threshold ROP or treatment-requiring ROP. All diagnoses were compared with a reference standard of dilated indirect ophthalmoscopy by an experienced paediatric ophthalmologist. RESULTS: For detection of type 2 or worse ROP, the mean (range) sensitivities and specificities were 0.95 (0.94-0.97) and 0.93 (0.91-0.96) for experts, 0.87 (0.71-0.97) and 0.73 (0.39-0.95) for resident non-experts, and 0.73 (0.41-0.88) and 0.91 (0.84-0.96) for student non-experts, respectively. For detection of treatment-requiring ROP, the mean (range) sensitivities and specificities were 1.00 (1.00-1.00) and 0.93 (0.88-0.96) for experts, 0.88 (0.50-1.00) and 0.84 (0.71-0.98) for resident non-experts, and 0.82 (0.42-1.00) and 0.92 (0.83-0.97) for student non-experts, respectively. CONCLUSIONS: Mean sensitivity and specificity of trained non-experts were lower than that of experts, although several non-experts had high accuracy. Development of methods for training non-expert graders may help support telemedical ROP evaluation.

Acute retinal necrosis after intraocular triamcinolone acetonide injection.

PURPOSE: The purpose of this study was to report a case of acute retinal necrosis after combined cataract surgery and intracameral triamcinolone acetonide injection in a healthy elderly patient. METHODS: Testing used was a clinical examination including fundus photographs, fluo-rescein angiography, and serologic testing. RESULTS: A 75-year-old healthy white woman undergoing cataract extraction received an injection of intracameral triamcinolone acetonide as a substitute for postoperative topical steroids. Two weeks later, the patient developed acute retinal necrosis, which responded well to systemic antiviral therapy. CONCLUSION: Acute retinal necrosis is a rare, but potentially devastating, complication that may be associated with intraocular triamcinolone acetonide injection.

Retinopathy of prematurity management using single-image vs multiple-image telemedicine examinations.

PURPOSE: To compare performance of single-image vs multiple-image telemedicine examinations for retinopathy of prematurity (ROP) diagnosis. DESIGN: Prospective comparative study. METHODS: A total of 248 eyes from 67 consecutive infants underwent wide-angle retinal imaging by a trained neonatal nurse at 31 to 33 weeks and/or 35 to 37 weeks postmenstrual age (PMA) at a single academic institution. Data were uploaded to a web-based telemedicine system and interpreted by three masked retinal specialists. Diagnoses were provided based on single images, and subsequently on multiple images, from both eyes of each infant. Findings were compared to a reference standard of indirect ophthalmoscopy by a pediatric ophthalmologist. Primary outcome measures were recommended follow-up interval, presence of plus disease, presence of type-2 or worse ROP, and presence of visible peripheral ROP. RESULTS: Among the three graders, mean sensitivity/specificity for detection of infants requiring follow-up in less than one week were 0.85/0.93 by single-image examination and 0.91/0.88 by multiple-image examination at 35 to 37 weeks PMA. Mean sensitivity/specificity for detection of infants with type-2 or worse ROP were 0.82/0.95 by single-image examination and 1.00/0.91 by multiple-image examination at 35 to 37 weeks PMA. Mean sensitivity/specificity for detection of plus disease were 1.00/0.86 by single-image examination and 1.00/0.87 by multiple-image examination at 35 to 37 weeks PMA. There were no statistically-significant intragrader differences between accuracy of single-image and multiple-image telemedicine examinations for detection of plus disease. CONCLUSIONS: Single-image and multiple-image telemedicine examinations perform comparably for determination of recommended follow-up interval and detection of plus disease. This may have implications for development of screening protocols, particularly in areas with limited access to ophthalmic care.

Telemedical retinopathy of prematurity diagnosis: accuracy, reliability, and image quality.

OBJECTIVE: To prospectively measure accuracy, reliability, and image quality of telemedical retinopathy of prematurity (ROP) diagnosis. METHODS: Two-hundred forty-eight eyes from 67 consecutive infants underwent wide-angle retinal imaging by a trained neonatal nurse at 31 to 33 weeks' and/or 35 to 37 weeks' postmenstrual age (PMA) using a standard protocol. Data were uploaded to a Web-based telemedicine system and interpreted by 3 expert retinal specialist graders who provided a diagnosis (no ROP, mild ROP, type 2 prethreshold ROP, treatment-requiring ROP) and an evaluation of image quality for each eye. Findings were compared with a reference standard of indirect ophthalmoscopy by an experienced pediatric ophthalmologist. RESULTS: At 35 to 37 weeks' PMA, sensitivity and specificity for diagnosis of mild or worse ROP were 0.908 and 1.000 for grader A, 0.971 and 1.000 for grader B, and 0.908 and 0.977 for grader C. Sensitivity and specificity for diagnosis of type 2 prethreshold or worse ROP were 1.000 and 0.943 for grader A, 1.000 and 0.930 for grader B, and 1.000 and 0.851 for grader C. At 35 to 37 weeks' PMA, weighted kappa for intergrader reliability was 0.791 to 0.889, and kappa for intragrader reliability for detection of type 2 prethreshold or worse ROP was 0.769 to 1.000. Image technical quality was rated as "adequate" or "possibly adequate" for diagnosis in 93.3% to 100% of eyes. CONCLUSION: A telemedicine system using nurse-captured retinal images has the potential to improve existing shortcomings of ROP management, particularly at later PMAs.

Normal retinal vasculature despite familial protein C deficiency.

PURPOSE: It is unclear whether protein C deficiency is associated with retinal venous occlusive disease. DESIGN: We performed a cross-sectional study. METHODS: Members of a protein C-deficient family, either deficient or nondeficient, with a history of nonocular venous thrombosis were included. All participants completed questionnaires regarding their medical and ophthalmic histories. Each subject underwent dilated direct ophthalmoscopic and binocular indirect ophthalmoscopic examinations by a single vitreoretinal specialist. RESULTS: None of the 18 family members with a known history of nonocular thrombosis-12 with and 6 without protein C deficiency- manifested stigmas of recent or chronic retinal vascular occlusive disease. CONCLUSIONS: This study showed no evidence of involvement of the retinal vascular bed in a family with an increased risk of nonocular venous thrombosis attributable to the deficiency of protein C.