An analysis of perceptual errors in reading mammograms using quasi-local spatial frequency spectra.

In this pilot study the authors examined areas on a mammogram that attracted the visual attention of experienced mammographers and mammography fellows, as well as areas that were reported to contain a malignant lesion, and, based on their spatial frequency spectrum, they characterized these areas by the type of decision outcome that they yielded: true-positives (TP), false-positives (FP), true-negatives (TN), and false-negatives (FN). Five 2-view (craniocaudal and medial-lateral oblique) mammogram cases were examined by 8 experienced observers, and the eye position of the observers was tracked. The observers were asked to report the location and nature of any malignant lesions present in the case. The authors analyzed each area in which either the observer made a decision or in which the observer had prolonged (>1,000 ms) visual dwell using wavelet packets, and characterized these areas in terms of the energy contents of each spatial frequency band. It was shown that each decision outcome is characterized by a specific profile in the spatial frequency domain, and that these profiles are significantly different from one another. As a consequence of these differences, the profiles can be used to determine which type of decision a given observer will make when examining the area. Computer-assisted perception correctly predicted up to 64% of the TPs made by the observers, 77% of the FPs, and 70% of the TNs.

Blinded review of retrospectively visible unreported breast cancers: an eye-position analysis.

PURPOSE: To determine whether unreported retrospectively identified cancers on mammograms receive prolonged visual attention and can be reliably detected in a blinded review. MATERIALS AND METHODS: Four experienced mammographers performed a blinded review of a test set of 20 retrospective cases where the cancer was not detected until the next mammographic evaluation, 10 prospective cases where the cancer was initially detected, and 10 cancer-free cases. Two views were digitized and displayed on a workstation. The experiment consisted of an initial impression, during which eye position was monitored, and a final impression, during which viewers zoomed on regions of interest and localized suspicious lesions. Eye-position data were analyzed to determine whether retrospectively visible cancers attracted attention to the same degree as prospectively visible cancers. The initial impression used 1,000 msec as the eye-fixation dwell criterion for detecting a lesion. RESULTS: Initially, 70% of retrospective cancers and 50% of prospective cancers did not attract prolonged visual attention. In prospective cases, detailed examination significantly improved the mean receiver operating characteristic area, from.73 to.88 (P <.01), but in retrospective cases, the mean receiver operating characteristic area barely increased, from.60 to.68, due to a high true-positive-to-false-positive ratio. CONCLUSION: At blinded review, detection of retrospectively visible cancers was significantly inferior to that of prospective cancers. It cannot be assumed that retrospectively identified cancers are intrinsically detectable, because they do not draw prolonged visual attention during visual search for breast cancers.

An automated results notification system for PACS.

The purpose of this study was to determine if the interval between an examination being ordered by an Emergency Department physician and his or her review of the report and images could be shortened by notifying the physician that the results were available. This hypothesis was based on work done previously in the Medical Intensive Care Unit that showed that physicians would wait to review results for a time considerably longer than the time required for the radiologist to review the images and provide a preliminary report. The software developments operate properly and show that even simple integration of multiple information systems (PACS, RIS, speech recognition) can provide useful features. Early results indicate that the Emergency Department (ED) physicians prefer the notification system over the previous (travel to check on images and reports) methods. The hypothesized time reductions did occur, although it is not clear that the notification system accounted for all of them. A system for automated notification of radiology results availability has been shown to be possible and practical. To do this automated interaction of 3 systems with a low-level or no electronic integration was required. Although not fully successful for this study, early physician response has been positive, and requests to expand this service hospitalwide now are common.

How experience and training influence mammography expertise.

RATIONALE AND OBJECTIVES: The authors evaluated the influence of perceptual and cognitive skills in mammography detection and interpretation by testing three groups representing different levels of mammography expertise in terms of experience, training, and talent with a mammography screening-diagnostic task. MATERIALS AND METHODS: One hundred fifty mammograms, composed of unilateral cranial-caudal and mediolateral oblique views, were displayed in pairs on a digital workstation to 19 radiology residents, three experienced mammographers, and nine mammography technologists. One-third of the mammograms showed malignant lesions; two-thirds were malignancy-free. Observers interacted with the display to indicate whether each image contained no malignant lesions or suspicious lesions indicating malignancy. Decision time was measured as the lesions were localized, classified, and rated for decision confidence. RESULTS: Compared with performance of experts, alternative free response operating characteristic performance for residents was significantly lower and equivalent to that of technologists. Analysis of overall performance showed that, as level of expertise decreased, false-positive results exerted a greater effect on overall decision accuracy over the time course of image perception. This defines the decision speed-accuracy relationship that characterizes mammography expertise. CONCLUSION: Differences in resident performance resulted primarily from lack of perceptual-learning experience during mammography training, which limited object recognition skills and made it difficult to determine differences between malignant lesions, benign lesions, and normal image perturbations. A proposed solution is systematic mentor-guided training that links image perception to feedback about the reasons underlying decision making.

A perceptually tempered display for digital mammograms.

The cathode ray tube of a workstation for use with digital mammograms was calibrated with a photometer to produce an input-output characteristic curve similar to the perceptually linear curve defined by a current display standard. Then, a test pattern consisting of bars of increasing intensity containing disks of decreasing contrast was used by an observer to estimate the minimal detectable contrast (MDC) at different levels of display luminance. The MDC was modeled by a parabola. The shape of the parabola was determined by the observer's perceptual responses, and the range was determined by the maximum and minimum pixel values of the breast parenchyma. As each mammogram was displayed, the contour of the breast was automatically found and pixels within the breast image were sampled to determine the pixel values that were used to compute the maximum and minimum pixel values. The parabola was integrated to determine the look-up table for the initial MDC-tempered display of the mammogram. Preliminary observer performance tests showed no significant differences in the accuracy and speed of three radiologists who read a set of mammograms when the MDC-tempered display was compared with the perceptually linear display.

Perceptual skill, radiology expertise, and visual test performance with NINA and WALDO.

RATIONALE AND OBJECTIVES: The goal of this study was to determine if radiologists possess superior visual search and analysis skills compared with those of laypeople. MATERIALS AND METHODS: In two experiments, radiologists and laypeople searched one of two complex pictorial scenes for hidden targets. Eye position was recorded during the search. Two measures of performance were obtained: accuracy of detecting targets as measured by using alternative free response receiver operating characteristic analysis and visual search efficiency as measured by using eye position analysis. RESULTS: There were no statistically significant differences in detection performance between radiologists and laypeople for either of the search tasks. Radiologists took longer on average to search the images and to first fixate on the targets than did the laypeople. For both groups, true-positive and false-positive decisions were associated with longer dwell times than true-negative decisions. As with radiology search tasks, false-negative decisions were also associated with longer dwell times than true-negative decisions. CONCLUSION: Performance on two visual search and detection tasks indicate that radiologists do not possess superior visual skills compared with laypeople. Radiology expertise is more likely to be a combination of specific visual and cognitive skills derived from medical training and experience in detecting and determining the diagnostic importance of radiographic findings.

Nature of expertise in searching mammograms for breast masses.

RATIONALE AND OBJECTIVES: The authors investigated how training and experience affect the performance of observers searching mammograms for breast masses. METHODS: Eye positions of mammographers, mammography technologists, mammography residents, and laypersons were compared to scan paths generated by a simulated scanner as each searched nine two-view digital mammogram pairs for breast masses. RESULTS: Analysis of time-to-hit data revealed that mammographers and mammography technologists with the most extensive training and experience had the fastest search times in the detection and confirmation of a breast mass on two views. Scanning patterns of less-experienced mammography residents were less efficient due to wider dispersion of visual attention between potential breast masses and perturbations in breast parenchyma. Because laypersons lacked both training and experience in mammography, bright blobs in the breast image were considered to be intuitively valid target candidates and these features distracted the search by capturing visual attention. CONCLUSION: Experience reading normal and abnormal mammograms plays a critical role in training radiologists. Experience combined with training provides the basis for generating efficient visual search strategies and developing distinctive conceptual criteria for perceptual differentiation and interpretation of true breast masses from image artifacts and structured noise that mimics breast abnormalities.

Observer performance in the localization of tubes and catheters on digital chest images: the role of expertise and image enhancement.

RATIONALE AND OBJECTIVES: To determine whether observer performance in the localization of tubes and catheters on computed radiography (CR) chest images can be improved by using an automatic image-processing algorithm. METHODS: Comparisons were made of CR hard-copy, CR soft-copy, and CR enhanced soft-copy images obtained with an image-processing algorithm. The enhanced images used gray-level optimization and nonlinear unsharp masking to emphasize the edges of the devices. Chest radiologists (n = 4), general radiologists (n = 4), and interns (n = 6) read 45 images that contained endotracheal tubes, pulmonary artery catheters, and central venous catheters. RESULTS: Chest radiologists had the smallest mean interobserver localization variability (4 mm), followed by general radiologists (6 mm) and interns (8 mm). Localization variability was greatest for hard-copy images and least for enhanced soft-copy images. CONCLUSION: Use of an automatic imaging-processing algorithm reduced localization variability and enabled the medical interns to perform at approximately the same level as the chest radiologists.

Intrauterine low density in women over 50. Assessment of significance and recommendations for follow-up.

Patients over 50 years old with intrauterine low density on enhanced computed tomography were analyzed. Uterine volume and volume of intrauterine low density were calculated. Intrauterine low density was expressed as a percent of uterine volume. At 1-year follow-up, 23 (63.9%) had uterine malignancy and 13 (36.2%) had benign findings. All patients whose intrauterine low density exceeded 35% of the total uterine volume had a malignancy (p < 0.001). If intrauterine low density exceeds 35% of uterine volume, evaluation of uterine malignancy should be performed regardless of symptoms.

Prospective study of a PACS: information flow and clinical action in a medical intensive care unit.

PURPOSE: To prospectively compare efficiency and outcome of a standard film-only system with those of a digital picture archiving and communication system (PACS). MATERIALS AND METHODS: The film-only system, which used either analog film or computed radiography (CR) hard copy, was compared with a PACS, which used CR images displayed on a multiviewer in the radiology department and a workstation in the medical intensive care unit. A random sample of nonroutine, bedside chest radiographs was studied. RESULTS: Within 20 minutes of completion of radiography, 246 of 328 (75%) of the images were available at the workstations; it took 1.8 hours for 238 of 317 (75%) of the images to be displayed on the multiviewer. When the workstation was used, the staff did not access the image information earlier, but clinical actions were initiated more promptly in response to imaging findings. Consultation with radiologists decreased from 507 of 561 (90%) images with hard copies to 70 of 249 (28%) with the workstation. CONCLUSION: Use of a PACS improves the delivery of chest images, facilitates the initiation of clinical actions, and decreases input by radiologists.

Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs.

PURPOSE: To use the eye position recordings of observers as they read chest images to advance understanding of the mechanism of "satisfaction of search," a phenomenon in which the detection of one abnormality interferes with the detection of other abnormalities. MATERIALS AND METHODS: Eight radiologists examined chest images that contained simulated pulmonary nodules and native abnormalities. Accuracy in detecting nodules and native abnormalities and eye position, gaze duration, and total search time were recorded. RESULTS: Nodule detectability was lower on native abnormality-containing images than it was on normal images (P < .005). Native-abnormality detectability was not negatively affected by the nodules. Most missed nodules were fixated; only those on images without native abnormalities, however, received prolonged visual attention. CONCLUSION: The satisfaction of search phenomenon is an important source of error in the detection of subtle abnormalities but not of obvious abnormalities. Obvious abnormalities capture visual attention and decrease vigilance for more subtle abnormalities.

Searching for bone fractures: a comparison with pulmonary nodule search.

RATIONALE AND OBJECTIVES: We aimed to determine if the characteristics and principles of visual search described for the detection of pulmonary nodules apply to extremity fractures. METHODS: The eye positions of staff orthopedic radiologists, radiology residents, and medical students were monitored as they searched hand and wrist X-ray images for fractures and a chest image for nodules. RESULTS: More systematic scanning patterns were observed for experienced observers than inexperienced observers. Positive decisions for bone images were associated with prolonged gaze durations; prolonged gaze durations were significantly longer for false-negative versus true-negative decisions. Intercluster jump distances were found to be greater for chest images than bone images. CONCLUSIONS: A search for bone fractures can be qualitatively characterized by classifying observer scan paths, dwell times, and jump distances. Gaze duration can be a useful predictor of bone image locations containing potential missed fractures. Perceptual feedback could aid observers in the detection of inconspicuous fractures.

Follow-up of benign hypoechoic peripheral zone lesions of the prostate gland: US characteristics and cancer prevalence.

PURPOSE: To evaluate the role of biopsy-proved benign peripheral zone hypoechoic lesions of the prostate gland, ultrasonographic (US) characteristics at follow-up, prostate-specific antigen (PSA) levels, and digital rectal examination (DRE) in prediction of cancer risk. MATERIALS AND METHODS: Retrospective analysis was performed for 105 consecutive patients with 148 benign hypoechoic lesions discovered at transrectal US (TRUS) and diagnosed with US-guided needle biopsy. At least one repeat TRUS study was performed in each patient. RESULTS: Among the benign lesions, 72% changed at follow-up TRUS, either disappearing or becoming smaller, less hypoechoic, and more vague. Cancer developed in 13% of patients. In 93% of patients in whom cancer developed, the appearance changed in the peripheral zone at follow-up TRUS. In this patient population, the positive predictive value for development of cancer was 16% with a changing TRUS appearance, 19% with an abnormal DRE result, and 27% with an elevated level of PSA; only the latter was statistically significant. CONCLUSION: The PSA value, alone or in combination with a changing TRUS appearance, is the best indicator for development of cancer.

Emergency department screening for ectopic pregnancy: a prospective US study.

PURPOSE: To determine the effectiveness of pelvic sonography as a screening test for ectopic pregnancy. MATERIALS AND METHODS: Pelvic sonograms were prospectively analyzed in 1,427 consecutive patients with a serum level of the beta subunit of human chorionic gonadotropin of over 1,500 IU/L. RESULTS: Sonograms were diagnostic in 1,158 patients and indeterminate in 269. When indeterminate studies were considered falsely negative, the diagnostic accuracy was 81%. Twenty-four percent of patients with indeterminate studies were subsequently proved to have ectopic pregnancy. In ectopic pregnancy (n = 103), the most common finding was a complex adnexal mass (specificity = 92% [P < .001]). The sensitivity and specificity of screening sonography for ectopic pregnancy were 99% and 84%, respectively. CONCLUSION: Pelvic sonography is an effective screening test for ectopic pregnancy. Having a one in four chance of harboring an ectopic pregnancy, patients with indeterminate studies require close follow-up. The presence of a complex adnexal mass is a strong predictor of ectopic pregnancy.

Voiding cystourethrography after radical prostatectomy: normal findings and correlation between contrast extravasation and anastomotic strictures.

OBJECTIVE: Vesicourethral anastomotic strictures are an important complication of radical prostatectomy for prostatic cancer. Their formation has been attributed to extravasation of urine at the anastomosis and to the surgical technique used to construct the anastomosis. Our study examines whether the formation of a vesicourethral anastomotic stricture correlates with (a) contrast extravasation seen on postoperative voiding cystourethrograms and (b) the surgical technique used to construct the vesicourethral anastomosis. We also describe the postoperative appearances of the anastomosis. MATERIALS AND METHODS: One hundred and forty-two patients who underwent radical retropubic prostatectomy at our institution between June 1, 1987, and December 31, 1991, were included in the study. Of these, 101 had a direct end-to-end vesicourethral anastomosis, and 41 had their anastomosis constructed with traction sutures (Vest procedure). Voiding cystourethrograms were obtained 3 weeks after the prostatectomy. The appearance of the anastomosis, the presence of extravasation of contrast material at the anastomotic site, and the relationship of the subsequent formation of an anastomotic stricture to extravasation were evaluated. The influence of the surgical technique used to construct the vesicourethral anastomosis on the development of anastomotic strictures was analyzed. RESULTS: Contrast extravasation at the anastomotic site was seen in 14 (14%) of 101 patients who had a direct procedure and in three (7%) of 41 patients who had a Vest procedure. No relationship was found between contrast extravasation and subsequent formation of a stricture. Anastomotic strictures occurred in 16 (16%) of 101 patients who had a direct anastomosis and in 12 (29%) of 41 patients who had a Vest procedure. The surgical technique used to construct the vesicourethral anastomosis influenced the appearance of the vesicourethral anastomosis on cystourethrograms. CONCLUSION: Contrast extravasation at the anastomotic site is not infrequently seen on voiding cystourethrograms obtained after radical retropubic prostatectomy and resolves with continued drainage via a Foley catheter. As long as catheters are left in place until anastomotic healing is complete, extravasation of contrast material (implying urine extravasation at the anastomotic site) does not influence the subsequent formation of anastomotic strictures. Anastomoses that heal more slowly are no more likely to develop strictures than normally healing ones. Construction of the vesicourethral anastomosis by using the Vest procedure is a significant risk factor for stricture formation.

Perceptual enhancement of tumor targets in chest X-ray images.

Under tachistoscopic viewing conditions, precuing the location of potential lung tumor targets in chest X-ray images was less effective than precuing followed by bounding the region of interest (ROI) with a circle directly on the image. Detection performance increased as the image was systematically masked so that its size approximated that of the circled ROI. When viewing time was extended to allow shifts in eye position, circling the ROI was found to restrict the dispersion of fixations and increase the accuracy of fixating the target tumor. When targets were placed outside the ROI, the circle inhibited their detection relative to detection of targets inside the circled region. These findings suggest that cuing by circling restricts target detection to the ROI, and by doing so reduces the interfering effects of outside distractors that complete with the target for attention.

A perceptually based method for enhancing pulmonary nodule recognition.

RATIONALE AND OBJECTIVES: Feedback of chest areas receiving prolonged gaze durations significantly increases nodule detection performance. Why feedback circling enhances performance when other cueing methods produce equivocal results was assessed. METHODS: Chest and noise images with nodule targets were used to determine: what type of cue is most effective; whether circling influences the way the eye samples the target; whether circling limits processing of distracting information outside its boundary. RESULTS: Circling improves performance more than cues with less complete boundaries and increases the accuracy and frequency with which nodules are fixated. Outside distractors were detected less often with than without the circle present. CONCLUSIONS: Circling isolates the abnormal region from the rest of the image, making disembedding and integration of nodule features more likely and insulates this region from distractors. The facilitative effects of circling are generalizable to other images in which low contrast targets are embedded in noisy backgrounds.

Searching for lung nodules. The guidance of visual scanning.

Four subjects searched a chest image for lung nodules using an eye position-dependent display that presented the image of a nodule selectively to either the central or peripheral visual field, while preserving the appearance of the chest. The time required to scan the image and fixate the nodule was shortest for nodules that were both reported and accessible to the peripheral vision. A stepwise concentric reduction in the size of the peripheral field that could access the nodules only affected search performance when the field was less than 5 degrees. (A chest image subtends about 25 degrees.) These data support the hypothesis that the optimal scanning strategy for lung nodules consists of spacing fixation clusters 5 degrees apart, and that peripheral vision only acts as an adjunct in guiding the gaze to inconspicuous nodules.