Teaching through their eyes: effects on optometry teachers' adaptivity and students' learning when teachers see students' gaze.

Adaptive teacher support fosters effective learning in one-to-one teaching sessions, which are a common way of learning complex visual tasks in the health sciences. Adaptive support is tailored to student needs, and this is difficult in complex visual tasks as visual problem-solving processes are covert and thus cannot be directly observed by the teacher. Eye-tracking apparatus can measure covert processes and make them visible in gaze displays: visualizations of where a student looks while executing a task. We investigate whether live dynamic gaze displays help teachers in being more adaptive to students' needs when teaching optical coherence tomography interpretation in one-to-one teaching sessions and whether this fosters learning. Forty-nine students and 10 teachers participated in a one-to-one teaching session in clinical optometry. In the control condition, teachers saw the learning task of the student and could discuss it with them, whereas in the gaze-display condition, teachers could additionally see where the student looked. After the 15-minute teaching session, a test was administered to examine achievement. Furthermore, students filled in the 'questionnaire on teacher support adaptivity', and teachers rated how adaptive their support was. Bayesian analyses provide some initial evidence that students did not experience support to be more adaptive in the gaze-display condition versus the control condition, nor were their post-test scores higher. Teachers rated their provided support as being more adaptive in the gaze-display versus the control condition. Further research could investigate if live dynamic gaze displays impact adaptive teaching when used over longer periods or with more teacher training.

The effects of gaze-display feedback on medical students' self-monitoring and learning in radiology.

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants' estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.

Detection and Identification of an Unknown Impurity in Ephedrine HCl 5 mg/mL Cyclic Olefin Syringes: Formulation Development.

An unknown impurity was detected in in-house prepared ephedrine hydrochloride (HCl) 5 mg/mL prefilled sterilized syringes when applying a stability-indicating British Pharmacopoeia 2018 impurity method for ephedrine injection. Ultraviolet, chromatographic, mass spectral, and physicochemical methods were combined to identify the unknown impurity. The unknown impurity was identified as methcathinone, which is generated from ephedrine drug substance through an oxidation reaction. A formulation study, in which different process adjustments were tested, was carried out to reduce the amount of unknown impurity. Nitrogen gassing in combination with 0.05 M citrate buffer addition proved to be the most potent process adjustment in reducing methcathinone formation in ephedrine HCl 5 mg/mL prefilled sterilized syringes after 4 months of storage in the dark at room temperature (20 °C ± 5 °C). More detailed research on the long-term stability of the reformulated ephedrine HCl drug product is currently underway, with promising results for up to 9 months gathered already.

Potential, Limitations and Risks of Cannabis-Derived Products in Cancer Treatment.

The application of cannabis products in oncology receives interest, especially from patients. Despite the plethora of research data available, the added value in curative or palliative cancer care and the possible risks involved are insufficiently proven and therefore a matter of debate. We aim to give a recommendation on the position of cannabis products in clinical oncology by assessing recent literature. Various types of cannabis products, characteristics, quality and pharmacology are discussed. Standardisation is essential for reliable and reproducible quality. The oromucosal/sublingual route of administration is preferred over inhalation and drinking tea. Cannabinoids may inhibit efflux transporters and drug-metabolising enzymes, possibly inducing pharmacokinetic interactions with anticancer drugs being substrates for these proteins. This may enhance the cytostatic effect and/or drug-related adverse effects. Reversely, it may enable dose reduction. Similar interactions are likely with drugs used for symptom management treating pain, nausea, vomiting and anorexia. Cannabis products are usually well tolerated and may improve the quality of life of patients with cancer (although not unambiguously proven). The combination with immunotherapy seems undesirable because of the immunosuppressive action of cannabinoids. Further clinical research is warranted to scientifically support (refraining from) using cannabis products in patients with cancer.

Did You Get That? Predicting Learners' Comprehension of a Video Lecture from Visualizations of Their Gaze Data.

In online lectures, unlike in face-to-face lectures, teachers lack access to (nonverbal) cues to check if their students are still "with them" and comprehend the lecture. The increasing availability of low-cost eye-trackers provides a promising solution. These devices measure unobtrusively where students look and can visualize these data to teachers. These visualizations might inform teachers about students' level of "with-me-ness" (i.e., do students look at the information that the teacher is currently talking about) and comprehension of the lecture, provided that (1) gaze measures of "with-me-ness" are related to comprehension, (2) people not trained in eye-tracking can predict students' comprehension from gaze visualizations, (3) we understand how different visualization techniques impact this prediction. We addressed these issues in two studies. In Study 1, 36 students watched a video lecture while being eye-tracked. The extent to which students looked at relevant information and the extent to which they looked at the same location as the teacher both correlated with students' comprehension (score on an open question) of the lecture. In Study 2, 50 participants watched visualizations of students' gaze (from Study 1), using six visualization techniques (dynamic and static versions of scanpaths, heatmaps, and focus maps) and were asked to predict students' posttest performance and to rate their ease of prediction. We found that people can use gaze visualizations to predict learners' comprehension above chance level, with minor differences between visualization techniques. Further research should investigate if teachers can act on the information provided by gaze visualizations and thereby improve students' learning.

Eye tracking: empirical foundations for a minimal reporting guideline.

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").

Holistic processing only? The role of the right fusiform face area in radiological expertise.

Radiologists can visually detect abnormalities on radiographs within 2s, a process that resembles holistic visual processing of faces. Interestingly, there is empirical evidence using functional magnetic resonance imaging (fMRI) for the involvement of the right fusiform face area (FFA) in visual-expertise tasks such as radiological image interpretation. The speed by which stimuli (e.g., faces, abnormalities) are recognized is an important characteristic of holistic processing. However, evidence for the involvement of the right FFA in holistic processing in radiology comes mostly from short or artificial tasks in which the quick, 'holistic' mode of diagnostic processing is not contrasted with the slower 'search-to-find' mode. In our fMRI study, we hypothesized that the right FFA responds selectively to the 'holistic' mode of diagnostic processing and less so to the 'search-to-find' mode. Eleven laypeople and 17 radiologists in training diagnosed 66 radiographs in 2s each (holistic mode) and subsequently checked their diagnosis in an extended (10-s) period (search-to-find mode). During data analysis, we first identified individual regions of interest (ROIs) for the right FFA using a localizer task. Then we employed ROI-based ANOVAs and obtained tentative support for the hypothesis that the right FFA shows more activation for radiologists in training versus laypeople, in particular in the holistic mode (i.e., during 2s trials), and less so in the search-to-find mode (i.e., during 10-s trials). No significant correlation was found between diagnostic performance (diagnostic accuracy) and brain-activation level within the right FFA for both, short-presentation and long-presentation diagnostic trials. Our results provide tentative evidence from a diagnostic-reasoning task that the FFA supports the holistic processing of visual stimuli in participants' expertise domain.

Expertise development in volumetric image interpretation of radiology residents: what do longitudinal scroll data reveal?

The current study used theories on expertise development (the holistic model of image perception and the information reduction hypothesis) as a starting point to identify and explore potentially relevant process measures to monitor and evaluate expertise development in radiology residency training. It is the first to examine expertise development in volumetric image interpretation (i.e., CT scans) within radiology residents using scroll data collected longitudinally over five years of residency training. Consistent with the holistic model of image perception, the percentage of time spent on full runs, i.e. scrolling through more than 50% of the CT-scan slices (global search), decreased within residents over residency training years. Furthermore, the percentage of time spent on question-relevant areas in the CT scans increased within residents over residency training years, consistent with the information reduction hypothesis. Second, we examined if scroll patterns can predict diagnostic accuracy. The percentage of time spent on full runs and the percentage of time spent on question-relevant areas did not predict diagnostic accuracy. Thus, although scroll patterns over training years are consistent with visual expertise theories, they could not be used as predictors of diagnostic accuracy in the current study. Therefore, the relation between scroll patterns and performance needs to be further examined, before process measures can be used to monitor and evaluate expertise development in radiology residency training.

How Experts Adapt Their Gaze Behavior When Modeling a Task to Novices.

Domain experts regularly teach novice students how to perform a task. This often requires them to adjust their behavior to the less knowledgeable audience and, hence, to behave in a more didactic manner. Eye movement modeling examples (EMMEs) are a contemporary educational tool for displaying experts' (natural or didactic) problem-solving behavior as well as their eye movements to learners. While research on expert-novice communication mainly focused on experts' changes in explicit, verbal communication behavior, it is as yet unclear whether and how exactly experts adjust their nonverbal behavior. This study first investigated whether and how experts change their eye movements and mouse clicks (that are displayed in EMMEs) when they perform a task naturally versus teach a task didactically. Programming experts and novices initially debugged short computer codes in a natural manner. We first characterized experts' natural problem-solving behavior by contrasting it with that of novices. Then, we explored the changes in experts' behavior when being subsequently instructed to model their task solution didactically. Experts became more similar to novices on measures associated with experts' automatized processes (i.e., shorter fixation durations, fewer transitions between code and output per click on the run button when behaving didactically). This adaptation might make it easier for novices to follow or imitate the expert behavior. In contrast, experts became less similar to novices for measures associated with more strategic behavior (i.e., code reading linearity, clicks on run button) when behaving didactically.

Redefining the structure of structured reporting in radiology.

Structured reporting is advocated as a means of improving reporting in radiology to the ultimate benefit of both radiological and clinical practice. Several large initiatives are currently evaluating its potential. However, with numerous characterizations of the term in circulation, "structured reporting" has become ambiguous and is often confused with "standardization," which may hamper proper evaluation and implementation in clinical practice. This paper provides an overview of interpretations of structured reporting and proposes a clear definition that differentiates structured reporting from standardization. Only a clear uniform definition facilitates evidence-based implementation, enables evaluation of its separate components, and supports (meta-)analyses of literature reports.

Reversal of the hanging protocol of Contrast Enhanced Mammography leads to similar diagnostic performance yet decreased reading times.

OBJECTIVES: Contrast-enhanced mammography (CEM) was found superior to Full-Field Digital Mammography (FFDM) for breast cancer detection. Current hanging protocols show low-energy (LE, similar to FFDM) images first, followed by recombined (RC) images. However, evidence regarding which hanging protocol leads to the most efficient reading process and highest diagnostic performance is lacking. This study investigates the effects of hanging-protocol ordering on the reading process and diagnostic performance of breast radiologists using eye-tracking methodology. Furthermore, it investigates differences in reading processes and diagnostic performance between LE, RC and FFDM images. MATERIALS AND METHODS: Twenty-seven breast radiologists were randomized into three reading groups: LE-RC (commonly used hangings), RC-LE (reversed hangings) and FFDM. Thirty cases (nine malignant) were used. Fixation count, net dwell time and time-to-first fixation on malignancies as visual search measures were registered by the eye-tracker. Reading time per image was measured. Participants clicked on suspicious lesions to determine sensitivity and specificity. Area-under-the-ROC-curve (AUC) values were calculated. RESULTS: RC-LE scored identical on visual search measures, t(16)= -1.45, p = .17 or higher-p values, decreased reading time with 31%, t(16)= -2.20, p = .04, while scoring similar diagnostic performance compared to LE-RC, t(13.2) = -1.39, p - .20 or higher p-values. The reading process was more efficient on RC compared to LE. Diagnostic performance of CEM was superior to FFDM; F (2,26) = 16.1, p < .001. Average reading time did not differ between the three groups, F (2,25) = 3.15, p = .06. CONCLUSION: The reversed CEM hanging protocol (RC-LE) scored similar on diagnostic performance compared to LE-RC, while reading time was a third faster. Abnormalities were interpreted quicker on RC images. A RC-LE hanging protocol is therefore recommended for clinical practice and training. Diagnostic performance of CEM was (again) superior to FFDM.

Chest X-ray evaluation training: impact of normal and abnormal image ratio and instructional sequence.

CONTEXT: Medical image perception training generally focuses on abnormalities, whereas normal images are more prevalent in medical practice. Furthermore, instructional sequences that let students practice prior to expert instruction (inductive) may lead to improved performance compared with methods that give students expert instruction before practice (deductive). This study investigates the effects of the proportion of normal images and practice-instruction order on learning to interpret medical images. It is hypothesised that manipulation of the proportion of normal images will lead to a sensitivity-specificity trade-off and that students in practice-first (inductive) conditons need more time per practice case but will correctly identify more test cases. METHODS: Third-year medical students (n = 103) learned radiograph interpretation by practising cases with, respectively, 30% or 70% normal radiographs prior to expert instruction (practice-first order) or after expert instruction (instruction-first order). After training, students performed a test (60% normal) and sensitivity (% of correctly identified abnormal radiographs), specificity (% of correctly identified normal radiographs), diagnostic performance (% of correct diagnoses) and case duration were measured. RESULTS: The conditions with 30% of normal images scored higher on sensitivity but the conditions with 70% of normal images scored higher on specificity, indicating a sensitivity and specificity trade-off. Those who participated in inductive conditions took less time per practice case but more per test case. They had similar test sensitivity, but scored lower on test specificity. CONCLUSIONS: The proportion of normal images impacted the sensitivity-specificity trade-off. This trade-off should be an important consideration for the alignment of training with future practice. Furthermore, the deductive conditions unexpectedly scored higher on specificity when participants took less time per case. An inductive approach did not lead to higher diagnostic performance, possibly because participants might already have relevant prior knowledge. Deductive approaches are therefore advised for the training of advanced learners.

The Neural Implementation of Surgical Expertise Within the Mirror-Neuron System: An fMRI Study.

Motor expertise is an important aspect of high-level performance in professional tasks such as surgery. While recently it has been shown that brain activation as measured by functional magnetic resonance imaging (fMRI) within the mirror-neuron system (MNS) is modulated by expertise in sports and music, little is known about the neural underpinnings of professional, e.g., surgical expertise. Here, we investigated whether and (if so) how surgical expertise is implemented in the MNS in medical professionals across three levels of surgical qualification. In order to answer the more specific research question, namely, if the neural implementation of motor expertise develops in a linear or non-linear fashion, the study compares not only brain activation within the MNS related to action observation of novices and experts, but also intermediates. Ten novices (medical students), ten intermediates (residents in orthopedic surgery) and ten experts (orthopedic surgeons) watched 60 video clips (5 s each) of daily-life activities and surgical procedures each while their brain activation was measured using a 3-T fMRI scanner. An established localization procedure was followed to functionally define the MNS for each participant individually. A 2 (video type: daily-life activities, surgical procedures) × 3 (expertise level: novice, intermediate, expert) ANOVA yielded a non-significant interaction. Furthermore, separate analyses of the precentral and parietal part of the MNS also yielded non-significant interactions. However, post hoc comparisons showed that intermediates displayed marginally significantly lower brain activation in response to surgery-related videos within the MNS than novices. No other significant differences were found. We did not find evidence for the hypothesis that the brain-activation level in the MNS evoked by observing surgical videos reflects the level of surgical expertise in the professional task of (orthopedic) surgery. However, the results suggest a potential non-linear relationship between expertise level and MNS-activation level.

Optimizing self-regulation of performance: is mental effort a cue?

Accurate self-regulation of performance is important for trainees. Trainees rely on cues to make monitoring judgments to self-regulate their performance. Ideally, cues and monitoring judgements accurately reflect performance, as measured by cue diagnosticity (the ability of a cue to predict performance) and monitoring accuracy (the ability of a monitoring judgement to predict performance). However, this process is far from perfect, emphasizing the need for more accurate cues and monitoring judgements. Perhaps the mental effort of a task could be a cue used to inform certainty judgements. The purpose of this study is to measure cue utilization and cue diagnosticity of mental effort and monitoring accuracy of certainty for self-regulation of performance. Focused on the task of ECG interpretation, 22 PGY 1-3 Internal Medicine residents at McMaster University provided a diagnosis for 10 ECGs, rating their level of certainty (0-100%) and mental effort (Paas scale, 1-9). 220 ECGs completed by 22 participants were analyzed using path analysis. There was a negative moderate path coefficient between certainty and mental effort (ß = - 0.370, p < 0.001), reflecting cue utilization. Regarding cue diagnosticity of mental effort, this was reflected in a small negative path coefficient between mental effort and diagnostic accuracy (ß = - 0.170, p = 0.013). Regarding monitoring accuracy, a moderate path coefficient was observed between certainty and diagnostic accuracy (ß = 0.343, p < 0.001). Our results support mental effort as a cue and certainty as a monitoring judgement for self-regulated performance. Yet, reported correlations are not very high. Future research is needed to identify additional cues.

Even if I showed you where you looked, remembering where you just looked is hard.

People know surprisingly little about their own visual behavior, which can be problematic when learning or executing complex visual tasks such as search of medical images. We investigated whether providing observers with online information about their eye position during search would help them recall their own fixations immediately afterwards. Seventeen observers searched for various objects in "Where's Waldo" images for 3 s. On two-thirds of trials, observers made target present/absent responses. On the other third (critical trials), they were asked to click twelve locations in the scene where they thought they had just fixated. On half of the trials, a gaze-contingent window showed observers their current eye position as a 7.5° diameter "spotlight." The spotlight "illuminated" everything fixated, while the rest of the display was still visible but dimmer. Performance was quantified as the overlap of circles centered on the actual fixations and centered on the reported fixations. Replicating prior work, this overlap was quite low (26%), far from ceiling (66%) and quite close to chance performance (21%). Performance was only slightly better in the spotlight condition (28%, p = 0.03). Giving observers information about their fixation locations by dimming the periphery improved memory for those fixations modestly, at best.

Does the Use of a Checklist Help Medical Students in the Detection of Abnormalities on a Chest Radiograph?

The interpretation of chest radiographs is a complex task that is prone to diagnostic error, especially for medical students. The aim of this study is to investigate the extent to which medical students benefit from the use of a checklist regarding the detection of abnormalities on a chest radiograph. We developed a checklist based on literature and interviews with experienced thorax radiologists. Forty medical students in the clinical phase assessed 18 chest radiographs during a computer test, either with (n = 20) or without (n = 20) the checklist. We measured performance and asked participants for feedback using a survey. Participants that used a checklist detected more abnormalities on images with multiple abnormalities (M = 50.1%) than participants that could not use a checklist (M = 41.9%), p = 0.04. The post-experimental survey shows that on average, participants considered the checklist helpful (M = 3.25 on a five-point scale), but also time consuming (M = 3.30 on a five-point scale). In conclusion, a checklist can help medical students to detect abnormalities in chest radiographs. Moreover, students tend to appreciate the use of a checklist as a helpful tool during the interpretation of a chest radiograph. Therefore, a checklist is a potentially important tool to improve radiology education in the medical curriculum.

What We Do and Do Not Know about Teaching Medical Image Interpretation.

Educators in medical image interpretation have difficulty finding scientific evidence as to how they should design their instruction. We review and comment on 81 papers that investigated instructional design in medical image interpretation. We distinguish between studies that evaluated complete offline courses and curricula, studies that evaluated e-learning modules, and studies that evaluated specific educational interventions. Twenty-three percent of all studies evaluated the implementation of complete courses or curricula, and 44% of the studies evaluated the implementation of e-learning modules. We argue that these studies have encouraging results but provide little information for educators: too many differences exist between conditions to unambiguously attribute the learning effects to specific instructional techniques. Moreover, concepts are not uniformly defined and methodological weaknesses further limit the usefulness of evidence provided by these studies. Thirty-two percent of the studies evaluated a specific interventional technique. We discuss three theoretical frameworks that informed these studies: diagnostic reasoning, cognitive schemas and study strategies. Research on diagnostic reasoning suggests teaching students to start with non-analytic reasoning and subsequently applying analytic reasoning, but little is known on how to train non-analytic reasoning. Research on cognitive schemas investigated activities that help the development of appropriate cognitive schemas. Finally, research on study strategies supports the effectiveness of practice testing, but more study strategies could be applicable to learning medical image interpretation. Our commentary highlights the value of evaluating specific instructional techniques, but further evidence is required to optimally inform educators in medical image interpretation.