A Perioperative Care Display for Understanding High Acuity Patients.

BACKGROUND: The data visualization literature asserts that the details of the optimal data display must be tailored to the specific task, the background of the user, and the characteristics of the data. The general organizing principle of a concept-oriented display is known to be useful for many tasks and data types. OBJECTIVES: In this project, we used general principles of data visualization and a co-design process to produce a clinical display tailored to a specific cognitive task, chosen from the anesthesia domain, but with clear generalizability to other clinical tasks. To support the work of the anesthesia-in-charge (AIC) our task was, for a given day, to depict the acuity level and complexity of each patient in the collection of those that will be operated on the following day. The AIC uses this information to optimally allocate anesthesia staff and providers across operating rooms. METHODS: We used a co-design process to collaborate with participants who work in the AIC role. We conducted two in-depth interviews with AICs and engaged them in subsequent input on iterative design solutions. RESULTS: Through a co-design process, we found (1) the need to carefully match the level of detail in the display to the level required by the clinical task, (2) the impedance caused by irrelevant information on the screen such as icons relevant only to other tasks, and (3) the desire for a specific but optional trajectory of increasingly detailed textual summaries. CONCLUSION: This study reports a real-world clinical informatics development project that engaged users as co-designers. Our process led to the user-preferred design of a single binary flag to identify the subset of patients needing further investigation, and then a trajectory of increasingly detailed, text-based abstractions for each patient that can be displayed when more information is needed.

Visualization of aggregate perioperative data improves anesthesia case planning: A randomized, cross-over trial.

STUDY OBJECTIVE: A challenge in reducing unwanted care variation is effectively managing the wide variety of performed surgical procedures. While an organization may perform thousands of types of cases, privacy and logistical constraints prevent review of previous cases to learn about prior practices. To bridge this gap, we developed a system for extracting key data from anesthesia records. Our objective was to determine whether usage of the system would improve case planning performance for anesthesia residents. DESIGN: Randomized, cross-over trial. SETTING: Vanderbilt University Medical Center. MEASUREMENTS: We developed a web-based, data visualization tool for reviewing de-identified anesthesia records. First year anesthesia residents were recruited and performed simulated case planning tasks (e.g., selecting an anesthetic type) across six case scenarios using a randomized, cross-over design after a baseline assessment. An algorithm scored case planning performance based on care components selected by residents occurring frequently among prior anesthetics, which was scored on a 0-4 point scale. Linear mixed effects regression quantified the tool effect on the average performance score, adjusting for potential confounders. MAIN RESULTS: We analyzed 516 survey questionnaires from 19 residents. The mean performance score was 2.55 ± SD 0.32. Utilization of the tool was associated with an average score improvement of 0.120 points (95% CI 0.060 to 0.179; p < 0.001). Additionally, a 0.055 point improvement due to the "learning effect" was observed from each assessment to the next (95% CI 0.034 to 0.077; p < 0.001). Assessment score was also significantly associated with specific case scenarios (p < 0.001). CONCLUSIONS: This study demonstrated the feasibility of developing of a clinical data visualization system that aggregated key anesthetic information and found that the usage of tools modestly improved residents' performance in simulated case planning.

User-Centered Clinical Display Design Issues for Inpatient Providers.

BACKGROUND: Suboptimal information display in electronic health records (EHRs) is a notorious pain point for users. Designing an effective display is difficult, due in part to the complex and varied nature of clinical practice. OBJECTIVE: This article aims to understand the goals, constraints, frustrations, and mental models of inpatient medical providers when accessing EHR data, to better inform the display of clinical information. METHODS: A multidisciplinary ethnographic study of inpatient medical providers. RESULTS: Our participants' primary goal was usually to assemble a clinical picture around a given question, under the constraints of time pressure and incomplete information. To do so, they tend to use a mental model of multiple layers of abstraction when thinking of patients and disease; they prefer immediate pattern recognition strategies for answering clinical questions, with breadth-first or depth-first search strategies used subsequently if needed; and they are sensitive to data relevance, completeness, and reliability when reading a record. CONCLUSION: These results conflict with the ubiquitous display design practice of separating data by type (test results, medications, notes, etc.), a mismatch that is known to encumber efficient mental processing by increasing both navigation burden and memory demands on users. A popular and obvious solution is to select or filter the data to display exactly what is presumed to be relevant to the clinical question, but this solution is both brittle and mistrusted by users. A less brittle approach that is more aligned with our users' mental model could use abstraction to summarize details instead of filtering to hide data. An abstraction-based approach could allow clinicians to more easily assemble a clinical picture, to use immediate pattern recognition strategies, and to adjust the level of displayed detail to their particular needs. It could also help the user notice unanticipated patterns and to fluidly shift attention as understanding evolves.

A workshop on leadership for senior MD-PhD students.

Leadership skills are essential for a successful career as a physician-scientist, yet many MD-PhD training programs do not offer formal training in leadership. The Vanderbilt Medical Scientist Training Program (MSTP) previously established a 2-day leadership workshop that has been held biennially since 2006 for students in the first and second years of the graduate school portion of combined MD and PhD training (G1/G2 students). Workshop attendees have consistently rated this workshop as a highly effective experience. However, opportunities for structured training in leadership competencies during the subsequent 3-5 years of MD-PhD training are limited. Given the success of the G1/G2 leadership workshop and the need for continuity in this model of leadership training, we developed a half-day workshop for MSTP students in the clinical years of medical school (M3/M4 students) to foster continued training in leadership. Our workshop curriculum, based in part on original cases drafted by Vanderbilt MSTP students, provides concrete strategies to manage conflict and navigate leadership transitions in the physician-scientist career path. The curriculum emphasizes both short-term competencies, such as effective participation as a member of a clinical team, and long-term competencies, such as leadership of a research team, division, or department. Our inaugural senior leadership workshop, held in August, 2015, was judged by student participants to be well organized and highly relevant to leadership concepts and skills. It will be offered biennially in our training curriculum for M3 and M4 MSTP students.

A workshop on leadership for MD/PhD students.

Success in academic medicine requires scientific and clinical aptitude and the ability to lead a team effectively. Although combined MD/PhD training programs invest considerably in the former, they often do not provide structured educational opportunities in leadership, especially as applied to investigative medicine. To fill a critical knowledge gap in physician-scientist training, the Vanderbilt Medical Scientist Training Program (MSTP) developed a biennial two-day workshop in investigative leadership. MSTP students worked in partnership with content experts to develop a case-based curriculum and deliver the material. In its initial three offerings in 2006, 2008, and 2010, the workshop was judged by MSTP student attendees to be highly effective. The Vanderbilt MSTP Leadership Workshop offers a blueprint for collaborative student-faculty interactions in curriculum design and a new educational modality for physician-scientist training.