A Preliminary Study of Clinical Abbreviation Disambiguation in Real Time.

OBJECTIVE: To save time, healthcare providers frequently use abbreviations while authoring clinical documents. Nevertheless, abbreviations that authors deem unambiguous often confuse other readers, including clinicians, patients, and natural language processing (NLP) systems. Most current clinical NLP systems "post-process" notes long after clinicians enter them into electronic health record systems (EHRs). Such post-processing cannot guarantee 100% accuracy in abbreviation identification and disambiguation, since multiple alternative interpretations exist. METHODS: Authors describe a prototype system for real-time Clinical Abbreviation Recognition and Disambiguation (rCARD) - i.e., a system that interacts with authors during note generation to verify correct abbreviation senses. The rCARD system design anticipates future integration with web-based clinical documentation systems to improve quality of healthcare records. When clinicians enter documents, rCARD will automatically recognize each abbreviation. For abbreviations with multiple possible senses, rCARD will show a ranked list of possible meanings with the best predicted sense at the top. The prototype application embodies three word sense disambiguation (WSD) methods to predict the correct senses of abbreviations. We then conducted three experments to evaluate rCARD, including 1) a performance evaluation of different WSD methods; 2) a time evaluation of real-time WSD methods; and 3) a user study of typing clinical sentences with abbreviations using rCARD. RESULTS: Using 4,721 sentences containing 25 commonly observed, highly ambiguous clinical abbreviations, our evaluation showed that the best profile-based method implemented in rCARD achieved a reasonable WSD accuracy of 88.8% (comparable to SVM - 89.5%) and the cost of time for the different WSD methods are also acceptable (ranging from 0.630 to 1.649 milliseconds within the same network). The preliminary user study also showed that the extra time costs by rCARD were about 5% of total document entry time and users did not feel a significant delay when using rCARD for clinical document entry. CONCLUSION: The study indicates that it is feasible to integrate a real-time, NLP-enabled abbreviation recognition and disambiguation module with clinical documentation systems.

Expanding the scope of health information systems - from hospitals to regional networks, to national infrastructures, and beyond.

OBJECTIVES: To identify current developments, obstacles, and opportunities for health information systems. METHODS: International reports were discussed during an IMIA HIS Working Conference with a focus on architectural design, project goals and drivers, obstacles, and opportunities. RESULTS: Technology and standards are available to build regional and national health IT networks, and successful implementations are currently being realized. There is, however, little consensus and communication concerning goals, benefits and risks of large-scale health IT initiatives. Complexity tends to be under-estimated, and the public needs to be more involved in the decision-making process. CONCLUSION: On all levels and across borders, a climate of exchange of ideas, experiences - both successes and failures-, policies, standards, systems, and information should be created.

Expanding the scope of health information systems. Challenges and developments.

OBJECTIVES: To identify current challenges and developments in health information systems. METHODS: Reports on HIS, eHealth and process support were analyzed, core problems and challenges were identified. RESULTS AND CONCLUSION: Health information systems are extending their scope towards regional networks and health IT infrastructures. Integration, interoperability and interaction design are still today's core problems. Additional problems arise through the integration of genetic information into the health care process. There are noticeable trends towards solutions for these problems.

Equations to support predictive automated postnatal growth curves for premature infants.

Growth charts are used in pediatric medicine to plot anthropomorphic measurements over time, serving as a screen for diseases related to a patient's nutritional and general health status. Whereas reference data for term infants are available from the Center for Disease Control, reference data for premature infants in a neonatal intensive care unit have not been established. Predictive curves for preterm patients, which are based on a patient's postmenstrual age and anthropomorphic measurements at birth, cannot be easily implemented with traditional paper-based methods. Preterm growth charts can be generated in an electronic health record system, but doing so requires mathematical equations or computer-readable tables. This report examines published perinatal growth curves and presents equations for predicted postnatal weight, head circumference and length in preterm infants.

Provider order entry with integrated decision support: from academia to industry.

OBJECTIVES: To describe the evolution of a provider order entry system with integrated decision support, from a research prototype to full implementation at one academic center, and finally to a commercial product. METHODS: Describe the institutional environment and planning process in which the system originated. Highlight the historical evolution of the provider entry system, and analyze its system architecture and functionality. Describe the requirements for successful design and deployment both within a single health care organization and as part of a commercial product line. RESULTS: Over a period of eight years the system evolved from a research prototype to a fully integrated order entry system in routine use on most inpatient units of a large academic medical center. Around 12,000 orders are entered every day into the computer system; 70% of those are entered directly by the responsible physician. The system embeds best-of-care practice guidelines, and is used to reduce resource utilization by limiting unnecessary testing and suggesting more effective or less costly therapeutic replacements. The system was recently acquired by a large HIS software vendor and is being rapidly implemented at numerous customer sites. CONCLUSIONS: Large-scale development or deployment of complex health information systems requires considerable organizational agreement and resources, as well as close attention to iterative system design that explicitly includes constant feedback from the user community. The transformation of such a system from a single-site success to a widely deployed product requires convergence of resources and needs.

From hospital information systems to health information systems. Problems, challenges, perspectives.

OBJECTIVES: Hospital information systems are evolving towards health information systems. This article aims at identifying both proven benefits and critical issues, and at discussing problems and possible solutions. METHODS: Reports on HIS successes and failures were analyzed, and core challenges were identified. These challenges are discussed against state of the art solutions. RESULTS: In spite of demonstrated benefits, there are more severe problems than reports on successes suggest. Among today's core problems are integration, human-computer interaction, socio-technical issues, and support of processes. CONCLUSIONS: Significant efforts of all parties involved in the health care process are needed to improve, implement, and evaluate the concepts described.

Preparing librarians to meet the challenges of today's health care environment.

OBJECTIVE: Refine the understanding of the desirable skills for health sciences librarians as a basis for developing a training program model that reflects the fundamental changes in health care delivery and information technology. DESIGN: A four-step needs assessment process: focus groups developed lists of desirable skills; the research team organized candidate skills into a taxonomy; a survey of a random sample of librarians and library users assessed perception of importance of individual skills; and the research team framed, as a unifying hypothesis, a training model. SURVEY METHODS: The survey was distributed to random samples of 150 librarians, stratified by type of library, and 150 library users, stratified by type of use. A non-randomized sample was obtained by mounting the survey on a World Wide Web server. The survey instrument included 96 distinct skills organized into 13 categories. Respondents rated the importance of each skill on a Likert scale and provided a separate ranking by identifying the ten most important skills for the profession. RESULTS: Among the participants, 51% of librarians and 36% of library users responded to the survey. All categories of skills were rated above the midpoint of priority on the Likert scale. All groups rated personality characteristics and skills as most important, with an understanding of the health sciences, education, and research being rated comparably to technical skills. CONCLUSIONS: Health sciences librarians need a new educational model that provides them with broad-based tools to discover new roles and new resources for acquiring individual skills as the need arises. A unifying training model would involve trainees in developing their learning plan in a way that promotes proactive inquiry and self-directed learning, and it would rotate the trainees through projects to provide skills and an understanding of end-user work processes.

Cross-institutional reuse of a problem statement knowledge base.

This article describes client and server applications for a problem statement knowledge base derived from a large corpus of provider entered terminology. The current status and potential for integration of the server into the Vanderbilt University Medical Center computing environment are discussed. Finally, an experiment in multiple dimensions of reuse for problem list terms is introduced, and possible strategies to mediate between free text and coded data are examined.

Integrating health sciences librarians into biomedicine.

Vanderbilt University Medical Center (VUMC) developed a model training program to prepare current and future health sciences librarians for roles that are integrated into the diverse fabric of the health care professions. As a complement to the traditional and theoretical aspects of a librarian's education, this mixture of supplemental coursework and intensive practical training emphasizes active management of information, problem-solving skills, learning in context, and direct participation in research, while providing the opportunity for advanced academic pursuits. The practical training will take place under the auspices of an established Integrated Advanced Information Management Systems (IAIMS) library that is fully integrated with the Health Center Information Management Unit and Academic Biomedical Informatics Unit. During the planning phase, investigators are analyzing the model's aims and requirements, concentrating on (a) refining the current understanding of the roles health sciences librarians occupy; (b) developing educational strategies that prepare librarians to fulfill expanded roles; and (c) planning for an evaluation process that will support iterative revision and refinement of the model.

Increasing the availability of the computerized patient record.

The MARS clinical repository, originally developed at the University of Pittsburgh, provides electronic access to the patient record at Vanderbilt University Medical Center. The original client interface we developed runs on all standard clinical workstations in the medical center, but is operating-system dependent. Porting and maintaining it on the variety of hardware- and software combinations found on VUMC personal computers would be fairly costly. To broaden the availability of the system to faculty and health care providers in all areas, and to support future access from Vanderbilt-affiliated providers outside the main campus, we are developing a new Web-based client. The new client provides good functionality and performance, and will be a strategic asset in our long-term commitment to making relevant clinical information immediately available to authorized health care providers.

Evaluation of long-term maintenance of a large medical knowledge base.

OBJECTIVE: Evaluate the effects of long-term maintenance activities on existing portions of a large internal medicine knowledge base. DESIGN: Five physicians who were not among the original developers of the knowledge base independently updated a total of 15 QMR disease profiles; each updated submission was modified by a review of group serving as the "gold standard, " and the pre- and post-study versions of each updated disease profile were compared. MEASUREMENTS: Numbers and types of changes, defined as any difference between the original version and the final version of a disease profile; reason for each change; and bibliographic references cited by the physicians as supporting evidence. RESULTS: A total of 16% of all entries were modified by the updating process; up to 95% of the entries in a disease profile were affected. The two most common modifications were changes to the frequency of an entry, and creation of a new entry. Laboratory findings were affected much more often than were history, symptom, or physical exam findings. The dominant reason for changes was appearance of new evidence in the medical literature. The literature cited ranged from 1944 to the present. CONCLUSIONS: This study provides an evaluation of the rate of change within the QMR medical knowledge base due to long-term maintenance. The results show that this is a demanding activity that may profoundly affect certain portions of a knowledge base, and that different types of knowledge (e.g., simple laboratory vs expensive or invasive laboratory findings) are affected by the process in different ways.

LabTalk/2: a middleware approach to HIS integration.

LabTalk/2 is an intelligent interface between a legacy order-entry system and a legacy laboratory information system. Unlike other interfaces, LabTalk/2 does more than just transform data from one format to another; it transforms the manner in which data is processed. Utilizing the "middleware" concept, it sits independently between the two systems, decoupling their maintenance needs. Implementation has been successful.

Information needs of health care professionals in an AIDS outpatient clinic as determined by chart review.

OBJECTIVE: To examine the information needs of health care professionals in HIV-related clinical encounters, and to determine the suitability of existing information sources to address those needs. SETTING: HIV outpatient clinic. PARTICIPANTS: Seven health care professionals with diverse training and patient care involvement. METHODS: Based on patient charts describing 120 patient encounters, participants generated 266 clinical questions. Printed and on-line information sources were used to answer questions in two phases: using commonly available sources and using all available medical library sources. MEASUREMENTS: The questions were divided into 16 categories by subject. The number of questions answered, their categories, the information source(s) providing answers, and the time required to answer questions were recorded for each phase. RESULTS: Each participant generated an average of 3.8 clinical questions per chart. Five categories accounted for almost 75% of all questions; the treatment protocols/regimens category was most frequent (24%). A total of 245 questions (92%) were answered, requiring an average of 15 minutes per question. Most (87%) of the questions were answered via electronic sources, even though paper sources were consulted first. CONCLUSIONS: The participating professionals showed considerable information needs. A combination of on-line and paper sources was necessary to provide the answers. The study suggests that present-day information sources are not entirely satisfactory for answering clinical questions generated by examining charts of HIV-infected patients.

Consistency enforcement in medical knowledge base construction.

Some aspects of knowledge base creation can be partially or completely automated, resulting in higher quality and smaller effort. Computer assistance is particularly valuable in ensuring the internal consistency of a knowledge base. The article describes several techniques for consistency enforcement in QMR-KAT, an interactive knowledge base editor for the INTERNIST-I/QMR medical knowledge base. Two strategies that improve consistency are applicable to a wide range of situations. The first strategy prevents simple (but common) inconsistencies. The second strategy reveals facts that are potentially (but not necessarily) inconsistent with known data, and may require further evaluation. Both strategies use the contents of the existing knowledge base in the evaluation of new facts.

Evaluating consensus among physicians in medical knowledge base construction.

This study evaluates inter-author variability in knowledge base construction. Seven board-certified internists independently profiled "acute perinephric abscess", using as reference material a set of 109 peer-reviewed articles. Each participant created a list of findings associated with the disease, estimated the predictive value and sensitivity of each finding, and assessed the pertinence of each article for making each judgment. Agreement in finding selection was significantly different from chance: seven, six, and five participants selected the same finding 78.6, 9.8, and 1.6 times more often than predicted by chance. Findings with the highest sensitivity were most likely to be included by all participants. The selection of supporting evidence from the medical literature was significantly related to each physician's agreement with the majority. The study shows that, with appropriate guidance, physicians can reproducibly extract information from the medical literature, and thus established a foundation for multi-author knowledge base construction.

Comparing contents of a knowledge base to traditional information sources.

Physicians rely on the medical literature as a major source of medical knowledge and data. The medical literature, however, is continually evolving and represents different sources at different levels of coverage and detail. The recent development of computerized medical knowledge bases has added a new form of information that can potentially be used to address the practicing physician's information needs. To understand how the information from various sources differs, we compared the description of a disease found in the QMR knowledge base to those found in two general internal medicine textbooks and two specialized nephrology textbooks. The study shows both differences in coverage and differences in the level of detail. Textbooks contain information about pathophysiology and therapy that is not present in the diagnostic knowledge base. The knowledge base contains a more detailed description of the associated findings, more quantitative information, and a greater number of references to peer-reviewed medical articles. The study demonstrates that computerized knowledge bases, if properly constructed, may be able to provide clinicians with a useful new source of medical knowledge that is complementary to existing sources.