Evaluation of Medical Subject Headings assignment in simulated patient articles.

OBJECTIVES: To evaluate human-based Medical Subject Headings (MeSH) allocation in articles about 'patient simulation'-a technique that mimics real-life patient scenarios with controlled patient responses. METHODS: A validation set of articles indexed before the Medical Text Indexer-Auto implementation (in 2019) was created with 150 combinations potentially referring to 'patient simulation'. Articles were classified into four categories of simulation studies. Allocation of seven MeSH terms (Simulation Training, Patient Simulation, High Fidelity Simulation Training, Computer Simulation, Patient-Specific Modelling, Virtual Reality, and Virtual Reality Exposure Therapy) was investigated. Accuracy metrics (sensitivity, precision, or positive predictive value) were calculated for each category of studies. KEY FINDINGS: A set of 7213 articles was obtained from 53 different word combinations, with 2634 excluded as irrelevant. 'Simulated patient' and 'standardized/standardized patient' were the most used terms. The 4579 included articles, published in 1044 different journals, were classified into: 'Machine/Automation' (8.6%), 'Education' (75.9%) and 'Practice audit' (11.4%); 4.1% were 'Unclear'. Articles were indexed with a median of 10 MeSH (IQR 8-13); however, 45.5% were not indexed with any of the seven MeSH terms. Patient Simulation was the most prevalent MeSH (24.0%). Automation articles were more associated with Computer Simulation MeSH (sensitivity = 54.5%; precision = 25.1%), while Education articles were associated with Patient Simulation MeSH (sensitivity = 40.2%; precision = 80.9%). Practice audit articles were also polarized to Patient Simulation MeSH (sensitivity = 34.6%; precision = 10.5%). CONCLUSIONS: Inconsistent use of free-text words related to patient simulation was observed, as well as inaccuracies in human-based MeSH assignments. These limitations can compromise relevant literature retrieval to support evidence synthesis exercises.

Trends in Modernization at the Nation's Medical Library.

This manuscript describes the ongoing efforts to meet ever-changing patron needs by modernizing operations, infrastructure, workforce, and customer service at the National Library of Medicine (NLM). Charged with collecting, organizing, preserving, and disseminating biomedical and life sciences information to the public, the NLM constantly adapts to evolving technologies and scientific advancements in order to better fulfill its mission. Historical context and an overview of operational decision-making offer a window into the workings of our nation's medical library.

The multiple dimensions of expanded access to health information: Don Lindberg and the U.S. National Library of Medicine.

When Donald A. B. Lindberg M.D. became Director of the U.S. National Library of Medicine in 1984, trained searchers, primarily librarians, conducted less than three million searches of NLM databases. They paid for their fair share of the commercial telecommunications costs to reach NLM's computer system. In 2015 when Lindberg retired, millions of scientists, health professionals, patients, members of the public, and librarians conducted billions of free searches of NLM's greatly expanded electronic resources via the Internet. Lindberg came to NLM intending to expand access to biomedical and health information along multiple dimensions: reaching more users, providing more types and volumes of information and data; and improving the conceptual, technical, and organizational connections needed to provide information to users when and where it is needed. By any measure he and NLM were spectacularly successful. This chapter discusses some key decisions and developments that contributed to that success.

Partnering for education and career development of librarians and information specialists.

Donald A.B. Lindberg M.D. was a strong proponent of self-improvement for all professions. He believed it was imperative for health sciences librarians to embrace lifelong learning as the Internet and networked information radically changed their work and opened new opportunities to increase their scope and impact. During Dr. Lindberg's 1984-2015 tenure as its Director, the U.S. National Library of Medicine (NLM) became an even more dominant influence on education and career development of health sciences librarians. This chapter focuses on the way NLM partnered with other institutions and organizations to ensure that education and training were consistently part of the roll-out of new NLM programs and services as they were implemented.

Free MEDLINE access worldwide.

When Donald A.B. Lindberg M.D. was sworn in as Director of the National Library of Medicine (NLM) in 1984, MEDLINE, NLM's online database of citations and abstracts to biomedical journal articles, was searched primarily by librarians trained to use its command language interface. There were fees for searching, primarily to recover the cost of using commercial value-added telecommunications networks. Thirteen years later, in 1997, MEDLINE became free to anyone with an Internet connection and a Web browser. This chapter provides an insider's view of how Dr. Lindberg's vision and leadership - combined with new technology, astute handling of policy issues, and key help from political supporters and influential advocates - enabled a tremendous expansion in access to biomedical and health information for scientists, health professionals, patients, and the public.

Don Lindberg's home library and leadership traits.

This chapter introduces the importance and some of the multidisciplinary diversity in Donald A.B. Lindberg M.D.'s home library. The latter collection minimally suggests his varied interests, which often inspired a multidisciplinary approach to tackling problems and managing the U.S. National Library of Medicine (NLM). Dr. Lindberg converted the ideas he picked up from reading into administering projects as well as to set aspirational goals for NLM and for himself. The chapter suggests Dr. Lindberg's home library was an enduring reservoir of knowledge, judgment, planning, and creativity. The chapter also discusses two of Dr. Lindberg's leadership traits: the cultivation of discovery and project development in educational administration and the need for leaders to determine and act in the greater public interest. The chapter suggests the latter two traits defined Dr. Lindberg's NLM leadership.

Dr. Lindberg and scholarly publishing.

Donald A.B. Lindberg M.D., Director of the U.S. National Library of Medicine (NLM) from August 1984 to March 2015, had a remarkable vision for NLM's scope, goals, and function. This vision resulted in many external partnerships and initiatives with the publishing industry, commercial and non-profit, journal editors, and professional organizations. These partnerships ranged from ongoing collaboration and dialogue, such as the NLM Publisher's Committee and the International Committee of Medical Journal Editors (ICMJE). to the more practical, such as the creation of HINARI and the Emergency Access Initiative (EAI). Dr. Lindberg fostered partnerships outside the NLM to expand the use and reach of Library resources, including MEDLINE and ClinicalTrials.gov to support innovations in the processes that build them, and to improve the quality of biomedical journals. Dr. Lindberg also encouraged the use of technology to enhance medical information and supported the early development of fully interactive publications. Attitudes that contained a measure of skepticism and distrust faded as collaborators came to have a better understanding of both NLM and their partners. This chapter discusses these relationships and accomplishments that NLM achieved working with publishers and other creators and disseminators of medical information under Dr. Lindberg's leadership.

Promoting new and expanded roles for librarians and information specialists.

This chapter describes how the U.S. National Library of Medicine (NLM), under the leadership of Donald A.B. Lindberg M.D., promoted new and expanded roles for librarians and information specialists in response to advances in technology and public policy. These advances brought information services directly to all potential users, including health professionals and the public and stimulated NLM to expand its programs, policies, and services to serve all. Dr. Lindberg included librarians and information specialists in all of NLM's new endeavors, helping both to recognize and establish new or expanded roles. The involvement of librarians and information specialists in multidisciplinary healthcare research teams, in underserved communities, and in research data management and compliance has helped to redefine the health sciences information profession for the 21st century.

Grateful Med: Direct access to MEDLINE for health professionals with personal computers.

Donald A.B. Lindberg M.D. arrived as Director, U.S. National Library of Medicine (NLM) in late 1984 with the intention of implementing a physician-friendly interface to MEDLINE, a prime example of his interest in making NLM information services more directly useful in medical care. By early 1986, NLM's Grateful Med, an inexpensive PC search interface to MEDLINE useful for health professionals, had joined the group of end-user systems for searching MEDLINE that emerged in the 1980s. This chapter recounts Grateful Med's rapid iterative development and the subsequent campaign to bring it to attention of health professionals. It emphasizes Lindberg's role, the challenges faced by those introducing and using the interface in a pre-Internet world, and some longer-term effects of the effort to expand health professionals' use of MEDLINE during the decade from 1986 to 1996.

An active contributor: Dr. Lindberg and NLM's historical programs and services.

Donald A.B. Lindberg M.D.'s interests extended far beyond his scientific expertise into the arts and humanities, as evidenced, for example, by his love of opera, his talents in photography, and his affection for history. It is therefore not surprising that he had a strong interest in the National Library of Medicine's historical programs and services, going beyond supporting these activities to becoming actively involved in some of them. The subject of this essay is Dr. Lindberg's contributions to these programs and services, which may be grouped under three main headings: placing greater emphasis on more contemporary history, promoting the digitization of historical materials to increase access, and enhancing outreach through an exhibition program.

Providing health information for patients, families and the public.

When Dr. Lindberg was sworn in as Director, the National Library of Medicine (NLM) was providing few resources with information useful to the public, having concentrated efforts towards health professionals and scientists. With his arrival, and that of the Internet in the 1990s, NLM embarked on a research and user-focused path towards providing authoritative health information for patients, families and the public. MedlinePlus, NIHSeniorHealth, and MedlinePlus en espanol delivered health information in a variety of formats using text, still images, audio and video. These resources were supported by NLM advisors and Dr. Lindberg's strong belief that patients and families needed easy access to medical information to be able to effectively care for themselves in illness and maintain the best health possible throughout their lives.

Don Lindberg and the creation of the National Center for Biotechnology Information.

The highest priority new initiative resulting from the 1985-86 National Library of Medicine Long Range Planning exercise initiated by NLM Director Dr. Donald A.B. Lindberg was the creation of new information resources and services related to molecular biology and genetics, termed "biotechnology information". Beginning with existing NLM resources and research projects associated with molecular data, and with Lindberg's enthusiastic support, the institution launched a Congressionally-mandated Center that has become an essential part of 21st century biomedical science.

Don Lindberg's influence on future generations: The U.S. National Library of Medicine's biomedical informatics research training programs.

Through his visionary leadership as Director of the U.S. National Library of Medicine (NLM), Donald A. B. Lindberg M.D. influenced future generations of informatics professionals and the field of biomedical informatics itself. This chapter describes Dr. Lindberg's role in sponsoring and shaping the NLM's Institutional T15 training programs.

The biomedical informatics short course at Woods Hole/Georgia: Training to support institutional change.

The US National Library of Medicine's Biomedical Informatics Short Course ran from 1992 to 2017, most of that time at the Marine Biological Laboratory in Woods Hole, Massachusetts. Its intention was to provide physicians, medical librarians and others engaged in health care with a basic understanding of the major topics in informatics so that they could return to their home institutions as "change agents". Over the years, the course provided week-long, intense, morning-to-night experiences for some 1,350 students, consisting of lectures and hands-on project development, taught by many luminaries in the field, not the least of which was Donald A.B. Lindberg M.D., who spoke on topics ranging from bioinformatics to national policy.

NLM's sponsorship of research in biomedical informatics (1985-2016).

The U.S. National Library of Medicine's (NLM) funding for biomedical informatics research in the 1980s and 1990s focused on clinical decision support systems, which were also the focus of research for Donald A.B. Lindberg M.D. prior to becoming NLM's director. The portfolio of projects expanded over the years. At NLM, Dr. Lindberg supported various large infrastructure programs that enabled biomedical informatics research, as well as investigator-initiated research projects that increasingly included biotechnology/bioinformatics and health services research. The authors review NLM's sponsorship of research during Dr. Lindberg's tenure as its Director. NLM's funding significantly increased in the 2000's and beyond. Authors report an analysis of R01 topics from 1985-2016 using data from NIH RePORTER. Dr. Lindberg's legacy for biomedical informatics research is reflected by the research NLM supported under his leadership. The number of R01s remained steady over the years, but the funds provided within awards increased over time. A significant amount of NLM funds listed in RePORTER went into various types of infrastructure projects that laid a solid foundation for biomedical informatics research over multiple decades.

The U.S. National Library of Medicine's impact on precision and genomic medicine.

Precision medicine offers the potential to improve health through deeper understandings of the lifestyle, biological, and environmental influences on health. Under Dr. Donald A. B. Lindberg's leadership, the U.S. National Library of Medicine (NLM) has developed the central reference resources for biomedical research and molecular laboratory medicine that enable precision medicine. The hosting and curation of biomedical knowledge repositories and data by NLM enable quality information reachable for providers and researchers throughout the world. NLM has been supporting the innovation of electronic health record systems to implement computability and secondary use for biomedical research, producing the scale of linked health and molecular datasets necessary for precision medicine discovery.

Something new and different: The Unified Medical Language System.

Donald A.B. Lindberg M.D. arrived at the U.S. National Library of Medicine in 1984 and quickly launched the Unified Medical Language System (UMLS) research and development project to help computers understand biomedical meaning and to enable retrieval and integration of information from disparate electronic sources, e.g., patient records, biomedical literature, knowledge bases. This chapter focuses on how Lindberg's thinking, preferred ways of working, and decision-making guided UMLS goals and development and on what made the UMLS markedly "new and different" and ahead of its time.

Donald A.B. Lindberg and the U.S. National Library of Medicine transformed biomedical and health informatics.

This overview summary of the Informatics Section of the book Transforming biomedical informatics and health information access: Don Lindberg and the U.S. National Library of Medicine illustrates how the NLM revolutionized the field of biomedical and health informatics during Lindberg's term as NLM Director. Authors present a before-and-after perspective of what changed, how it changed, and the impact of those changes.

The Visible Human Project.

This paper gives a flavor of Dr. Donald A.B. Lindberg's view of the expanding role of libraries, his curiosity, and his tolerance for taking educated risks, through the creation and nurturing of National Library of Medicine's Visible Human Project. That project produced the Visible Man and Visible Woman datasets and a suite of tools for presenting and analyzing those and similar datasets. The results are used in teaching anatomy and other medical school courses and in software from the open-source Insight Tool Kit (ITK) that is included in many if not most volume-reconstructing systems. This story is a bit personal. From the beginning we recognized and understood each other since we were both "boys from Brooklyn".

NLM and the IAIMS initiative: Cross-institutional academic/advanced systems contributing to the evolution of networked information and resources.

The Integrated Academic/Advanced Information Systems (IAIMS) program began in 1983 and was based on a study by the Association of American Medical Colleges (AAMC). Donald A.B. Lindberg M.D. was a member of the AAMC Advisory Committee. The U.S. National Library of Medicine (NLM) grants for IAIMS were initiated in 1984 the same year Dr. Lindberg became Director of the NLM. This chapter presents an overview of IAIMS and its progression through three stages with Dr. Lindberg's leadership.