Northwestern University resource and education development initiatives to advance collaborative artificial intelligence across the learning health system.

Introduction: The rapid development of artificial intelligence (AI) in healthcare has exposed the unmet need for growing a multidisciplinary workforce that can collaborate effectively in the learning health systems. Maximizing the synergy among multiple teams is critical for Collaborative AI in Healthcare. Methods: We have developed a series of data, tools, and educational resources for cultivating the next generation of multidisciplinary workforce for Collaborative AI in Healthcare. We built bulk-natural language processing pipelines to extract structured information from clinical notes and stored them in common data models. We developed multimodal AI/machine learning (ML) tools and tutorials to enrich the toolbox of the multidisciplinary workforce to analyze multimodal healthcare data. We have created a fertile ground to cross-pollinate clinicians and AI scientists and train the next generation of AI health workforce to collaborate effectively. Results: Our work has democratized access to unstructured health information, AI/ML tools and resources for healthcare, and collaborative education resources. From 2017 to 2022, this has enabled studies in multiple clinical specialties resulting in 68 peer-reviewed publications. In 2022, our cross-discipline efforts converged and institutionalized into the Center for Collaborative AI in Healthcare. Conclusions: Our Collaborative AI in Healthcare initiatives has created valuable educational and practical resources. They have enabled more clinicians, scientists, and hospital administrators to successfully apply AI methods in their daily research and practice, develop closer collaborations, and advanced the institution-level learning health system.

Group authorship, an excellent opportunity laced with ethical, legal and technical challenges.

Group authorship (also known as corporate authorship, team authorship, consortium authorship) refers to attribution practices that use the name of a collective (be it team, group, project, corporation, or consortium) in the authorship byline. Data shows that group authorships are on the rise but thus far, in scholarly discussions about authorship, they have not gained much specific attention. Group authorship can minimize tensions within the group about authorship order and the criteria used for inclusion/exclusion of individual authors. However, current use of group authorships has drawbacks, such as ethical challenges associated with the attribution of credit and responsibilities, legal challenges regarding how copyrights are handled, and technical challenges related to the lack of persistent identifiers (PIDs), such as ORCID, for groups. We offer two recommendations: 1) Journals should develop and share context-specific and unambiguous guidelines for group authorship, for which they can use the four baseline requirements offered in this paper; 2) Using persistent identifiers for groups and consistent reporting of members' contributions should be facilitated through devising PIDs for groups and linking these to the ORCIDs of their individual contributors and the Digital Object Identifier (DOI) of the published item.

An exploratory survey about using ChatGPT in education, healthcare, and research.

OBJECTIVE: ChatGPT is the first large language model (LLM) to reach a large, mainstream audience. Its rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas. In a hybrid (virtual and in-person) panel discussion event, we examined various perspectives regarding the use of ChatGPT in education, research, and healthcare. MATERIALS AND METHODS: We surveyed in-person and online attendees using an audience interaction platform (Slido). We quantitatively analyzed received responses on questions about the use of ChatGPT in various contexts. We compared pairwise categorical groups with a Fisher's Exact. Furthermore, we used qualitative methods to analyze and code discussions. RESULTS: We received 420 responses from an estimated 844 participants (response rate 49.7%). Only 40% of the audience had tried ChatGPT. More trainees had tried ChatGPT compared with faculty. Those who had used ChatGPT were more interested in using it in a wider range of contexts going forwards. Of the three discussed contexts, the greatest uncertainty was shown about using ChatGPT in education. Pros and cons were raised during discussion for the use of this technology in education, research, and healthcare. DISCUSSION: There was a range of perspectives around the uses of ChatGPT in education, research, and healthcare, with still much uncertainty around its acceptability and optimal uses. There were different perspectives from respondents of different roles (trainee vs faculty vs staff). More discussion is needed to explore perceptions around the use of LLMs such as ChatGPT in vital sectors such as education, healthcare and research. Given involved risks and unforeseen challenges, taking a thoughtful and measured approach in adoption would reduce the likelihood of harm.

Clinical and Translational Science Personas: Expansion and use cases.

Twelve evidence-based profiles of roles across the Clinical and Translational Science (CTS) workforce and two patient profiles were developed by CTS Personas collaborators in 2019 as part of the CTSA Program National Center for Data to Health (CD2H). Based on feedback received from the community, CTS Personas team members collaborated to produce five additional Personas to broaden representation of the CTS workforce and enhance the existing portfolio. This paper presents the rationale and methodology used in the latest CTS Personas initiative. This work also includes an implementation scenario incorporating multiple Personas. Using the new National Institutes of Health's (NIH) Data Management and Sharing Policy as an example, we demonstrate how administrators, researchers, support staff, and all CTS collaborators can use the Personas to respond to this new policy while considering the needs of service providers and users, CTS employees with short- and long-term needs, and interdisciplinary perspectives.

Bridging the gap: A library-based collaboration to enhance data skills for clinical researchers.

Introduction: Enterprise data warehouses (EDWs) serve as foundational infrastructure in a modern learning health system, housing clinical and other system-wide data and making it available for research, strategic, and quality improvement purposes. Building on a longstanding partnership between Northwestern University's Galter Health Sciences Library and the Northwestern Medicine Enterprise Data Warehouse (NMEDW), an end-to-end clinical research data management (cRDM) program was created to enhance clinical data workforce capacity and further expand related library-based services for the campus. Methods: The training program covers topics such as clinical database architecture, clinical coding standards, and translation of research questions into queries for proper data extraction. Here we describe this program, including partners and motivations, technical and social components, integration of FAIR principles into clinical data research workflows, and the long-term implications for this work to serve as a blueprint of best practice workflows for clinical research to support library and EDW partnerships at other institutions. Results: This training program has enhanced the partnership between our institution's health sciences library and clinical data warehouse to provide support services for researchers, resulting in more efficient training workflows. Through instruction on best practices for preserving and sharing outputs, researchers are given the tools to improve the reproducibility and reusability of their work, which has positive effects for the researchers as well as for the university. All training resources have been made publicly available so that those who support this critical need at other institutions can build on our efforts. Conclusions: Library-based partnerships to support training and consultation offer an important vehicle for clinical data science capacity building in learning health systems. The cRDM program launched by Galter Library and the NMEDW is an example of this type of partnership and builds on a strong foundation of past collaboration, expanding the scope of clinical data support services and training on campus.

An exploratory survey about using ChatGPT in education, healthcare, and research.

Objective ChatGPT is the first large language model (LLM) to reach a large, mainstream audience. Its rapid adoption and exploration by the population at large has sparked a wide range of discussions regarding its acceptable and optimal integration in different areas. In a hybrid (virtual and in-person) panel discussion event, we examined various perspectives regarding the use of ChatGPT in education, research, and healthcare. Materials and Methods We surveyed in-person and online attendees using an audience interaction platform (Slido). We quantitatively analyzed received responses on questions about the use of ChatGPT in various contexts. We compared pairwise categorical groups with Fisher's Exact. Furthermore, we used qualitative methods to analyze and code discussions. Results We received 420 responses from an estimated 844 participants (response rate 49.7%). Only 40% of the audience had tried ChatGPT. More trainees had tried ChatGPT compared with faculty. Those who had used ChatGPT were more interested in using it in a wider range of contexts going forwards. Of the three discussed contexts, the greatest uncertainty was shown about using ChatGPT in education. Pros and cons were raised during discussion for the use of this technology in education, research, and healthcare. Discussion There was a range of perspectives around the uses of ChatGPT in education, research, and healthcare, with still much uncertainty around its acceptability and optimal uses. There were different perspectives from respondents of different roles (trainee vs faculty vs staff). More discussion is needed to explore perceptions around the use of LLMs such as ChatGPT in vital sectors such as education, healthcare and research. Given involved risks and unforeseen challenges, taking a thoughtful and measured approach in adoption would reduce the likelihood of harm.

Leadership and administration to advance translational science: Environmental scan of adaptive capacity and preparedness of Clinical and Translational Science Award Program hubs.

COVID-19 reinforced the need for effective leadership and administration within Clinical and Translational Science Award (CTSA) program hubs in response to a public health crisis. The speed, scale, and persistent evolution of the pandemic forced CTSA hubs to act quickly and remain nimble. The switch to virtual environments paired with supporting program operations, while ensuring the safety and well-being of their team, highlight the critical support role provided by leadership and administration. The pandemic also illustrated the value of emergency planning in supporting organizations' ability to quickly pivot and adapt. Lessons learned from the pandemic and from other cases of adaptive capacity and preparedness can aid program hubs in promoting and sustaining the overall capabilities of their organizations to prepare for future events.

A systematic scoping review of the ethics of Contributor Role Ontologies and Taxonomies.

Contributor Role Ontologies and Taxonomies (CROTs) provide a standard list of roles to specify individual contributions to research. CROTs most common application has been their inclusion alongside author bylines in scholarly publications. With the recent uptake of CROTs among publishers -particularly the Contributor Role Taxonomy (CRediT)- some have anticipated a positive impact on ethical issues regarding the attribution of credit and responsibilities, but others have voiced concerns about CROTs shortcomings and ways they could be misunderstood or have unintended consequences. Since these discussions have never been consolidated, this review collated and explored published viewpoints about the ethics of CROTs. After searching Ovid Medline, Scopus, Web of Science, and Google Scholar, 30 papers met the inclusion criteria and were analyzed. We identified eight themes and 20 specific issues related to the ethics of CROTs and provided four recommendations for CROT developers, custodians, or others seeking to use CROTs in their workflows, policy and practice: 1) Compile comprehensive instructions that explain how CROTs should be used; 2) Improve the coherence of used terms, 3) Translate roles in languages other than English, 4) Communicate a clear vision about future development plans and be transparent about CROTs' strengths and weaknesses. We conclude that CROTs are not the panacea for unethical attributions and should be complemented with initiatives that support social and infrastructural transformation of scholarly publications.

Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan.

The National Institutes of Health (NIH) Policy for Data Management and Sharing (DMS Policy) recognizes the NIH's role as a key steward of United States biomedical research and information and seeks to enhance that stewardship through systematic recommendations for the preservation and sharing of research data generated by funded projects. The policy is effective as of January 2023. The recommendations include a requirement for the submission of a Data Management and Sharing Plan (DMSP) with funding applications, and while no strict template was provided, the NIH has released supplemental draft guidance on elements to consider when developing a plan. This article provides 10 key recommendations for creating a DMSP that is both maximally compliant and effective.

Using informatics to advance translational science: Environmental scan of adaptive capacity and preparedness of Clinical and Translational Science Award Program hubs.

As the USA and the rest of the world raced to fight the COVID-19 pandemic, years of investments from the National Center for Advancing Translational Sciences allowed for informatics services and resources at CTSA hubs to play a significant role in addressing the crisis. CTSA hubs partnered with local and regional partners to collect data on the pandemic, provide access to relevant patient data, and produce data dashboards to support decision-making. Coordinated efforts, like the National COVID Cohort Collaborative (N3C), helped to aggregate and harmonize clinical data nationwide. Even with significant informatics investments, some CTSA hubs felt unprepared in their ability to respond to the fast-moving public health crisis. Many hubs were forced to quickly evolve to meet local needs. Informatics teams expanded critical support at their institutions which included an engagement platform for clinical research, COVID-19 awareness and education activities in the community, and COVID-19 data dashboards. Continued investments in informatics resources will aid in ensuring that tools, resources, practices, and policies are aligned to meet local and national public health needs.

Development of a web tool to increase research literacy in underserved populations through public library partnerships.

OBJECTIVE: Inadequate diversity in clinical trials is widely recognized as a significant contributing factor to health disparities experienced by racial/ethnic minorities and other diverse populations in the US. To address this in a scalable way, we sought to develop a web tool that could help enhance underserved minority participation in clinical research. METHODS: We used our research literacy support flashcard tool as the initial prototype for human-centered design and usability testing of the web tool Health for All in public library settings. After forming partnerships with leadership from Chicago Public Libraries (CPL), local medical libraries, and the Chicago Department of Public Health, we conducted seven iterative design sessions with focus groups of library patrons and library staff from six CPL branches serving underserved communities followed by two rounds of usability testing and website modification. RESULTS: Based on the qualitative research findings from Design Sessions 1-7, we enacted the design decision of a website that was a hybrid of fact-filled and vignette (personal stories) paper prototypes divided into 4 modules (trust, diversity, healthy volunteers, pros/cons), each with their own outcome metrics. The website was thus constructed, and navigation issues identified in two rounds of usability testing by library patrons were addressed through further website modification, followed by the launch of a beta version of a hybridized single-scrolling and guided module prototype to allow further development with website analytics. CONCLUSIONS: We report the development of Health for All, a website designed to enhance racial/ethnic minority participation in clinical trials by imparting research literacy, mitigating distrust engendered by longstanding racism and discrimination, and providing connections to clinical trials recruiting participants.

Is authorship sufficient for today's collaborative research? A call for contributor roles.

Assigning authorship and recognizing contributions to scholarly works is challenging on many levels. Here we discuss ethical, social, and technical challenges to the concept of authorship that may impede the recognition of contributions to a scholarly work. Recent work in the field of authorship shows that shifting to a more inclusive contributorship approach may address these challenges. Recent efforts to enable better recognition of contributions to scholarship include the development of the Contributor Role Ontology (CRO), which extends the CRediT taxonomy and can be used in information systems for structuring contributions. We also introduce the Contributor Attribution Model (CAM), which provides a simple data model that relates the contributor to research objects via the role that they played, as well as the provenance of the information. Finally, requirements for the adoption of a contributorship-based approach are discussed.

Personas for the translational workforce.

Twelve evidence-based profiles of roles across the translational workforce and two patients were made available through clinical and translational science (CTS) Personas, a project of the Clinical and Translational Science Awards (CTSA) Program National Center for Data to Health (CD2H). The persona profiles were designed and researched to demonstrate the key responsibilities, motivators, goals, software use, pain points, and professional development needs of those working across the spectrum of translation, from basic science to clinical research to public health. The project's goal was to provide reliable documents that could be used to inform CTSA software development projects, educational resources, and communication initiatives. This paper presents the initiative to create personas for the translational workforce, including the methodology, engagement strategy, and lessons learned. Challenges faced and successes achieved by the project may serve as a roadmap for others searching for best practices in the creation of Persona profiles.

Translational Personas and Hospital Library Services.

Academic health centers, CTSA hubs, and hospital libraries experience similar funding challenges and charges to do more with less. In recent years academic health center and hospital librarians have risen to these challenges by examining their service models, and beyond that, examining their patron base and users' needs. To meet the needs of employees, patients, and those who assist patients, hospital librarians can employ the CTS Personas, a project of the Clinical and Translational Science Awards (CTSA) Program National Center for Data to Health. The Persona profiles, which outline the motivations, goals, pain points, wants, and needs of twelve employees and two patients in translational science, provide vital information and insights that can inform everything from designing software tools and educational services, to advertising these services, to designing impactful and collaborative library spaces.

Academic information on Twitter: A user survey.

Although counts of tweets citing academic papers are used as an informal indicator of interest, little is known about who tweets academic papers and who uses Twitter to find scholarly information. Without knowing this, it is difficult to draw useful conclusions from a publication being frequently tweeted. This study surveyed 1,912 users that have tweeted journal articles to ask about their scholarly-related Twitter uses. Almost half of the respondents (45%) did not work in academia, despite the sample probably being biased towards academics. Twitter was used most by people with a social science or humanities background. People tend to leverage social ties on Twitter to find information rather than searching for relevant tweets. Twitter is used in academia to acquire and share real-time information and to develop connections with others. Motivations for using Twitter vary by discipline, occupation, and employment sector, but not much by gender. These factors also influence the sharing of different types of academic information. This study provides evidence that Twitter plays a significant role in the discovery of scholarly information and cross-disciplinary knowledge spreading. Most importantly, the large numbers of non-academic users support the claims of those using tweet counts as evidence for the non-academic impacts of scholarly research.