Digitalizing Clinical Guidelines: Experiences in the Development of Clinical Decision Support Algorithms for Management of Childhood Illness in Resource-Constrained Settings.

Clinical decision support systems (CDSSs) can strengthen the quality of integrated management of childhood illness (IMCI) in resource-constrained settings. Several IMCI-related CDSSs have been developed and implemented in recent years. Yet, despite having a shared starting point, the IMCI-related CDSSs are markedly varied due to the need for interpretation when translating narrative guidelines into decision logic combined with considerations of context and design choices. Between October 2019 and April 2021, we conducted a comparative analysis of 4 IMCI-related CDSSs. The extent of adaptations to IMCI varied, but common themes emerged. Scope was extended to cover a broader range of conditions. Content was added or modified to enhance precision, align with new evidence, and support rational resource use. Structure was modified to increase efficiency, improve usability, and prioritize care for severely ill children. The multistakeholder development processes involved syntheses of recommendations from existing guidelines and literature; creation and validation of clinical algorithms; and iterative development, implementation, and evaluation. The common themes surrounding adaptations of IMCI guidance highlight the complexities of digitalizing evidence-based recommendations and reinforce the rationale for leveraging standards for CDSS development, such as the World Health Organization's SMART Guidelines. Implementation through multistakeholder dialogue is critical to ensure CDSSs can effectively and equitably improve quality of care for children in resource-constrained settings.

Experiences in aligning WHO SMART guidelines to classification and terminology standards.

OBJECTIVES: Digital adaptation kits (DAKs) distill WHO guidelines for digital use by representing them as workflows, data dictionaries and decision support tables. This paper aims to highlight key lessons learnt in coding data elements of the antenatal care (ANC) and family planning DAKs to standardised classifications and terminologies (CATs). METHODS: We encoded data elements within the ANC and family planning DAKs to standardised CATs from the WHO CATs and other freely available CATs. RESULTS: The coding process demonstrated approaches to refine the data dictionaries and enhance alignment between data elements and CATs. DISCUSSION: Applying CATs to WHO clinical and public health guidelines can ensure that recommendations are operationalised in a digital system with appropriate consistency and clarity. This requires a multidisciplinary team and careful review to achieve conceptual equivalence between data elements and standardised terminologies. CONCLUSION: The systematic translation of guidelines into digital systems provides an opportunity for leveraging CATs; however, this approach needs further exploration into its implementation in country contexts and transition into machine-readable components.

Digitalization of routine health information systems: Bangladesh, Indonesia, Pakistan.

Objective: To describe a systematic process of transforming paper registers into a digital system optimized to enhance service provision and fulfil reporting requirements. Methods: We designed a formative study around primary health workers providing reproductive, maternal, newborn and child health services in three countries in Bangladesh, Indonesia and Pakistan. The study ran from November 2014 to June 2018. We developed a prototype digital application after conducting a needs assessment of health workers' responsibilities, workflows, routine data requirements and service delivery needs. Methods included desk reviews, focus group discussions, in-depth interviews; data mapping of paper registers; observations of health workers; co-design workshops with health workers; and usability testing. Finally, we conducted an observational feasibility assessment to monitor uptake of the application. Findings: Researchers reviewed a total of 17 paper registers across the sites, which we transformed into seven modules within a digital application running on mobile devices. Modules corresponded to the services provided, including household enumeration, antenatal care, family planning, immunization, nutrition and child health. A total of 65 health workers used the modules during the feasibility assessment, and average weekly form submissions ranged from 8 to 234, depending on the health worker and their responsibilities. We also observed variability in the use of modules, requiring consistent monitoring support for health workers. Conclusion: Lessons learnt from this study shaped key global initiatives and resulted in a software global good. The deployment of digital systems requires well-designed applications, change management and strengthening human resources to realize and sustain health system gains.

Transitioning to Digital Systems: The Role of World Health Organization's Digital Adaptation Kits in Operationalizing Recommendations and Interoperability Standards.

INTRODUCTION: The transition from paper to digital systems requires quality assurance of the underlying content and application of data standards for interoperability. The World Health Organization (WHO) developed digital adaptation kits (DAKs) as an operational and software-neutral mechanism to translate WHO guidelines into a standardized format that can be more easily incorporated into digital systems. METHODS: WHO convened health program area and digital leads, reviewed existing approaches for requirements gathering, mapped to established standards, and incorporated research findings to define DAK components. RESULTS: For each health domain area, the DAKs distill WHO guidelines to specify the health interventions, personas, user scenarios, business process workflows, core data elements mapped to terminology codes, decision-support logic, program indicators, and functional and nonfunctional requirements. DISCUSSION: DAKs aim to catalyze quality of care and facilitate data use and interoperability as part of WHO's vision of SMART (Standards-based, Machine-readable, Adaptive, Requirements-based, and Testable) guidelines. Efforts will be needed to strengthen a collaborative approach for the uptake of DAKs within the local digital ecosystem and national health policies.

Integration of new digital antenatal care tools using the WHO SMART guideline approach: Experiences from Rwanda and Zambia.

OBJECTIVES: Digital tools for decision-support and health records can address the protracted process of guideline adoption at local levels and accelerate countries' implementation of new health policies and programmes. World Health Organization (WHO) launched the SMART Guidelines approach to support the uptake of clinical, public health, and data recommendations within digital systems. SMART guidelines are a package of tools that include Digital Adaptation Kits (DAKs), which distill WHO guidelines into a format that facilitates translation into digital systems. SMART Guidelines also include reference software applications known as digital modules. METHODS: This paper details the structured process to inform the adaptation of the WHO antenatal care (ANC) digital module to align with country-specific ANC packages for Zambia and Rwanda using the DAK. Digital landscape assessments were conducted to determine potential integrations between the ANC digital module and existing systems. A multi-stakeholder team consisting of Ministry of Health technical officers representing maternal health, HIV, digital health, and monitoring and evaluation at district and national levels was assembled to review existing guidelines to adapt the DAK. RESULTS: The landscape analysis resulted in considerations for integrating the ANC module into the broader digital ecosystems of both countries. Adaptations to the DAK included adding national services not reflected in the generic DAK and modification of decision support logic and indicators. Over 80% of the generic DAK content was consistent with processes for both countries. The adapted DAK will inform the customization of country-specific ANC digital modules. CONCLUSION: Both countries found that coordination between maternal and digital health leads was critical to ensuring requirements were accurately reflected within the ANC digital module. Additionally, DAKs provided a structured process for gathering requirements, reviewing and addressing gaps within existing systems, and aligning clinical content.

Enhancing narrative clinical guidance with computer-readable artifacts: Authoring FHIR implementation guides based on WHO recommendations.

INTRODUCTION: Narrative clinical guidelines often contain assumptions, knowledge gaps, and ambiguities that make translation into an electronic computable format difficult. This can lead to divergence in electronic implementations, reducing the usefulness of collected data outside of that implementation setting. This work set out to evolve guidelines-based data dictionaries by mapping to HL7 Fast Health Interoperability Resources (FHIR) and semantic terminology, thus progressing toward machine-readable guidelines that define the minimum data set required to support family planning and sexually transmitted infections. MATERIAL AND METHODS: The data dictionaries were first structured to facilitate mapping to FHIR and semantic terminologies, including ICD-10, SNOMED-CT, LOINC, and RxNorm. FHIR resources and codes were assigned to data dictionary terms. The data dictionary and mappings were used as inputs for a newly developed tool to generate FHIR implementation guides. RESULTS: Implementation guides for core data requirements for family planning and sexually transmitted infections were created. These implementation guides display data dictionary content as FHIR resources and semantic terminology codes. Challenges included the use of a two-dimensional spreadsheet to facilitate mapping, the need to create FHIR profiles and resource extensions, and applying FHIR to a data dictionary that was created with a user interface in mind. CONCLUSIONS: Authoring FHIR implementation guides is a complex and evolving practice, and there are limited examples for this groundbreaking work. Moving toward machine-readable guidelines by mapping to FHIR and semantic terminologies requires a thorough understanding of the context and use of terminology, an applied information model, and other strategies for optimizing the creation and long-term management of implementation guides. Next steps for this work include validation and, eventually, real-world application. The process for creating the data dictionary and for generating implementation guides should also be improved to prepare for this expanding work. FUNDING: This work was supported by the World Health Organization, which also worked as a collaborative partner throughout the study.