Measuring the Burden of Infodemics: Summary of the Methods and Results of the Fifth WHO Infodemic Management Conference.

Background: An infodemic is excess information, including false or misleading information, that spreads in digital and physical environments during a public health emergency. The COVID-19 pandemic has been accompanied by an unprecedented global infodemic that has led to confusion about the benefits of medical and public health interventions, with substantial impact on risk-taking and health-seeking behaviors, eroding trust in health authorities and compromising the effectiveness of public health responses and policies. Standardized measures are needed to quantify the harmful impacts of the infodemic in a systematic and methodologically robust manner, as well as harmonizing highly divergent approaches currently explored for this purpose. This can serve as a foundation for a systematic, evidence-based approach to monitoring, identifying, and mitigating future infodemic harms in emergency preparedness and prevention. Objective: In this paper, we summarize the Fifth World Health Organization (WHO) Infodemic Management Conference structure, proceedings, outcomes, and proposed actions seeking to identify the interdisciplinary approaches and frameworks needed to enable the measurement of the burden of infodemics. Methods: An iterative human-centered design (HCD) approach and concept mapping were used to facilitate focused discussions and allow for the generation of actionable outcomes and recommendations. The discussions included 86 participants representing diverse scientific disciplines and health authorities from 28 countries across all WHO regions, along with observers from civil society and global public health-implementing partners. A thematic map capturing the concepts matching the key contributing factors to the public health burden of infodemics was used throughout the conference to frame and contextualize discussions. Five key areas for immediate action were identified. Results: The 5 key areas for the development of metrics to assess the burden of infodemics and associated interventions included (1) developing standardized definitions and ensuring the adoption thereof; (2) improving the map of concepts influencing the burden of infodemics; (3) conducting a review of evidence, tools, and data sources; (4) setting up a technical working group; and (5) addressing immediate priorities for postpandemic recovery and resilience building. The summary report consolidated group input toward a common vocabulary with standardized terms, concepts, study designs, measures, and tools to estimate the burden of infodemics and the effectiveness of infodemic management interventions. Conclusions: Standardizing measurement is the basis for documenting the burden of infodemics on health systems and population health during emergencies. Investment is needed into the development of practical, affordable, evidence-based, and systematic methods that are legally and ethically balanced for monitoring infodemics; generating diagnostics, infodemic insights, and recommendations; and developing interventions, action-oriented guidance, policies, support options, mechanisms, and tools for infodemic managers and emergency program managers.

A Public Health Research Agenda for Managing Infodemics: Methods and Results of the First WHO Infodemiology Conference.

BACKGROUND: An infodemic is an overflow of information of varying quality that surges across digital and physical environments during an acute public health event. It leads to confusion, risk-taking, and behaviors that can harm health and lead to erosion of trust in health authorities and public health responses. Owing to the global scale and high stakes of the health emergency, responding to the infodemic related to the pandemic is particularly urgent. Building on diverse research disciplines and expanding the discipline of infodemiology, more evidence-based interventions are needed to design infodemic management interventions and tools and implement them by health emergency responders. OBJECTIVE: The World Health Organization organized the first global infodemiology conference, entirely online, during June and July 2020, with a follow-up process from August to October 2020, to review current multidisciplinary evidence, interventions, and practices that can be applied to the COVID-19 infodemic response. This resulted in the creation of a public health research agenda for managing infodemics. METHODS: As part of the conference, a structured expert judgment synthesis method was used to formulate a public health research agenda. A total of 110 participants represented diverse scientific disciplines from over 35 countries and global public health implementing partners. The conference used a laddered discussion sprint methodology by rotating participant teams, and a managed follow-up process was used to assemble a research agenda based on the discussion and structured expert feedback. This resulted in a five-workstream frame of the research agenda for infodemic management and 166 suggested research questions. The participants then ranked the questions for feasibility and expected public health impact. The expert consensus was summarized in a public health research agenda that included a list of priority research questions. RESULTS: The public health research agenda for infodemic management has five workstreams: (1) measuring and continuously monitoring the impact of infodemics during health emergencies; (2) detecting signals and understanding the spread and risk of infodemics; (3) responding and deploying interventions that mitigate and protect against infodemics and their harmful effects; (4) evaluating infodemic interventions and strengthening the resilience of individuals and communities to infodemics; and (5) promoting the development, adaptation, and application of interventions and toolkits for infodemic management. Each workstream identifies research questions and highlights 49 high priority research questions. CONCLUSIONS: Public health authorities need to develop, validate, implement, and adapt tools and interventions for managing infodemics in acute public health events in ways that are appropriate for their countries and contexts. Infodemiology provides a scientific foundation to make this possible. This research agenda proposes a structured framework for targeted investment for the scientific community, policy makers, implementing organizations, and other stakeholders to consider.

Infodemic Signal Detection During the COVID-19 Pandemic: Development of a Methodology for Identifying Potential Information Voids in Online Conversations.

BACKGROUND: The COVID-19 pandemic has been accompanied by an infodemic: excess information, including false or misleading information, in digital and physical environments during an acute public health event. This infodemic is leading to confusion and risk-taking behaviors that can be harmful to health, as well as to mistrust in health authorities and public health responses. The World Health Organization (WHO) is working to develop tools to provide an evidence-based response to the infodemic, enabling prioritization of health response activities. OBJECTIVE: In this work, we aimed to develop a practical, structured approach to identify narratives in public online conversations on social media platforms where concerns or confusion exist or where narratives are gaining traction, thus providing actionable data to help the WHO prioritize its response efforts to address the COVID-19 infodemic. METHODS: We developed a taxonomy to filter global public conversations in English and French related to COVID-19 on social media into 5 categories with 35 subcategories. The taxonomy and its implementation were validated for retrieval precision and recall, and they were reviewed and adapted as language about the pandemic in online conversations changed over time. The aggregated data for each subcategory were analyzed on a weekly basis by volume, velocity, and presence of questions to detect signals of information voids with potential for confusion or where mis- or disinformation may thrive. A human analyst reviewed and identified potential information voids and sources of confusion, and quantitative data were used to provide insights on emerging narratives, influencers, and public reactions to COVID-19-related topics. RESULTS: A COVID-19 public health social listening taxonomy was developed, validated, and applied to filter relevant content for more focused analysis. A weekly analysis of public online conversations since March 23, 2020, enabled quantification of shifting interests in public health-related topics concerning the pandemic, and the analysis demonstrated recurring voids of verified health information. This approach therefore focuses on the detection of infodemic signals to generate actionable insights to rapidly inform decision-making for a more targeted and adaptive response, including risk communication. CONCLUSIONS: This approach has been successfully applied to identify and analyze infodemic signals, particularly information voids, to inform the COVID-19 pandemic response. More broadly, the results have demonstrated the importance of ongoing monitoring and analysis of public online conversations, as information voids frequently recur and narratives shift over time. The approach is being piloted in individual countries and WHO regions to generate localized insights and actions; meanwhile, a pilot of an artificial intelligence-based social listening platform is using this taxonomy to aggregate and compare online conversations across 20 countries. Beyond the COVID-19 pandemic, the taxonomy and methodology may be adapted for fast deployment in future public health events, and they could form the basis of a routine social listening program for health preparedness and response planning.

Strengthening risk communication systems for public health emergencies in the WHO South-East Asia Region.

Risk communication and community engagement are critical aspects of public health emergency preparedness and response and therefore one of the eight original core capacities of the International Health Regulations (2005). Joint external evaluations in eight out of eleven countries of the World Health Organization South-East Asia Region reveal that there is considerable variation in risk communication capacities among countries. Of the five areas evaluated - risk communication systems, internal and partner coordination, public communication, community engagement and listening, and risky behaviour and misinformation - the strongest areas, across the region, are partner coordination and community engagement, while risk communication systems is the weakest area and needs further strengthening. For strong and sustainable risk communication for public health emergencies in the WHO South East Asia Region, institutionalized capacity-building supported by increased budgetary allocations to this area is needed. There is a strong need for advocacy to and sensitization of key policy-makers and decision-makers at country level regarding the importance and advantages of being prepared on risk communication plans and systems.

Pandemic influenza preparedness in the WHO South-East Asia Region: a model for planning regional preparedness for other priority high-threat pathogens.

Pandemic influenza preparedness has contributed significantly to building, strengthening and maintaining countries' core capacities to prepare for health emergencies. The Pandemic influenza preparedness framework for the sharing of influenza viruses and access to vaccines and other benefits (the PIP framework) was adopted by the World Health Assembly in 2011. The experiences and lessons learnt from the implementation of the PIP framework have provided insights that can be used to strengthen preparedness for epidemics of other priority high-threat pathogens in the World Health Organization (WHO) South-East Asia Region in line with obligations under the International Health Regulations, 2005 (IHR). Implementation has established policies, strategies, action plans, strengthened systems and operational readiness to promptly diagnose influenza virus strains with pandemic potential and ensure timely event notifications and management in compliance with the IHR. WHO collaborating centres and the annual bi-regional meeting of national influenza centres and influenza surveillance have strengthened the influenza laboratory diagnostic knowledge network in the region. After action reviews following influenza outbreaks have documented best practices, strengths, constraints and areas for improvement in pandemic preparedness. The pandemic in 2009 and recent seasonal influenza outbreaks have offered real-life scenarios for testing national pandemic influenza preparedness plans and deploying vaccines. The successful implementation of the PIP framework, along with strengthening of health systems and operational procedures and continued technical collaboration with global centres of excellence, should be tapped into to strengthen preparedness to respond to epidemics of other high-threat pathogens based on the influenza model. The political commitment reflected in the Delhi Declaration on Emergency Preparedness, signed by all ministers of health in September 2019 and supported by the Five-year regional strategic plan to strengthen public health preparedness and response - 2019-2023, should be a catalyst for guidance and support in developing a broad, long-term strategic plan for preparedness and response to high-threat pathogens in the region.

Assessment of Ebola virus disease preparedness in the WHO South-East Asia Region.

OBJECTIVE: To conduct assessments of Ebola virus disease preparedness in countries of the World Health Organization (WHO) South-East Asia Region. METHODS: Nine of 11 countries in the region agreed to be assessed. During February to November 2015 a joint team from WHO and ministries of health conducted 4-5 day missions to Bangladesh, Bhutan, Indonesia, Maldives, Myanmar, Nepal, Sri Lanka, Thailand and Timor-Leste. We collected information through guided discussions with senior technical leaders and visits to hospitals, laboratories and airports. We assessed each country's Ebola virus disease preparedness on 41 tasks under nine key components adapted from the WHO Ebola preparedness checklist of January 2015. FINDINGS: Political commitment to Ebola preparedness was high in all countries. Planning was most advanced for components that had been previously planned or tested for influenza pandemics: multilevel and multisectoral coordination; multidisciplinary rapid response teams; public communication and social mobilization; drills in international airports; and training on personal protective equipment. Major vulnerabilities included inadequate risk assessment and risk communication; gaps in data management and analysis for event surveillance; and limited capacity in molecular diagnostic techniques. Many countries had limited planning for a surge of Ebola cases. Other tasks needing improvement included: advice to inbound travellers; adequate isolation rooms; appropriate infection control practices; triage systems in hospitals; laboratory diagnostic capacity; contact tracing; and danger pay to staff to ensure continuity of care. CONCLUSION: Joint assessment and feedback about the functionality of Ebola virus preparedness systems help countries strengthen their core capacities to meet the International Health Regulations.