Prioritization of hazards for risk and resilience management through elicitation of expert judgement.

Risk assessment in communities or regions typically relies on the determination of hazard scenarios and an evaluation of their impact on local systems and structures. One of the challenges of risk assessment for infrastructure operators is how to identify the most critical scenarios that are likely to represent unacceptable risks to such assets in a given time frame. This study develops a novel approach for prioritizing hazards for the risk assessment of infrastructure. Central to the proposed methodology is an expert elicitation technique termed paired comparison which is based on a formal mathematical technique for quantifying the range and variance in the judgements of a group of stakeholders. The methodology is applied here to identify and rank natural and operational hazard scenarios that could cause serious disruption or have disastrous effects to the infrastructure in the transnational Øresund region over a period of 5 years. The application highlighted substantial divergences of views among the stakeholders on identifying a single 'most critical' natural or operational hazard scenario. Despite these differences, it was possible to flag up certain cases as critical among the natural hazard scenarios, and others among the operational hazards.

Attribution of Illnesses Transmitted by Food and Water to Comprehensive Transmission Pathways Using Structured Expert Judgment, United States.

Illnesses transmitted by food and water cause a major disease burden in the United States despite advancements in food safety, water treatment, and sanitation. We report estimates from a structured expert judgment study using 48 experts who applied Cooke's classical model of the proportion of disease attributable to 5 major transmission pathways (foodborne, waterborne, person-to-person, animal contact, and environmental) and 6 subpathways (food handler-related, under foodborne; recreational, drinking, and nonrecreational/nondrinking, under waterborne; and presumed person-to-person-associated and presumed animal contact-associated, under environmental). Estimates for 33 pathogens were elicited, including bacteria such as Salmonella enterica, Campylobacter spp., Legionella spp., and Pseudomonas spp.; protozoa such as Acanthamoeba spp., Cyclospora cayetanensis, and Naegleria fowleri; and viruses such as norovirus, rotavirus, and hepatitis A virus. The results highlight the importance of multiple pathways in the transmission of the included pathogens and can be used to guide prioritization of public health interventions.

Major explosions and paroxysms at Stromboli (Italy): a new historical catalog and temporal models of occurrence with uncertainty quantification.

Stromboli volcano (Italy), always active with low energy explosive activity, is a very attractive place for visitors, scientists, and inhabitants of the island. Nevertheless, occasional more intense eruptions can present a serious danger. This study focuses on the modeling and estimation of their inter-event time and temporal rate. With this aim we constructed a new historical catalog of major explosions and paroxysms through a detailed review of scientific literature of the last ca. 140 years. The catalog includes the calendar date and phenomena descriptions for 180 explosive events, of which 36 were paroxysms. We evaluated the impact of the main sources of uncertainty affecting the historical catalog. In particular, we categorized as uncertain 45 major explosions that reportedly occurred before 1985 and tested the effect of excluding these events from our analysis. Moreover, after analyzing the entire record in the period [1879, 2020], we separately considered, as sequences, events in [1879, 1960] and in [1985, 2020] because of possible under recording issues in the period [1960, 1985]. Our new models quantify the temporal rate of major explosions and paroxysms as a function of time passed since the last event occurred. Recurrence hazard levels are found to be significantly elevated in the weeks and months following a major explosion or paroxysm, and then gradually decrease over longer periods. Computed hazard functions are also used to illustrate a methodology for estimating order-of-magnitude individual risk of fatality under certain basis conditions. This study represents a first quantitatively formal advance in determining long-term hazard levels at Stromboli.

Anticipated impacts of Brexit scenarios on UK food prices and implications for policies on poverty and health: a structured expert judgement approach.

INTRODUCTION: Food insecurity is associated with increased risk for several health conditions and with poor chronic disease management. Key determinants for household food insecurity are income and food costs. Whereas short-term household incomes are likely to remain static, increased food prices would be a significant driver of food insecurity. OBJECTIVES: To investigate food price drivers for household food security and its health consequences in the UK under scenarios of Deal and No-deal for Britain's exit from the European Union. To estimate the 5% and 95% quantiles of the projected price distributions. DESIGN: Structured expert judgement elicitation, a well-established method for quantifying uncertainty, using experts. In July 2018, each expert estimated the median, 5% and 95% quantiles of changes in price for 10 food categories under Brexit Deal and No-deal to June 2020 assuming Brexit had taken place on 29 March 2019. These were aggregated based on the accuracy and informativeness of the experts on calibration questions. PARTICIPANTS: Ten specialists with expertise in food procurement, retail, agriculture, economics, statistics and household food security. RESULTS: When combined in proportions used to calculate Consumer Price Index food basket costs, median food price change for Brexit with a Deal is expected to be +6.1% (90% credible interval -3% to +17%) and with No-deal +22.5% (90% credible interval +1% to +52%). CONCLUSIONS: The number of households experiencing food insecurity and its severity is likely to increase because of expected sizeable increases in median food prices after Brexit. Higher increases are more likely than lower rises and towards the upper limits, these would entail severe impacts. Research showing a low food budget leads to increasingly poor diet suggests that demand for health services in both the short and longer terms is likely to increase due to the effects of food insecurity on the incidence and management of diet-sensitive conditions.

Ice sheet contributions to future sea-level rise from structured expert judgment.

Despite considerable advances in process understanding, numerical modeling, and the observational record of ice sheet contributions to global mean sea-level rise (SLR) since the Fifth Assessment Report (AR5) of the Intergovernmental Panel on Climate Change, severe limitations remain in the predictive capability of ice sheet models. As a consequence, the potential contributions of ice sheets remain the largest source of uncertainty in projecting future SLR. Here, we report the findings of a structured expert judgement study, using unique techniques for modeling correlations between inter- and intra-ice sheet processes and their tail dependences. We find that since the AR5, expert uncertainty has grown, in particular because of uncertain ice dynamic effects. For a +2 °C temperature scenario consistent with the Paris Agreement, we obtain a median estimate of a 26 cm SLR contribution by 2100, with a 95th percentile value of 81 cm. For a +5 °C temperature scenario more consistent with unchecked emissions growth, the corresponding values are 51 and 178 cm, respectively. Inclusion of thermal expansion and glacier contributions results in a global total SLR estimate that exceeds 2 m at the 95th percentile. Our findings support the use of scenarios of 21st century global total SLR exceeding 2 m for planning purposes. Beyond 2100, uncertainty and projected SLR increase rapidly. The 95th percentile ice sheet contribution by 2200, for the +5 °C scenario, is 7.5 m as a result of instabilities coming into play in both West and East Antarctica. Introducing process correlations and tail dependences increases estimates by roughly 15%.

Oklahoma's induced seismicity strongly linked to wastewater injection depth.

The sharp rise in Oklahoma seismicity since 2009 is due to wastewater injection. The role of injection depth is an open, complex issue, yet critical for hazard assessment and regulation. We developed an advanced Bayesian network to model joint conditional dependencies between spatial, operational, and seismicity parameters. We found that injection depth relative to crystalline basement most strongly correlates with seismic moment release. The joint effects of depth and volume are critical, as injection rate becomes more influential near the basement interface. Restricting injection depths to 200 to 500 meters above basement could reduce annual seismic moment release by a factor of 1.4 to 2.8. Our approach enables identification of subregions where targeted regulation may mitigate effects of induced earthquakes, aiding operators and regulators in wastewater disposal regions.

Attribution of global foodborne disease to specific foods: Findings from a World Health Organization structured expert elicitation.

BACKGROUND: Recently the World Health Organization, Foodborne Disease Burden Epidemiology Reference Group (FERG) estimated that 31 foodborne diseases (FBDs) resulted in over 600 million illnesses and 420,000 deaths worldwide in 2010. Knowing the relative role importance of different foods as exposure routes for key hazards is critical to preventing illness. This study reports the findings of a structured expert elicitation providing globally comparable food source attribution estimates for 11 major FBDs in each of 14 world subregions. METHODS AND FINDINGS: We used Cooke's Classical Model to elicit and aggregate judgments of 73 international experts. Judgments were elicited from each expert individually and aggregated using both equal and performance weights. Performance weighted results are reported as they increased the informativeness of estimates, while retaining accuracy. We report measures of central tendency and uncertainty bounds on food source attribution estimate. For some pathogens we see relatively consistent food source attribution estimates across subregions of the world; for others there is substantial regional variation. For example, for non-typhoidal salmonellosis, pork was of minor importance compared to eggs and poultry meat in the American and African subregions, whereas in the European and Western Pacific subregions the importance of these three food sources were quite similar. Our regional results broadly agree with estimates from earlier European and North American food source attribution research. As in prior food source attribution research, we find relatively wide uncertainty bounds around our median estimates. CONCLUSIONS: We present the first worldwide estimates of the proportion of specific foodborne diseases attributable to specific food exposure routes. While we find substantial uncertainty around central tendency estimates, we believe these estimates provide the best currently available basis on which to link FBDs and specific foods in many parts of the world, providing guidance for policy actions to control FBDs.

Using expert judgments to improve chronic wasting disease risk management in Canada.

ABSTARCT Chronic wasting disease (CWD) is a neurodegenerative, protein misfolding disease affecting cervids in North America in epidemic proportions. While the existence of CWD has been known for more than 40 years, risk management efforts to date have not been able to curtail the spread of this condition. An expert elicitation exercise was carried out in May 2011 to obtain the views of international experts on both the etiology of CWD and possible CWD risk management strategies. This study presents the results of the following three components of the elicitation exercise: (1) expert views of the most likely scenarios for the evolution of the CWD among cervid populations in Canada, (2) ranking analyses of the importance of direct and indirect transmission routes, and (3) rating analyses of CWD control measures in farmed and wild cervids. The implications of these findings for the development of CWD risk management strategies are described in a Canadian context.

Expert elicitation on the uncertainties associated with chronic wasting disease.

A high degree of uncertainty exists for chronic wasting disease (CWD) transmission factors in farmed and wild cervids. Evaluating the factors is important as it helps to inform future risk management strategies. Expert opinion is often used to assist decision making in a number of health, science, and technology domains where data may be sparse or missing. Using the "Classical Model" of elicitation, a group of experts was asked to estimate the most likely values for several risk factors affecting CWD transmission. The formalized expert elicitation helped structure the issues and hence provide a rational basis for estimating some transmission risk factors for which evidence is lacking. Considered judgments regarding environmental transmission, latency of CWD transmission, management, and species barrier were provided by the experts. Uncertainties for many items were determined to be large, highlighting areas requiring more research. The elicited values may be used as surrogate values until research evidence becomes available.

World Health Organization Estimates of the Relative Contributions of Food to the Burden of Disease Due to Selected Foodborne Hazards: A Structured Expert Elicitation.

BACKGROUND: The Foodborne Disease Burden Epidemiology Reference Group (FERG) was established in 2007 by the World Health Organization (WHO) to estimate the global burden of foodborne diseases (FBDs). This estimation is complicated because most of the hazards causing FBD are not transmitted solely by food; most have several potential exposure routes consisting of transmission from animals, by humans, and via environmental routes including water. This paper describes an expert elicitation study conducted by the FERG Source Attribution Task Force to estimate the relative contribution of food to the global burden of diseases commonly transmitted through the consumption of food. METHODS AND FINDINGS: We applied structured expert judgment using Cooke's Classical Model to obtain estimates for 14 subregions for the relative contributions of different transmission pathways for eleven diarrheal diseases, seven other infectious diseases and one chemical (lead). Experts were identified through international networks followed by social network sampling. Final selection of experts was based on their experience including international working experience. Enrolled experts were scored on their ability to judge uncertainty accurately and informatively using a series of subject-matter specific 'seed' questions whose answers are unknown to the experts at the time they are interviewed. Trained facilitators elicited the 5th, and 50th and 95th percentile responses to seed questions through telephone interviews. Cooke's Classical Model uses responses to the seed questions to weigh and aggregate expert responses. After this interview, the experts were asked to provide 5th, 50th, and 95th percentile estimates for the 'target' questions regarding disease transmission routes. A total of 72 experts were enrolled in the study. Ten panels were global, meaning that the experts should provide estimates for all 14 subregions, whereas the nine panels were subregional, with experts providing estimates for one or more subregions, depending on their experience in the region. The size of the 19 hazard-specific panels ranged from 6 to 15 persons with several experts serving on more than one panel. Pathogens with animal reservoirs (e.g. non-typhoidal Salmonella spp. and Toxoplasma gondii) were in general assessed by the experts to have a higher proportion of illnesses attributable to food than pathogens with mainly a human reservoir, where human-to-human transmission (e.g. Shigella spp. and Norovirus) or waterborne transmission (e.g. Salmonella Typhi and Vibrio cholerae) were judged to dominate. For many pathogens, the foodborne route was assessed relatively more important in developed subregions than in developing subregions. The main exposure routes for lead varied across subregions, with the foodborne route being assessed most important only in two subregions of the European region. CONCLUSIONS: For the first time, we present worldwide estimates of the proportion of specific diseases attributable to food and other major transmission routes. These findings are essential for global burden of FBD estimates. While gaps exist, we believe the estimates presented here are the best current source of guidance to support decision makers when allocating resources for control and intervention, and for future research initiatives.

Expert elicitation for the judgment of prion disease risk uncertainties.

There is a high level of uncertainty surrounding the potential for iatrogenic prion transmission through transplantation, medical instrument reuse, blood transfusion, and blood product use due to a lack of evidence-based research on this important risk issue. A group of specialists was enlisted to evaluate some of the knowledge gaps in this area using the "Classical Model," a structured elicitation procedure for weighting and pooling expert judgment. The elicitation exercise was undertaken in March 2009 with 11 transmissible spongiform encephalopathy (TSE) experts who were first calibrated using a series of seed questions for which the answers are known; they were then asked to answer a number of target questions that are important for risk assessment purposes, but for which there remains high uncertainty at this time. The target questions focused on variant Creutzfeldt-Jakob disease (vCJD) prevalence, incubation times for vCJD, genetic susceptibility to prion disease, blood infectivity, prion reduction of blood and blood products, surgical instrument risks, and interspecies transmission of TSEs. The experts were also asked to perform pairwise risk rankings for 12 different potential routes of infection. Dura mater transplantation was seen as having the highest risk, while dental tissue grafts were viewed as presenting the lowest risk of iatrogenic transmission. The structured elicitation procedure provides a rational, auditable, and repeatable basis for obtaining useful information on prion disease risk issues, for which data are sparse.