Identifying and cultivating superforecasters as a method of improving probabilistic predictions.

Across a wide range of tasks, research has shown that people make poor probabilistic predictions of future events. Recently, the U.S. Intelligence Community sponsored a series of forecasting tournaments designed to explore the best strategies for generating accurate subjective probability estimates of geopolitical events. In this article, we describe the winning strategy: culling off top performers each year and assigning them into elite teams of superforecasters. Defying expectations of regression toward the mean 2 years in a row, superforecasters maintained high accuracy across hundreds of questions and a wide array of topics. We find support for four mutually reinforcing explanations of superforecaster performance: (a) cognitive abilities and styles, (b) task-specific skills, (c) motivation and commitment, and (d) enriched environments. These findings suggest that superforecasters are partly discovered and partly created-and that the high-performance incentives of tournaments highlight aspects of human judgment that would not come to light in laboratory paradigms focused on typical performance.

The psychology of intelligence analysis: drivers of prediction accuracy in world politics.

This article extends psychological methods and concepts into a domain that is as profoundly consequential as it is poorly understood: intelligence analysis. We report findings from a geopolitical forecasting tournament that assessed the accuracy of more than 150,000 forecasts of 743 participants on 199 events occurring over 2 years. Participants were above average in intelligence and political knowledge relative to the general population. Individual differences in performance emerged, and forecasting skills were surprisingly consistent over time. Key predictors were (a) dispositional variables of cognitive ability, political knowledge, and open-mindedness; (b) situational variables of training in probabilistic reasoning and participation in collaborative teams that shared information and discussed rationales (Mellers, Ungar, et al., 2014); and (c) behavioral variables of deliberation time and frequency of belief updating. We developed a profile of the best forecasters; they were better at inductive reasoning, pattern detection, cognitive flexibility, and open-mindedness. They had greater understanding of geopolitics, training in probabilistic reasoning, and opportunities to succeed in cognitively enriched team environments. Last but not least, they viewed forecasting as a skill that required deliberate practice, sustained effort, and constant monitoring of current affairs.

Pet Ownership and Evacuation Prior to Hurricane Irene.

Pet ownership has historically been one of the biggest risk factors for evacuation failure prior to natural disasters. The forced abandonment of pets during Hurricane Katrina in 2005 made national headlines and led to the passage of the Pet Evacuation and Transportation Standards Act (PETS, 2006) which mandated local authorities to plan for companion animal evacuation. Hurricane Irene hit the East Coast of the United States in 2011, providing an excellent opportunity to examine the impact of the PETS legislation on frequency and ease of evacuation among pet owners and non-pet owners. Ninety pet owners and 27 non-pet owners who lived in mandatory evacuation zones completed questionnaires assessing their experiences during the hurricane and symptoms of depression, PTSD, dissociative experiences, and acute stress. Pet ownership was not found to be a statistical risk factor for evacuation failure. However, many pet owners who failed to evacuate continue to cite pet related reasons.