Ozone as an environmental driver of influenza.

Under long-standing threat of seasonal influenza outbreaks, it remains imperative to understand the drivers of influenza dynamics which can guide mitigation measures. While the role of absolute humidity and temperature is extensively studied, the possibility of ambient ozone (O3) as an environmental driver of influenza has received scant attention. Here, using state-level data in the USA during 2010-2015, we examined such research hypothesis. For rigorous causal inference by evidence triangulation, we applied 3 distinct methods for data analysis: Convergent Cross Mapping from state-space reconstruction theory, Peter-Clark-momentary-conditional-independence plus as graphical modeling algorithms, and regression-based Generalised Linear Model. The negative impact of ambient O3 on influenza activity at 1-week lag is consistently demonstrated by those 3 methods. With O3 commonly known as air pollutant, the novel findings here on the inhibition effect of O3 on influenza activity warrant further investigations to inform environmental management and public health protection.

Network-based forecasting of climate phenomena.

Network theory, as emerging from complex systems science, can provide critical predictive power for mitigating the global warming crisis and other societal challenges. Here we discuss the main differences of this approach to classical numerical modeling and highlight several cases where the network approach substantially improved the prediction of high-impact phenomena: 1) El Niño events, 2) droughts in the central Amazon, 3) extreme rainfall in the eastern Central Andes, 4) the Indian summer monsoon, and 5) extreme stratospheric polar vortex states that influence the occurrence of wintertime cold spells in northern Eurasia. In this perspective, we argue that network-based approaches can gainfully complement numerical modeling.

Reconstructing regime-dependent causal relationships from observational time series.

Inferring causal relations from observational time series data is a key problem across science and engineering whenever experimental interventions are infeasible or unethical. Increasing data availability over the past few decades has spurred the development of a plethora of causal discovery methods, each addressing particular challenges of this difficult task. In this paper, we focus on an important challenge that is at the core of time series causal discovery: regime-dependent causal relations. Often dynamical systems feature transitions depending on some, often persistent, unobserved background regime, and different regimes may exhibit different causal relations. Here, we assume a persistent and discrete regime variable leading to a finite number of regimes within which we may assume stationary causal relations. To detect regime-dependent causal relations, we combine the conditional independence-based PCMCI method [based on a condition-selection step (PC) followed by the momentary conditional independence (MCI) test] with a regime learning optimization approach. PCMCI allows for causal discovery from high-dimensional and highly correlated time series. Our method, Regime-PCMCI, is evaluated on a number of numerical experiments demonstrating that it can distinguish regimes with different causal directions, time lags, and sign of causal links, as well as changes in the variables' autocorrelation. Furthermore, Regime-PCMCI is employed to observations of El Niño Southern Oscillation and Indian rainfall, demonstrating skill also in real-world datasets.

Causal networks for climate model evaluation and constrained projections.

Global climate models are central tools for understanding past and future climate change. The assessment of model skill, in turn, can benefit from modern data science approaches. Here we apply causal discovery algorithms to sea level pressure data from a large set of climate model simulations and, as a proxy for observations, meteorological reanalyses. We demonstrate how the resulting causal networks (fingerprints) offer an objective pathway for process-oriented model evaluation. Models with fingerprints closer to observations better reproduce important precipitation patterns over highly populated areas such as the Indian subcontinent, Africa, East Asia, Europe and North America. We further identify expected model interdependencies due to shared development backgrounds. Finally, our network metrics provide stronger relationships for constraining precipitation projections under climate change as compared to traditional evaluation metrics for storm tracks or precipitation itself. Such emergent relationships highlight the potential of causal networks to constrain longstanding uncertainties in climate change projections.

Detecting and quantifying causal associations in large nonlinear time series datasets.

Identifying causal relationships and quantifying their strength from observational time series data are key problems in disciplines dealing with complex dynamical systems such as the Earth system or the human body. Data-driven causal inference in such systems is challenging since datasets are often high dimensional and nonlinear with limited sample sizes. Here, we introduce a novel method that flexibly combines linear or nonlinear conditional independence tests with a causal discovery algorithm to estimate causal networks from large-scale time series datasets. We validate the method on time series of well-understood physical mechanisms in the climate system and the human heart and using large-scale synthetic datasets mimicking the typical properties of real-world data. The experiments demonstrate that our method outperforms state-of-the-art techniques in detection power, which opens up entirely new possibilities to discover and quantify causal networks from time series across a range of research fields.

Inferring causation from time series in Earth system sciences.

The heart of the scientific enterprise is a rational effort to understand the causes behind the phenomena we observe. In large-scale complex dynamical systems such as the Earth system, real experiments are rarely feasible. However, a rapidly increasing amount of observational and simulated data opens up the use of novel data-driven causal methods beyond the commonly adopted correlation techniques. Here, we give an overview of causal inference frameworks and identify promising generic application cases common in Earth system sciences and beyond. We discuss challenges and initiate the benchmark platform causeme.net to close the gap between method users and developers.

Common solar wind drivers behind magnetic storm-magnetospheric substorm dependency.

The dynamical relationship between magnetic storms and magnetospheric substorms is one of the most controversial issues of contemporary space research. Here, we address this issue through a causal inference approach to two corresponding indices in conjunction with several relevant solar wind variables. We find that the vertical component of the interplanetary magnetic field is the strongest and common driver of both storms and substorms. Further, our results suggest, at least based on the analyzed indices, that there is no statistical evidence for a direct or indirect dependency between substorms and storms and their statistical association can be explained by the common solar drivers. Given the powerful statistical tests we performed (by simultaneously taking into account time series of indices and solar wind variables), a physical mechanism through which substorms directly or indirectly drive storms or vice versa is, therefore, unlikely.

Introduction to Focus Issue: Causation inference and information flow in dynamical systems: Theory and applications.

Questions of causation are foundational across science and often relate further to problems of control, policy decisions, and forecasts. In nonlinear dynamics and complex systems science, causation inference and information flow are closely related concepts, whereby "information" or knowledge of certain states can be thought of as coupling influence onto the future states of other processes in a complex system. While causation inference and information flow are by now classical topics, incorporating methods from statistics and time series analysis, information theory, dynamical systems, and statistical mechanics, to name a few, there remain important advancements in continuing to strengthen the theory, and pushing the context of applications, especially with the ever-increasing abundance of data collected across many fields and systems. This Focus Issue considers different aspects of these questions, both in terms of founding theory and several topical applications.

Unified functional network and nonlinear time series analysis for complex systems science: The pyunicorn package.

We introduce the pyunicorn (Pythonic unified complex network and recurrence analysis toolbox) open source software package for applying and combining modern methods of data analysis and modeling from complex network theory and nonlinear time series analysis. pyunicorn is a fully object-oriented and easily parallelizable package written in the language Python. It allows for the construction of functional networks such as climate networks in climatology or functional brain networks in neuroscience representing the structure of statistical interrelationships in large data sets of time series and, subsequently, investigating this structure using advanced methods of complex network theory such as measures and models for spatial networks, networks of interacting networks, node-weighted statistics, or network surrogates. Additionally, pyunicorn provides insights into the nonlinear dynamics of complex systems as recorded in uni- and multivariate time series from a non-traditional perspective by means of recurrence quantification analysis, recurrence networks, visibility graphs, and construction of surrogate time series. The range of possible applications of the library is outlined, drawing on several examples mainly from the field of climatology.

Identifying causal gateways and mediators in complex spatio-temporal systems.

Identifying regions important for spreading and mediating perturbations is crucial to assess the susceptibilities of spatio-temporal complex systems such as the Earth's climate to volcanic eruptions, extreme events or geoengineering. Here a data-driven approach is introduced based on a dimension reduction, causal reconstruction, and novel network measures based on causal effect theory that go beyond standard complex network tools by distinguishing direct from indirect pathways. Applied to a data set of atmospheric dynamics, the method identifies several strongly uplifting regions acting as major gateways of perturbations spreading in the atmosphere. Additionally, the method provides a stricter statistical approach to pathways of atmospheric teleconnections, yielding insights into the Pacific-Indian Ocean interaction relevant for monsoonal dynamics. Also for neuroscience or power grids, the novel causal interaction perspective provides a complementary approach to simulations or experiments for understanding the functioning of complex spatio-temporal systems with potential applications in increasing their resilience to shocks or extreme events.

Optimal model-free prediction from multivariate time series.

Forecasting a time series from multivariate predictors constitutes a challenging problem, especially using model-free approaches. Most techniques, such as nearest-neighbor prediction, quickly suffer from the curse of dimensionality and overfitting for more than a few predictors which has limited their application mostly to the univariate case. Therefore, selection strategies are needed that harness the available information as efficiently as possible. Since often the right combination of predictors matters, ideally all subsets of possible predictors should be tested for their predictive power, but the exponentially growing number of combinations makes such an approach computationally prohibitive. Here a prediction scheme that overcomes this strong limitation is introduced utilizing a causal preselection step which drastically reduces the number of possible predictors to the most predictive set of causal drivers making a globally optimal search scheme tractable. The information-theoretic optimality is derived and practical selection criteria are discussed. As demonstrated for multivariate nonlinear stochastic delay processes, the optimal scheme can even be less computationally expensive than commonly used suboptimal schemes like forward selection. The method suggests a general framework to apply the optimal model-free approach to select variables and subsequently fit a model to further improve a prediction or learn statistical dependencies. The performance of this framework is illustrated on a climatological index of El Niño Southern Oscillation.

Quantifying the causal strength of multivariate cardiovascular couplings with momentary information transfer.

This article studies a recently introduced information-theoretic approach to detect and quantify the causal couplings in a complex cardiovascular system. In the first step a causal algorithm detects the coupling delays and in the second step the causal strength of each coupling mechanism is quantified using the recently introduced momentary information transfer. As an example, the method is applied to time series of respiration, systolic and diastolic blood pressure, and heart rate of pregnant healthy women and women suffering from pre-eclampsia. A possible explanation for the influence of heart rate on systolic blood pressure is found and some differences between healthy women and patients are discussed.

Quantifying information transfer and mediation along causal pathways in complex systems.

Measures of information transfer have become a popular approach to analyze interactions in complex systems such as the Earth or the human brain from measured time series. Recent work has focused on causal definitions of information transfer aimed at decompositions of predictive information about a target variable, while excluding effects of common drivers and indirect influences. While common drivers clearly constitute a spurious causality, the aim of the present article is to develop measures quantifying different notions of the strength of information transfer along indirect causal paths, based on first reconstructing the multivariate causal network. Another class of novel measures quantifies to what extent different intermediate processes on causal paths contribute to an interaction mechanism to determine pathways of causal information transfer. The proposed framework complements predictive decomposition schemes by focusing more on the interaction mechanism between multiple processes. A rigorous mathematical framework allows for a clear information-theoretic interpretation that can also be related to the underlying dynamics as proven for certain classes of processes. Generally, however, estimates of information transfer remain hard to interpret for nonlinearly intertwined complex systems. But if experiments or mathematical models are not available, then measuring pathways of information transfer within the causal dependency structure allows at least for an abstraction of the dynamics. The measures are illustrated on a climatological example to disentangle pathways of atmospheric flow over Europe.

Disentangling different types of El Niño episodes by evolving climate network analysis.

Complex network theory provides a powerful toolbox for studying the structure of statistical interrelationships between multiple time series in various scientific disciplines. In this work, we apply the recently proposed climate network approach for characterizing the evolving correlation structure of the Earth's climate system based on reanalysis data for surface air temperatures. We provide a detailed study of the temporal variability of several global climate network characteristics. Based on a simple conceptual view of red climate networks (i.e., networks with a comparably low number of edges), we give a thorough interpretation of our evolving climate network characteristics, which allows a functional discrimination between recently recognized different types of El Niño episodes. Our analysis provides deep insights into the Earth's climate system, particularly its global response to strong volcanic eruptions and large-scale impacts of different phases of the El Niño Southern Oscillation.

Escaping the curse of dimensionality in estimating multivariate transfer entropy.

Multivariate transfer entropy (TE) is a model-free approach to detect causalities in multivariate time series. It is able to distinguish direct from indirect causality and common drivers without assuming any underlying model. But despite these advantages it has mostly been applied in a bivariate setting as it is hard to estimate reliably in high dimensions since its definition involves infinite vectors. To overcome this limitation, we propose to embed TE into the framework of graphical models and present a formula that decomposes TE into a sum of finite-dimensional contributions that we call decomposed transfer entropy. Graphical models further provide a richer picture because they also yield the causal coupling delays. To estimate the graphical model we suggest an iterative algorithm, a modified version of the PC-algorithm with a very low estimation dimension. We present an appropriate significance test and demonstrate the method's performance using examples of nonlinear stochastic delay-differential equations and observational climate data (sea level pressure).

Quantifying causal coupling strength: a lag-specific measure for multivariate time series related to transfer entropy.

While it is an important problem to identify the existence of causal associations between two components of a multivariate time series, a topic addressed in Runge, Heitzig, Petoukhov, and Kurths [Phys. Rev. Lett. 108, 258701 (2012)], it is even more important to assess the strength of their association in a meaningful way. In the present article we focus on the problem of defining a meaningful coupling strength using information-theoretic measures and demonstrate the shortcomings of the well-known mutual information and transfer entropy. Instead, we propose a certain time-delayed conditional mutual information, the momentary information transfer (MIT), as a lag-specific measure of association that is general, causal, reflects a well interpretable notion of coupling strength, and is practically computable. Rooted in information theory, MIT is general in that it does not assume a certain model class underlying the process that generates the time series. As discussed in a previous paper [Runge, Heitzig, Petoukhov, and Kurths, Phys. Rev. Lett. 108, 258701 (2012)], the general framework of graphical models makes MIT causal in that it gives a nonzero value only to lagged components that are not independent conditional on the remaining process. Further, graphical models admit a low-dimensional formulation of conditions, which is important for a reliable estimation of conditional mutual information and, thus, makes MIT practically computable. MIT is based on the fundamental concept of source entropy, which we utilize to yield a notion of coupling strength that is, compared to mutual information and transfer entropy, well interpretable in that, for many cases, it solely depends on the interaction of the two components at a certain lag. In particular, MIT is, thus, in many cases able to exclude the misleading influence of autodependency within a process in an information-theoretic way. We formalize and prove this idea analytically and numerically for a general class of nonlinear stochastic processes and illustrate the potential of MIT on climatological data.

Momentary information transfer as a coupling measure of time series.

We propose a method to analyze couplings between two simultaneously measured time series. Our approach is based on conditional mutual sorting information. It is related to other concepts for detecting coupling directions: the old idea of Marko for directed information and the more recent concept of Schreiber's transfer entropy. By setting suitable conditions we first of all consider momentary information in both time series. This enables the detection not only of coupling directions but also delays. Sorting information refers to ordinal properties of time series, which makes the analysis robust with respect to strictly monotonous distortions and thus very useful in the analysis of proxy data in climatology. Fortunately, ordinal analysis is easy and fast to compute. We consider also the problem of reliable estimation from finite time series.