The asymptotic distribution of the permutation entropy.

Ordinal patterns serve as a robust symbolic transformation technique, enabling the unveiling of latent dynamics within time series data. This methodology involves constructing histograms of patterns, followed by the calculation of both entropy and statistical complexity-an avenue yet to be fully understood in terms of its statistical properties. While asymptotic results can be derived by assuming a multinomial distribution for histogram proportions, the challenge emerges from the non-independence present in the sequence of ordinal patterns. Consequently, the direct application of the multinomial assumption is questionable. This study focuses on the computation of the asymptotic distribution of permutation entropy, considering the inherent patterns' correlation structure. Furthermore, the research delves into a comparative analysis, pitting this distribution against the entropy derived from a multinomial law. We present simulation algorithms for sampling time series with prescribed histograms of patterns and transition probabilities between them. Through this analysis, we better understand the intricacies of ordinal patterns and their statistical attributes.

Statistical properties of the entropy from ordinal patterns.

The ultimate purpose of the statistical analysis of ordinal patterns is to characterize the distribution of the features they induce. In particular, knowing the joint distribution of the pair entropy-statistical complexity for a large class of time series models would allow statistical tests that are unavailable to date. Working in this direction, we characterize the asymptotic distribution of the empirical Shannon's entropy for any model under which the true normalized entropy is neither zero nor one. We obtain the asymptotic distribution from the central limit theorem (assuming large time series), the multivariate delta method, and a third-order correction of its mean value. We discuss the applicability of other results (exact, first-, and second-order corrections) regarding their accuracy and numerical stability. Within a general framework for building test statistics about Shannon's entropy, we present a bilateral test that verifies if there is enough evidence to reject the hypothesis that two signals produce ordinal patterns with the same Shannon's entropy. We applied this bilateral test to the daily maximum temperature time series from three cities (Dublin, Edinburgh, and Miami) and obtained sensible results.