Emulation of Sun-Induced Fluorescence from Radiance Data Recorded by the HyPlant Airborne Imaging Spectrometer.

The retrieval of sun-induced fluorescence (SIF) from hyperspectral radiance data grew to maturity with research activities around the FLuorescence EXplorer satellite mission FLEX, yet full-spectrum estimation methods such as the spectral fitting method (SFM) are computationally expensive. To bypass this computational load, this work aims to approximate the SFM-based SIF retrieval by means of statistical learning, i.e., emulation. While emulators emerged as fast surrogate models of simulators, the accuracy-speedup trade-offs are still to be analyzed when the emulation concept is applied to experimental data. We evaluated the possibility of approximating the SFM-like SIF output directly based on radiance data while minimizing the loss in precision as opposed to SFM-based SIF. To do so, we implemented a double principal component analysis (PCA) dimensionality reduction, i.e., in both input and output, to achieve emulation of multispectral SIF output based on hyperspectral radiance data. We then evaluated systematically: (1) multiple machine learning regression algorithms, (2) number of principal components, (3) number of training samples, and (4) quality of training samples. The best performing SIF emulator was then applied to a HyPlant flight line containing at sensor radiance information, and the results were compared to the SFM SIF map of the same flight line. The emulated SIF map was quasi-instantaneously generated, and a good agreement against the reference SFM map was obtained with a R 2 of 0.88 and NRMSE of 3.77%. The SIF emulator was subsequently applied to 7 HyPlant flight lines to evaluate its robustness and portability, leading to a R 2 between 0.68 and 0.95, and a NRMSE between 6.42% and 4.13%. Emulated SIF maps proved to be consistent while processing time was in the order of 3 min. In comparison, the original SFM needed approximately 78 min to complete the SIF processing. Our results suggest that emulation can be used to efficiently reduce computational loads of SIF retrieval methods.

Retrieving and Validating Leaf and Canopy Chlorophyll Content at Moderate Resolution: A Multiscale Analysis with the Sentinel-3 OLCI Sensor.

ESA's Eighth Earth Explorer mission "FLuorescence EXplorer" (FLEX) will be dedicated to the global monitoring of the chlorophyll fluorescence emitted by vegetation. In order to properly interpret the measured fluorescence signal, essential vegetation variables need to be retrieved concomitantly. FLEX will fly in tandem formation with Sentinel-3 (S3), which conveys the Ocean and Land Color Instrument (OLCI) that is designed to characterize the atmosphere and the terrestrial vegetation at a spatial resolution of 300 m. In support of FLEX's preparatory activities, this paper presents a first validation exercise of OLCI vegetation products against in situ data coming from the 2018 FLEXSense campaign. During this campaign, leaf chlorophyll content (LCC) and leaf area index (LAI) measurements were collected over croplands, while HyPlant DUAL images of the area were acquired at a 3 m spatial resolution. A multiscale validation strategy was pursued. First, estimates of these two variables, together with the combined canopy chlorophyll content (CCC = LCC × LAI), were obtained at the HyPlant spatial resolution and were compared against the in situ measurements. Second, the fine-scale retrieval maps from HyPlant were coarsened to the S3 spatial scale as a reference to assess the quality of the OLCI vegetation products. As an intermediary step, vegetation products extracted from Sentinel-2 data were used to compare retrievals at the in-between spatial resolution of 20 m. For all spatial scales, CCC delivered the most accurate estimates with the smallest prediction error obtained at the 300 m resolution (R2 of 0.74 and RMSE = 26.8 µg cm-2). Results of a scaling analysis suggest that CCC performs well at the different tested spatial resolutions since it presents a linear behavior across scales. LCC, on the other hand, was poorly retrieved at the 300 m scale, showing overestimated values over heterogeneous pixels. The introduction of a new LCC model integrating mixed reflectance spectra in its training enabled to improve by 16% the retrieval accuracy for this variable (RMSE = 10 µg cm-2 for the new model versus RMSE = 11.9 µg cm-2 for the former model).

DATimeS: A machine learning time series GUI toolbox for gap-filling and vegetation phenology trends detection.

Optical remotely sensed data are typically discontinuous, with missing values due to cloud cover. Consequently, gap-filling solutions are needed for accurate crop phenology characterization. The here presented Decomposition and Analysis of Time Series software (DATimeS) expands established time series interpolation methods with a diversity of advanced machine learning fitting algorithms (e.g., Gaussian Process Regression: GPR) particularly effective for the reconstruction of multiple-seasons vegetation temporal patterns. DATimeS is freely available as a powerful image time series software that generates cloud-free composite maps and captures seasonal vegetation dynamics from regular or irregular satellite time series. This work describes the main features of DATimeS, and provides a demonstration case using Sentinel-2 Leaf Area Index time series data over a Spanish site. GPR resulted as an optimum fitting algorithm with most accurate gap-filling performance and associated uncertainties. DATimeS further quantified LAI fluctuations among multiple crop seasons and provided phenological indicators for specific crop types.

Optimizing Gaussian Process Regression for Image Time Series Gap-Filling and Crop Monitoring.

Image processing entered the era of artificial intelligence, and machine learning algorithms emerged as attractive alternatives for time series data processing. Satellite image time series processing enables crop phenology monitoring, such as the calculation of start and end of season. Among the promising algorithms, Gaussian process regression (GPR) proved to be a competitive time series gap-filling algorithm with the advantage of, as developed within a Bayesian framework, providing associated uncertainty estimates. Nevertheless, the processing of time series images becomes computationally inefficient in its standard per-pixel usage, mainly for GPR training rather than the fitting step. To mitigate this computational burden, we propose to substitute the per-pixel optimization step with the creation of a cropland-based precalculations for the GPR hyperparameters θ . To demonstrate our approach hardly affects the accuracy in fitting, we used Sentinel-2 LAI time series over an agricultural region in Castile and Leon, North-West Spain. The performance of image reconstructions were compared against the standard per-pixel GPR time series processing. Results showed that accuracies were on the same order (RMSE 0.1767 vs. 0.1564 [m2/m2], 12% RMSE degradation) whereas processing time accelerated about 90 times. We further evaluated the alternative option of using the same hyperparameters for all the pixels within the complete scene. It led to similar overall accuracies over crop areas and computational performance. Crop phenology indicators were also calculated for the three different approaches and compared. Results showed analogous crop temporal patterns, with differences in start and end of growing season of no more than five days. To the benefit of crop monitoring applications, all the gap-filling and phenology indicators retrieval techniques have been implemented into the freely downloadable GUI toolbox DATimeS.

Gaussian processes retrieval of LAI from Sentinel-2 top-of-atmosphere radiance data.

Retrieval of vegetation properties from satellite and airborne optical data usually takes place after atmospheric correction, yet it is also possible to develop retrieval algorithms directly from top-of-atmosphere (TOA) radiance data. One of the key vegetation variables that can be retrieved from at-sensor TOA radiance data is leaf area index (LAI) if algorithms account for variability in atmosphere. We demonstrate the feasibility of LAI retrieval from Sentinel-2 (S2) TOA radiance data (L1C product) in a hybrid machine learning framework. To achieve this, the coupled leaf-canopy-atmosphere radiative transfer models PROSAIL-6SV were used to simulate a look-up table (LUT) of TOA radiance data and associated input variables. This LUT was then used to train the Bayesian machine learning algorithms Gaussian processes regression (GPR) and variational heteroscedastic GPR (VHGPR). PROSAIL simulations were also used to train GPR and VHGPR models for LAI retrieval from S2 images at bottom-of-atmosphere (BOA) level (L2A product) for comparison purposes. The BOA and TOA LAI products were consistently validated against a field dataset with GPR (R2 of 0.78) and with VHGPR (R 2 of 0.80) and for both cases a slightly lower RMSE for the TOA LAI product (about 10% reduction). Because of delivering superior accuracies and lower uncertainties, the VHGPR models were further applied for LAI mapping using S2 acquisitions over the agricultural sites Marchfeld (Austria) and Barrax (Spain). The models led to consistent LAI maps at BOA and TOA scale. The LAI maps were also compared against LAI maps as generated by the SNAP toolbox, which is based on a neural network (NN). Maps were again consistent, however the SNAP NN model tends to overestimate over dense vegetation cover. Overall, this study demonstrated that hybrid LAI retrieval algorithms can be developed from TOA radiance data given a cloud-free sky, thus without the need of atmospheric correction. To the benefit of the community, the development of such hybrid models for the retrieval vegetation properties from BOA or TOA images has been streamlined in the freely downloadable ALG-ARTMO software framework.

Quantifying vegetation biophysical variables from the Sentinel-3/FLEX tandem mission: Evaluation of the synergy of OLCI and FLORIS data sources.

The ESA's forthcoming FLuorescence EXplorer (FLEX) mission is dedicated to the global monitoring of the vegetation's chlorophyll fluorescence by means of an imaging spectrometer, FLORIS. In order to properly interpret the fluorescence signal in relation to photosynthetic activity, essential vegetation variables need to be retrieved concomitantly. FLEX will fly in tandem with Sentinel-3 (S3), which conveys the Ocean and Land Colour Instrument (OLCI) that is designed to characterize the atmosphere and the terrestrial vegetation at a spatial resolution of 300 m. In this work we present the retrieval models of four essential biophysical variables: (1) Leaf Area Index (LAI), (2) leaf chlorophyll content (Cab), (3) fraction of absorbed photosynthetically active radiation (fAPAR), and (4) fractional vegetation cover (FCover). These variables can be operationally inferred by hybrid retrieval approaches, which combine the generalization capabilities offered by radiative transfer models (RTMs) with the flexibility and computational efficiency of machine learning methods. The RTM SCOPE (Soil Canopy Observation, Photochemistry and Energy fluxes) was used to generate a database of reflectance spectra corresponding to a large variety of canopy realizations, which served subsequently as input to train a Gaussian Process Regression (GPR) algorithm for each targeted variable. Three sets of GPR models were developed, based on different spectral band settings: (1) OLCI (21 bands between 400 and 1040 nm), (2) FLORIS (281 bands between 500 and 780 nm), and (3) their synergy. Their respective performances were assessed based on simulated reflectance scenes. Regarding the retrieval of Cab, the OLCI model gave good model performances (R2: 0.91; RMSE: 7.6 µg. cm -2), yet superior accuracies were achieved as a result of FLORIS' higher spectral resolution (R2: 0.96; RMSE: 4.8 µg. cm -2). The synergy of both datasets did not further enhance the variable retrieval. Regarding LAI, the improvement of the model performances by using only FLORIS spectra (R2: 0.87; RMSE: 1.05 m2.m-2) rather than only OLCI spectra (R2: 0.86; RMSE: 1.12 m2.m-2) was less evident but merging both data sets was more beneficial (R2: 0.88; RMSE: 1.01 m2.m-2). Finally, the three data sources gave good model performances for the retrieval of fAPAR and Fcover, with the best performing model being the Synergy model (fAPAR: R2: 0.99; RMSE: 0.02 and FCover: R2: 0.98; RMSE: 0.04). The ability of the models to process real data was subsequently demonstrated by applying the OLCI models to S3 surface reflectance products acquired over Western Europe and Argentina. Obtained maps showed consistent patterns and variable ranges, and comparison against corresponding Sentinel-2 products (coarsened to a 300 m spatial resolution) led to reasonable matches (R2: 0.5-0.7). Altogether, given the availability of the multiple data sources, the FLEX tandem mission will foster unique opportunities to quantify essential vegetation properties, and hence facilitate the interpretation of the measured fluorescence levels.

Quantifying the Robustness of Vegetation Indices through Global Sensitivity Analysis of Homogeneous and Forest Leaf-Canopy Radiative Transfer Models.

Vegetation indices (VIs) are widely used in optical remote sensing to estimate biophysical variables of vegetated surfaces. With the advent of spectroscopy technology, spectral bands can be combined in numerous ways to extract the desired information. This resulted in a plethora of proposed indices, designed for a diversity of applications and research purposes. However, it is not always clear whether they are sensitive to the variable of interest while at the same time, responding insensitive to confounding factors. Hence, to be able to quantify the robustness of VIs, a systematic evaluation is needed, thereby introducing a widest possible variety of biochemical and structural heterogeneity. Such exercise can be achieved with coupled leaf and canopy radiative transfer models (RTMs), whereby input variables can virtually simulate any vegetation scenario. With the intention of evaluating multiple VIs in an efficient way, this led us to the development of a global sensitivity analysis (GSA) toolbox dedicated to the analysis of VIs on their sensitivity towards RTM input variables. We identified VIs that are designed to be sensitive towards leaf chlorophyll content (LCC), leaf water content (LWC) and leaf area index (LAI) for common sensors of terrestrial Earth observation satellites: Landsat 8, MODIS, Sentinel-2, Sentinel-3 and the upcoming imaging spectrometer mission EnMAP. The coupled RTMs PROSAIL and PROINFORM were used for simulations of homogeneous and forest canopies respectively. GSA total sensitivity results suggest that LCC-sensitive indices respond most robust: for the great majority of scenarios, chlorophyll a + b content (Cab) drives between 75% and 82% of the indices' variability. LWC-sensitive indices were most affected by confounding variables such as Cab and LAI, although the equivalent water thickness (Cw) can drive between 25% and 50% of the indices' variability. Conversely, the majority of LAI-sensitive indices are not only sensitive to LAI but rather to a mixture of structural and biochemical variables.

Global Sensitivity Analysis of Leaf-Canopy-Atmosphere RTMs: Implications for Biophysical Variables Retrieval from Top-of-Atmosphere Radiance Data.

Knowledge of key variables driving the top of the atmosphere (TOA) radiance over a vegetated surface is an important step to derive biophysical variables from TOA radiance data, e.g., as observed by an optical satellite. Coupled leaf-canopy-atmosphere Radiative Transfer Models (RTMs) allow linking vegetation variables directly to the at-sensor TOA radiance measured. Global Sensitivity Analysis (GSA) of RTMs enables the computation of the total contribution of each input variable to the output variance. We determined the impacts of the leaf-canopy-atmosphere variables into TOA radiance using the GSA to gain insights into retrievable variables. The leaf and canopy RTM PROSAIL was coupled with the atmospheric RTM MODTRAN5. Because of MODTRAN's computational burden and GSA's demand for many simulations, we first developed a surrogate statistical learning model, i.e., an emulator, that allows approximating RTM outputs through a machine learning algorithm with low computation time. A Gaussian process regression (GPR) emulator was used to reproduce lookup tables of TOA radiance as a function of 12 input variables with relative errors of 2.4%. GSA total sensitivity results quantified the driving variables of emulated TOA radiance along the 400-2500 nm spectral range at 15 cm-1 (between 0.3-9 nm); overall, the vegetation variables play a more dominant role than atmospheric variables. This suggests the possibility to retrieve biophysical variables directly from at-sensor TOA radiance data. Particularly promising are leaf chlorophyll content, leaf water thickness and leaf area index, as these variables are the most important drivers in governing TOA radiance outside the water absorption regions. A software framework was developed to facilitate the development of retrieval models from at-sensor TOA radiance data. As a proof of concept, maps of these biophysical variables have been generated for both TOA (L1C) and bottom-of-atmosphere (L2A) Sentinel-2 data by means of a hybrid retrieval scheme, i.e., training GPR retrieval algorithms using the RTM simulations. Obtained maps from L1C vs L2A data are consistent, suggesting that vegetation properties can be directly retrieved from TOA radiance data given a cloud-free sky, thus without the need of an atmospheric correction.

Approximating Empirical Surface Reflectance Data through Emulation: Opportunities for Synthetic Scene Generation.

Collection of spectroradiometric measurements with associated biophysical variables is an essential part of the development and validation of optical remote sensing vegetation products. However, their quality can only be assessed in the subsequent analysis, and often there is a need for collecting extra data, e.g., to fill in gaps. To generate empirical-like surface reflectance data of vegetated surfaces, we propose to exploit emulation, i.e., reconstruction of spectral measurements through statistical learning. We evaluated emulation against classical interpolation methods using an empirical field dataset with associated hyperspectral spaceborne CHRIS and airborne HyMap reflectance spectra, to produce synthetic CHRIS and HyMap reflectance spectra for any combination of input biophysical variables. Results indicate that: (1) emulation produces surface reflectance data more accurately than interpolation when validating against a separate part of the field dataset; and (2) emulation produces the spectra multiple times (tens to hundreds) faster than interpolation. This technique opens various data processing opportunities, e.g., emulators not only allow rapidly producing large synthetic spectral datasets, but they can also speed up computationally intensive processing routines such as synthetic scene generation. To demonstrate this, emulators were run to simulate hyperspectral imagery based on input maps of a few biophysical variables coming from CHRIS, HyMap and Sentinel-2 (S2). The emulators produced spaceborne CHRIS-like and airborne HyMap-like surface reflectance imagery in the order of seconds, thereby approximating the spectra of vegetated surfaces sufficiently similar to the reference images. Similarly, it took a few minutes to produce a hyperspectral data cube with a spatial texture of S2 and a spectral resolution of HyMap.