Comparison of the Efficiency of Hyperspectral and Pulse Amplitude Modulation Imaging Methods in Pre-Symptomatic Virus Detection in Tobacco Plants.

Early detection of pathogens can significantly reduce yield losses and improve the quality of agricultural products. This study compares the efficiency of hyperspectral (HS) imaging and pulse amplitude modulation (PAM) fluorometry to detect pathogens in plants. Reflectance spectra, normalized indices, and fluorescence parameters were studied in healthy and infected areas of leaves. Potato virus X with GFP fluorescent protein was used to assess the spread of infection throughout the plant. The study found that infection increased the reflectance of leaves in certain wavelength ranges. Analysis of the normalized reflectance indices (NRIs) revealed indices that were sensitive and insensitive to infection. NRI700/850 was optimal for virus detection; significant differences were detected on the 4th day after the virus arrived in the leaf. Maximum (Fv/Fm) and effective quantum yields of photosystem II (ΦPSII) and non-photochemical fluorescence quenching (NPQ) were almost unchanged at the early stage of infection. ΦPSII and NPQ in the transition state (a short time after actinic light was switched on) showed high sensitivity to infection. The higher sensitivity of PAM compared to HS imaging may be due to the possibility of assessing the physiological changes earlier than changes in leaf structure.

Ensuring Explainability and Dimensionality Reduction in a Multidimensional HSI World for Early XAI-Diagnostics of Plant Stress.

This work is mostly devoted to the search for effective solutions to the problem of early diagnosis of plant stress (given an example of wheat and its drought stress), which would be based on explainable artificial intelligence (XAI). The main idea is to combine the benefits of two of the most popular agricultural data sources, hyperspectral images (HSI) and thermal infrared images (TIR), in a single XAI model. Our own dataset of a 25-day experiment was used, which was created via both (1) an HSI camera Specim IQ (400-1000 nm, 204, 512 × 512) and (2) a TIR camera Testo 885-2 (320 × 240, res. 0.1 °C). The HSI were a source of the k-dimensional high-level features of plants (k ≤ K, where K is the number of HSI channels) for the learning process. Such combination was implemented as a single-layer perceptron (SLP) regressor, which is the main feature of the XAI model and receives as input an HSI pixel-signature belonging to the plant mask, which then automatically through the mask receives a mark from the TIR. The correlation of HSI channels with the TIR image on the plant's mask on the days of the experiment was studied. It was established that HSI channel 143 (820 nm) was the most correlated with TIR. The problem of training the HSI signatures of plants with their corresponding temperature value via the XAI model was solved. The RMSE of plant temperature prediction is 0.2-0.3 °C, which is acceptable for early diagnostics. Each HSI pixel was represented in training by a number (k) of channels (k ≤ K = 204 in our case). The number of channels used for training was minimized by a factor of 25-30, from 204 to eight or seven, while maintaining the RMSE value. The model is computationally efficient in training; the average training time was much less than one minute (Intel Core i3-8130U, 2.2 GHz, 4 cores, 4 GB). This XAI model can be considered a research-aimed model (R-XAI), which allows the transfer of knowledge about plants from the TIR domain to the HSI domain, with their contrasting onto only a few from hundreds of HSI channels.

Entropy as a High-Level Feature for XAI-Based Early Plant Stress Detection.

This article is devoted to searching for high-level explainable features that can remain explainable for a wide class of objects or phenomena and become an integral part of explainable AI (XAI). The present study involved a 25-day experiment on early diagnosis of wheat stress using drought stress as an example. The state of the plants was periodically monitored via thermal infrared (TIR) and hyperspectral image (HSI) cameras. A single-layer perceptron (SLP)-based classifier was used as the main instrument in the XAI study. To provide explainability of the SLP input, the direct HSI was replaced by images of six popular vegetation indices and three HSI channels (R630, G550, and B480; referred to as indices), along with the TIR image. Furthermore, in the explainability analysis, each of the 10 images was replaced by its 6 statistical features: min, max, mean, std, max-min, and the entropy. For the SLP output explainability, seven output neurons corresponding to the key states of the plants were chosen. The inner layer of the SLP was constructed using 15 neurons, including 10 corresponding to the indices and 5 reserved neurons. The classification possibilities of all 60 features and 10 indices of the SLP classifier were studied. Study result: Entropy is the earliest high-level stress feature for all indices; entropy and an entropy-like feature (max-min) paired with one of the other statistical features can provide, for most indices, 100% accuracy (or near 100%), serving as an integral part of XAI.