LeTra: a leaf tracking workflow based on convolutional neural networks and intersection over union.

BACKGROUND: The study of plant photosynthesis is essential for productivity and yield. Thanks to the development of high-throughput phenotyping (HTP) facilities, based on chlorophyll fluorescence imaging, photosynthetic traits can be measured in a reliable, reproducible and efficient manner. In most state-of-the-art HTP platforms, these traits are automatedly analyzed at individual plant level, but information at leaf level is often restricted by the use of manual annotation. Automated leaf tracking over time is therefore highly desired. Methods for tracking individual leaves are still uncommon, convoluted, or require large datasets. Hence, applications and libraries with different techniques are required. New phenotyping platforms are initiated now more frequently than ever; however, the application of advanced computer vision techniques, such as convolutional neural networks, is still growing at a slow pace. Here, we provide a method for leaf segmentation and tracking through the fine-tuning of Mask R-CNN and intersection over union as a solution for leaf tracking on top-down images of plants. We also provide datasets and code for training and testing on both detection and tracking of individual leaves, aiming to stimulate the community to expand the current methodologies on this topic. RESULTS: We tested the results for detection and segmentation on 523 Arabidopsis thaliana leaves at three different stages of development from which we obtained a mean F-score of 0.956 on detection and 0.844 on segmentation overlap through the intersection over union (IoU). On the tracking side, we tested nine different plants with 191 leaves. A total of 161 leaves were tracked without issues, accounting to a total of 84.29% correct tracking, and a Higher Order Tracking Accuracy (HOTA) of 0.846. In our case study, leaf age and leaf order influenced photosynthetic capacity and photosynthetic response to light treatments. Leaf-dependent photosynthesis varies according to the genetic background. CONCLUSION: The method provided is robust for leaf tracking on top-down images. Although one of the strong components of the method is the low requirement in training data to achieve a good base result (based on fine-tuning), most of the tracking issues found could be solved by expanding the training dataset for the Mask R-CNN model.

Interpreting the variation in particle size of ground spice by high-resolution visual and spectral imaging: A ginger case study.

High-resolution (HR) visual imaging and spectral imaging are common computer vision-based techniques used for food quality analysis and/or authentication based on the interaction of light and material surface and/or composition. The particle size of ground spices is an important morphological feature that affects the physico-chemical properties of food products containing such particles. This study aimed to interpret the impact of particle size of ground spice on its HR visual profile and spectral imaging profile using ginger powder as a representative spice powder model. The results revealed an increase in the light reflection with the decrease of particle size of ginger powder, which was manifested by the lighter colour (higher percentage of the colour code with lighter yellow colour) of the HR visual image and stronger reflection with spectral imaging. The study also revealed that, in spectral imaging, the influence of the particle size of ginger powder increased with rising wavelengths. Finally, the results indicated a relationship between spectral wavelengths, ginger particle size, and other natural variables of the products which might be generated from cultivation to processing. Ultimately, the impact of natural variables arising during the food production process on the physico-chemical properties of the product should be fully considered or even additionally evaluated prior to the application of specific food quality and/or authentication analytical techniques.

Insect exuviae as soil amendment affect flower reflectance and increase flower production and plant volatile emission.

Soil composition and herbivory are two environmental factors that can affect plant traits including flower traits, thus potentially affecting plant-pollinator interactions. Importantly, soil composition and herbivory may interact in these effects, with consequences for plant fitness. We assessed the main effects of aboveground insect herbivory and soil amendment with exuviae of three different insect species on visual and olfactory traits of Brassica nigra plants, including interactive effects. We combined various methodological approaches including gas chromatography/mass spectrometry, spectroscopy and machine learning to evaluate changes in flower morphology, colour and the emission of volatile organic compounds (VOCs). Soil amended with insect exuviae increased the total number of flowers per plant and VOC emission, whereas herbivory reduced petal area and VOC emission. Soil amendment and herbivory interacted in their effect on the floral reflectance spectrum of the base part of petals and the emission of 10 VOCs. These findings demonstrate the effects of insect exuviae as soil amendment on plant traits involved in reproduction, with a potential for enhanced reproductive success by increasing the strength of signals attracting pollinators and by mitigating the negative effects of herbivory.

High-Resolution Analysis of Growth and Transpiration of Quinoa Under Saline Conditions.

The Plantarray 3.0 phenotyping platform® was used to monitor the growth and water use of the quinoa varieties Pasto and selRiobamba under salinity (0-300 mM NaCl). Salinity reduced the cumulative transpiration of both varieties by 60% at 200 mM NaCl and by 75 and 82% at 300 mM NaCl for selRiobamba and Pasto, respectively. Stomatal conductance was reduced by salinity, but at 200 mM NaCl Pasto showed a lower reduction (15%) than selRiobamba (35%), along with decreased specific leaf area. Diurnal changes in water use parameters indicate that under salt stress, daily transpiration in quinoa is less responsive to changes in light irradiance, and stomatal conductance is modulated to maximize CO2 uptake and minimize water loss following the changes in VPD (vapor pressure deficit). These changes might contribute to the enhanced water use efficiency of both varieties under salt stress. The mechanistic crop model LINTUL was used to integrate physiological responses into the radiation use efficiency of the plants (RUE), which was more reduced in Pasto than selRiobamba under salinity. By the end of the experiment (eleven weeks after sowing, six weeks after stress), the growth of Pasto was significantly lower than selRiobamba, fresh biomass was 50 and 35% reduced at 200 mM and 70 and 50% reduced at 300 mM NaCl for Pasto and selRiobamba, respectively. We argue that contrasting water management strategies can at least partly explain the differences in salt tolerance between Pasto and selRiobamba. Pasto adopted a "conservative-growth" strategy, saving water at the expense of growth, while selRiobamba used an "acquisitive-growth" strategy, maximizing growth in spite of the stress. The implementation of high-resolution phenotyping could help to dissect these complex growth traits that might be novel breeding targets for abiotic stress tolerance.

Hyperspectral imaging system based on a single-pixel camera design for detecting differences in tissue properties.

Optical spectroscopy can be used to distinguish between healthy and diseased tissue. In this study, the design and testing of a single-pixel hyperspectral imaging (HSI) system that uses autofluorescence emission from collagen (400 nm) and nicotinamide adenine dinucleotide phosphate (475 nm) along with differences in the optical reflectance spectra to differentiate between healthy and thermally damaged tissue is discussed. The changes in protein autofluorescence and reflectance due to thermal damage are studied in ex vivo porcine tissue models. Thermal lesions were created in porcine skin (n=12) and liver (n=15) samples using an IR laser. The damaged regions were clearly visible in the hyperspectral images. Sizes of the thermally damaged regions as measured via HSI are compared to sizes of these regions as measured in white-light images and via physical measurement. Good agreement between the sizes measured in the hyperspectral images, white-light imaging, and physical measurements were found. The HSI system can differentiate between healthy and damaged tissue. Possible applications of this imaging system include determination of tumor margins during surgery/biopsy and cancer diagnosis and staging.