Winter wheat ear counting based on improved YOLOv7x and Kalman filter tracking algorithm with video streaming.

Accurate and real-time field wheat ear counting is of great significance for wheat yield prediction, genetic breeding and optimized planting management. In order to realize wheat ear detection and counting under the large-resolution Unmanned Aerial Vehicle (UAV) video, Space to depth (SPD) module was added to the deep learning model YOLOv7x. The Normalized Gaussian Wasserstein Distance (NWD) Loss function is designed to create a new detection model YOLOv7xSPD. The precision, recall, F1 score and AP of the model on the test set are 95.85%, 94.71%, 95.28%, and 94.99%, respectively. The AP value is 1.67% higher than that of YOLOv7x, and 10.41%, 39.32%, 2.96%, and 0.22% higher than that of Faster RCNN, SSD, YOLOv5s, and YOLOv7. YOLOv7xSPD is combined with the Kalman filter tracking and the Hungarian matching algorithm to establish a wheat ear counting model with the video flow, called YOLOv7xSPD Counter, which can realize real-time counting of wheat ears in the field. In the video with a resolution of 3840×2160, the detection frame rate of YOLOv7xSPD Counter is about 5.5FPS. The counting results are highly correlated with the ground truth number (R2 = 0.99), and can provide model basis for wheat yield prediction, genetic breeding and optimized planting management.

The Importance of Using Realistic 3D Canopy Models to Calculate Light Interception in the Field.

Quantifying canopy light interception provides insight into the effects of plant spacing, canopy structure, and leaf orientation on radiation distribution. This is essential for increasing crop yield and improving product quality. Canopy light interception can be quantified using 3-dimensional (3D) plant models and optical simulations. However, virtual 3D canopy models (VCMs) have often been used to quantify canopy light interception because realistic 3D canopy models (RCMs) are difficult to obtain in the field. This study aims to compare the differences in light interception between VCMs and RCM. A realistic 3D maize canopy model (RCM) was reconstructed over a large area of the field using an advanced unmanned aerial vehicle cross-circling oblique (CCO) route and the structure from motion-multi-view stereo method. Three types of VCMs (VCM-1, VCM-4, and VCM-8) were then created by replicating 1, 4, and 8 individual realistic plants constructed by CCO in the center of the corresponding RCM. The daily light interception per unit area (DLI), as computed for the 3 VCMs, exhibited marked deviation from the RCM, as evinced by the relative root mean square error (rRMSE) values of 20.22%, 17.38%, and 15.48%, respectively. Although this difference decreased as the number of plants used to replicate the virtual canopy increased, rRMSE of DLI for VCM-8 and RCM still reached 15.48%. It was also found that the difference in light interception between RCMs and VCMs was substantially smaller in the early stage (48 days after sowing [DAS]) than in the late stage (70 DAS). This study highlights the importance of using RCM when calculating light interception in the field, especially in the later growth stages of plants.

Fine mapping of reduced height locus RHT26 in common wheat.

KEY MESSAGE: We fine mapped RHT26 for plant height in wheat, confirmed its genetic effects in a panel of wheat cultivars and predicted candidate genes. Development of wheat cultivars with appropriate plant height (PH) is an important goal in breeding. Utilization of semi-dwarfing genes Rht-B1b and Rht-D1b triggered wheat Green Resolution in the 1960s. Since these genes also bring unfavorable features, such as reduced coleoptile length and grain weight, it is necessary to identify alternative reduced height genes without yield penalty. Here we constructed a high-density genetic map of a recombinant inbred line population derived from the cross of Zhongmai175 and Lunxuan987 and detected a stable genetic locus for PH, designated RHT26, on chromosome arm 3DL in all of six environments, accounting for 6.8-14.0% of the phenotypic variances. RHT26 was delimited to an approximate 1.4 Mb physical interval (517.1-518.5 Mb) using secondary mapping populations derived from 22 heterozygous recombinant plants and 24 kompetitive allele-specific PCR markers. Eleven high-confidence genes were annotated in the physical interval according to the Chinese Spring reference genome, and four of them were predicted as candidates for RHT26 based on genome and transcriptome sequencing analyses. We also confirmed that RHT26 had significant effects on PH, but not grain yield in a panel of wheat cultivars; its dwarfing allele has been frequently used in wheat breeding. These findings lay a sound foundation for map-based cloning of RHT26 and provide a breeding-applicable tool for marker-assisted selection.

UAV-based multi-sensor data fusion and machine learning algorithm for yield prediction in wheat.

Early prediction of grain yield helps scientists to make better breeding decisions for wheat. Use of machine learning (ML) methods for fusion of unmanned aerial vehicle (UAV)-based multi-sensor data can improve the prediction accuracy of crop yield. For this, five ML algorithms including Cubist, support vector machine (SVM), deep neural network (DNN), ridge regression (RR) and random forest (RF) were used for multi-sensor data fusion and ensemble learning for grain yield prediction in wheat. A set of thirty wheat cultivars and breeding lines were grown under three irrigation treatments i.e., light, moderate and high irrigation treatments to evaluate the yield prediction capabilities of a low-cost multi-sensor (RGB, multi-spectral and thermal infrared) UAV platform. Multi-sensor data fusion-based yield prediction showed higher accuracy compared to individual-sensor data in each ML model. The coefficient of determination (R 2) values for Cubist, SVM, DNN and RR models regarding grain yield prediction were observed from 0.527 to 0.670. Moreover, the results of ensemble learning through integrating the above models illustrated further increase in accuracy. The predictions of ensemble learning showed high R 2 values up to 0.692, which was higher as compared to individual ML models across the multi-sensor data. Root mean square error (RMSE), residual prediction deviation (RPD) and ratio of prediction performance to inter-quartile range (RPIQ) were calculated to be 0.916 t ha-1, 1.771 and 2.602, respectively. The results proved that low altitude UAV-based multi-sensor data can be used for early grain yield prediction using data fusion and an ensemble learning framework with high accuracy. This high-throughput phenotyping approach is valuable for improving the efficiency of selection in large breeding activities. Supplementary Information: The online version contains supplementary material available at 10.1007/s11119-022-09938-8.

Combining novel feature selection strategy and hyperspectral vegetation indices to predict crop yield.

BACKGROUND: Wheat is an important food crop globally, and timely prediction of wheat yield in breeding efforts can improve selection efficiency. Traditional yield prediction method based on secondary traits is time-consuming, costly, and destructive. It is urgent to develop innovative methods to improve selection efficiency and accelerate genetic gains in the breeding cycle. RESULTS: Crop yield prediction using remote sensing has gained popularity in recent years. This paper proposed a novel ensemble feature selection (EFS) method to improve yield prediction from hyperspectral data. For this, 207 wheat cultivars and breeding lines were grown under full and limited irrigation treatments respectively, and their canopy hyperspectral reflectance was measured at the flowering, early grain filling (EGF), mid grain filling (MGF), and late grain filling (LGF) stages. Then, 115 vegetation indices were extracted from the hyperspectral reflectance and combined with four feature selection methods, i.e., mean decrease impurity (MDI), Boruta, FeaLect, and RReliefF to train deep neural network (DNN) models for yield prediction. Next, a learning framework was developed by combining the predicted values of the selected and the full features using multiple linear regression (MLR). The results show that the selected features contributed to higher yield prediction accuracy than the full features, and the MDI method performed well across growth stages, with a mean R2 ranging from 0.634 to 0.666 (mean RMSE = 0.926-0.967 t ha-1). Also, the proposed EFS method outperformed all the individual feature selection methods across growth stages, with a mean R2 ranging from 0.648 to 0.679 (mean RMSE = 0.911-0.950 t ha-1). CONCLUSIONS: The proposed EFS method can improve grain yield prediction from hyperspectral data and can be used to assist wheat breeders in earlier decision-making.

Application of UAV Multisensor Data and Ensemble Approach for High-Throughput Estimation of Maize Phenotyping Traits.

High-throughput estimation of phenotypic traits from UAV (unmanned aerial vehicle) images is helpful to improve the screening efficiency of breeding maize. Accurately estimating phenotyping traits of breeding maize at plot scale helps to promote gene mining for specific traits and provides a guarantee for accelerating the breeding of superior varieties. Constructing an efficient and accurate estimation model is the key to the application of UAV-based multiple sensors data. This study aims to apply the ensemble learning model to improve the feasibility and accuracy of estimating maize phenotypic traits using UAV-based red-green-blue (RGB) and multispectral sensors. The UAV images of four growth stages were obtained, respectively. The reflectance of visible light bands, canopy coverage, plant height (PH), and texture information were extracted from RGB images, and the vegetation indices were calculated from multispectral images. We compared and analyzed the estimation accuracy of single-type feature and multiple features for LAI (leaf area index), fresh weight (FW), and dry weight (DW) of maize. The basic models included ridge regression (RR), support vector machine (SVM), random forest (RF), Gaussian process (GP), and K-neighbor network (K-NN). The ensemble learning models included stacking and Bayesian model averaging (BMA). The results showed that the ensemble learning model improved the accuracy and stability of maize phenotypic traits estimation. Among the features extracted from UAV RGB images, the highest accuracy was obtained by the combination of spectrum, structure, and texture features. The model had the best accuracy constructed using all features of two sensors. The estimation accuracies of ensemble learning models, including stacking and BMA, were higher than those of the basic models. The coefficient of determination (R 2) of the optimal validation results were 0.852, 0.888, and 0.929 for LAI, FW, and DW, respectively. Therefore, the combination of UAV-based multisource data and ensemble learning model could accurately estimate phenotyping traits of breeding maize at plot scale.

Fine mapping and characterization of a major QTL for grain weight on wheat chromosome arm 5DL.

KEY MESSAGE: We fine mapped QTL QTKW.caas-5DL for thousand kernel weight in wheat, predicted candidate genes and developed a breeding-applicable marker. Thousand kernel weight (TKW) is an important yield component trait in wheat, and identification of the underlying genetic loci is helpful for yield improvement. We previously identified a stable quantitative trait locus (QTL) QTKW.caas-5DL for TKW in a Doumai/Shi4185 recombinant inbred line (RIL) population. Here we performed fine mapping of QTKW.caas-5DL using secondary populations derived from 15 heterozygous recombinants and delimited the QTL to an approximate 3.9 Mb physical interval from 409.9 to 413.8 Mb according to the Chinese Spring (CS) reference genome. Analysis of genomic synteny showed that annotated genes in the physical interval had high collinearity among CS and eight other wheat genomes. Seven genes with sequence variation and/or differential expression between parents were predicted as candidates for QTKW.caas-5DL based on whole-genome resequencing and transcriptome assays. A kompetitive allele-specific PCR (KASP) marker for QTKW.caas-5DL was developed, and genotyping confirmed a significant association with TKW but not with other yield component traits in a panel of elite wheat cultivars. The superior allele of QTKW.caas-5DL was frequent in a panel of cultivars, suggesting that it had undergone positive selection. These findings not only lay a foundation for map-based cloning of QTKW.caas-5DL but also provide an efficient tool for marker-assisted selection.

Wheat Ear Recognition Based on RetinaNet and Transfer Learning.

The number of wheat ears is an essential indicator for wheat production and yield estimation, but accurately obtaining wheat ears requires expensive manual cost and labor time. Meanwhile, the characteristics of wheat ears provide less information, and the color is consistent with the background, which can be challenging to obtain the number of wheat ears required. In this paper, the performance of Faster regions with convolutional neural networks (Faster R-CNN) and RetinaNet to predict the number of wheat ears for wheat at different growth stages under different conditions is investigated. The results show that using the Global WHEAT dataset for recognition, the RetinaNet method, and the Faster R-CNN method achieve an average accuracy of 0.82 and 0.72, with the RetinaNet method obtaining the highest recognition accuracy. Secondly, using the collected image data for recognition, the R2 of RetinaNet and Faster R-CNN after transfer learning is 0.9722 and 0.8702, respectively, indicating that the recognition accuracy of the RetinaNet method is higher on different data sets. We also tested wheat ears at both the filling and maturity stages; our proposed method has proven to be very robust (the R2 is above 90). This study provides technical support and a reference for automatic wheat ear recognition and yield estimation.

Entropy Weight Ensemble Framework for Yield Prediction of Winter Wheat Under Different Water Stress Treatments Using Unmanned Aerial Vehicle-Based Multispectral and Thermal Data.

Crop breeding programs generally perform early field assessments of candidate selection based on primary traits such as grain yield (GY). The traditional methods of yield assessment are costly, inefficient, and considered a bottleneck in modern precision agriculture. Recent advances in an unmanned aerial vehicle (UAV) and development of sensors have opened a new avenue for data acquisition cost-effectively and rapidly. We evaluated UAV-based multispectral and thermal images for in-season GY prediction using 30 winter wheat genotypes under 3 water treatments. For this, multispectral vegetation indices (VIs) and normalized relative canopy temperature (NRCT) were calculated and selected by the gray relational analysis (GRA) at each growth stage, i.e., jointing, booting, heading, flowering, grain filling, and maturity to reduce the data dimension. The elastic net regression (ENR) was developed by using selected features as input variables for yield prediction, whereas the entropy weight fusion (EWF) method was used to combine the predicted GY values from multiple growth stages. In our results, the fusion of dual-sensor data showed high yield prediction accuracy [coefficient of determination (R 2) = 0.527-0.667] compared to using a single multispectral sensor (R 2 = 0.130-0.461). Results showed that the grain filling stage was the optimal stage to predict GY with R 2 = 0.667, root mean square error (RMSE) = 0.881 t ha-1, relative root-mean-square error (RRMSE) = 15.2%, and mean absolute error (MAE) = 0.721 t ha-1. The EWF model outperformed at all the individual growth stages with R 2 varying from 0.677 to 0.729. The best prediction result (R 2 = 0.729, RMSE = 0.831 t ha-1, RRMSE = 14.3%, and MAE = 0.684 t ha-1) was achieved through combining the predicted values of all growth stages. This study suggests that the fusion of UAV-based multispectral and thermal IR data within an ENR-EWF framework can provide a precise and robust prediction of wheat yield.