Orchard monitoring based on unmanned aerial vehicles and image processing by artificial neural networks: a systematic review.

Orchard monitoring is a vital direction of scientific research and practical application for increasing fruit production in ecological conditions. Recently, due to the development of technology and the decrease in equipment cost, the use of unmanned aerial vehicles and artificial intelligence algorithms for image acquisition and processing has achieved tremendous progress in orchards monitoring. This paper highlights the new research trends in orchard monitoring, emphasizing neural networks, unmanned aerial vehicles (UAVs), and various concrete applications. For this purpose, papers on complex topics obtained by combining keywords from the field addressed were selected and analyzed. In particular, the review considered papers on the interval 2017-2022 on the use of neural networks (as an important exponent of artificial intelligence in image processing and understanding) and UAVs in orchard monitoring and production evaluation applications. Due to their complexity, the characteristics of UAV trajectories and flights in the orchard area were highlighted. The structure and implementations of the latest neural network systems used in such applications, the databases, the software, and the obtained performances are systematically analyzed. To recommend some suggestions for researchers and end users, the use of the new concepts and their implementations were surveyed in concrete applications, such as a) identification and segmentation of orchards, trees, and crowns; b) detection of tree diseases, harmful insects, and pests; c) evaluation of fruit production, and d) evaluation of development conditions. To show the necessity of this review, in the end, a comparison is made with review articles with a related theme.

New trends in detection of harmful insects and pests in modern agriculture using artificial neural networks. a review.

Modern and precision agriculture is constantly evolving, and the use of technology has become a critical factor in improving crop yields and protecting plants from harmful insects and pests. The use of neural networks is emerging as a new trend in modern agriculture that enables machines to learn and recognize patterns in data. In recent years, researchers and industry experts have been exploring the use of neural networks for detecting harmful insects and pests in crops, allowing farmers to act and mitigate damage. This paper provides an overview of new trends in modern agriculture for harmful insect and pest detection using neural networks. Using a systematic review, the benefits and challenges of this technology are highlighted, as well as various techniques being taken by researchers to improve its effectiveness. Specifically, the review focuses on the use of an ensemble of neural networks, pest databases, modern software, and innovative modified architectures for pest detection. The review is based on the analysis of multiple research papers published between 2015 and 2022, with the analysis of the new trends conducted between 2020 and 2022. The study concludes by emphasizing the significance of ongoing research and development of neural network-based pest detection systems to maintain sustainable and efficient agricultural production.

Detection of Malignant Skin Lesions Based on Decision Fusion of Ensembles of Neural Networks.

Today, skin cancer, and especially melanoma, is an increasing and dangerous health disease. The high mortality rate of some types of skin cancers needs to be detected in the early stages and treated urgently. The use of neural network ensembles for the detection of objects of interest in images has gained more and more interest due to the increased performance of the results. In this sense, this paper proposes two ensembles of neural networks, based on the fusion of the decisions of the component neural networks for the detection of four skin lesions (basal cancer cell, melanoma, benign keratosis, and melanocytic nevi). The first system is based on separate learning of three neural networks (MobileNet V2, DenseNet 169, and EfficientNet B2), with multiple weights for the four classes of lesions and weighted overall prediction. The second system is made up of six binary models (one for each pair of classes) for each network; the fusion and prediction are conducted by weighted summation per class and per model. In total, 18 such binary models will be considered. The 91.04% global accuracy of this set of binary models is superior to the first system (89.62%). Separately, only for the binary classifications within the system was the individual accuracy better. The individual F1 score for each class and the global system varied from 81.36% to 94.17%. Finally, a critical comparison is made with similar works from the literature.

Decision Support System for Liver Lesion Segmentation Based on Advanced Convolutional Neural Network Architectures.

Given its essential role in body functions, liver cancer is the third most common cause of death from cancer, despite being the sixth most common type of cancer worldwide. Following advancements in medicine and image processing, medical image segmentation methods are receiving a great deal of attention. As a novelty, the paper proposes an intelligent decision system for segmenting liver and hepatic tumors by integrating four efficient neural networks (ResNet152, ResNeXt101, DenseNet201, and InceptionV3). Images from computed tomography for training, validation, and testing were taken from the public LiTS17 database and preprocessed to better highlight liver tissue and tumors. Global segmentation is done by separately training individual classifiers and the global system of merging individual decisions. For the aforementioned application, classification neural networks have been modified for semantic segmentation. After segmentation based on the neural network system, the images were postprocessed to eliminate artifacts. The segmentation results obtained by the system were better, from the point of view of the Dice coefficient, than those obtained by the individual networks, and comparable with those reported in recent works.

Skin Lesion Classification Using Collective Intelligence of Multiple Neural Networks.

Skin lesion detection and analysis are very important because skin cancer must be found in its early stages and treated immediately. Once installed in the body, skin cancer can easily spread to other body parts. Early detection would represent a very important aspect since, by ensuring correct treatment, it could be curable. Thus, by taking all these issues into consideration, there is a need for highly accurate computer-aided systems to assist medical staff in the early detection of malignant skin lesions. In this paper, we propose a skin lesion classification system based on deep learning techniques and collective intelligence, which involves multiple convolutional neural networks, trained on the HAM10000 dataset, which is able to predict seven skin lesions including melanoma. The convolutional neural networks experimentally chosen, considering their performances, to implement the collective intelligence-based system for this purpose are: AlexNet, GoogLeNet, GoogLeNet-Places365, MobileNet-V2, Xception, ResNet-50, ResNet-101, InceptionResNet-V2 and DenseNet201. We then analyzed the performances of each of the above-mentioned convolutional neural networks to obtain a weight matrix whose elements are weights associated with neural networks and classes of lesions. Based on this matrix, a new decision matrix was used to build the multi-network ensemble system (Collective Intelligence-based System), combining each of individual neural network decision into a decision fusion module (Collective Decision Block). This module would then have the responsibility to take a final and more accurate decision related to the prediction based on the associated weights of each network output. The validation accuracy of the proposed system is about 3 percent better than that of the best performing individual network.

New Trends in Melanoma Detection Using Neural Networks: A Systematic Review.

Due to its increasing incidence, skin cancer, and especially melanoma, is a serious health disease today. The high mortality rate associated with melanoma makes it necessary to detect the early stages to be treated urgently and properly. This is the reason why many researchers in this domain wanted to obtain accurate computer-aided diagnosis systems to assist in the early detection and diagnosis of such diseases. The paper presents a systematic review of recent advances in an area of increased interest for cancer prediction, with a focus on a comparative perspective of melanoma detection using artificial intelligence, especially neural network-based systems. Such structures can be considered intelligent support systems for dermatologists. Theoretical and applied contributions were investigated in the new development trends of multiple neural network architecture, based on decision fusion. The most representative articles covering the area of melanoma detection based on neural networks, published in journals and impact conferences, were investigated between 2015 and 2021, focusing on the interval 2018-2021 as new trends. Additionally presented are the main databases and trends in their use in teaching neural networks to detect melanomas. Finally, a research agenda was highlighted to advance the field towards the new trends.

Deep Learning-Based Methods for Automatic Diagnosis of Skin Lesions.

The main purpose of the study was to develop a high accuracy system able to diagnose skin lesions using deep learning-based methods. We propose a new decision system based on multiple classifiers like neural networks and feature-based methods. Each classifier (method) gives the final decision system a certain weight, depending on the calculated accuracy, helping the system make a better decision. First, we created a neural network (NN) that can differentiate melanoma from benign nevus. The NN architecture is analyzed by evaluating it during the training process. Some biostatistic parameters, such as accuracy, specificity, sensitivity, and Dice coefficient are calculated. Then, we developed three other methods based on convolutional neural networks (CNNs). The CNNs were pre-trained using large ImageNet and Places365 databases. GoogleNet, ResNet-101, and NasNet-Large, were used in the enumeration order. CNN architectures were fine-tuned in order to distinguish the different types of skin lesions using transfer learning. The accuracies of the classifications were determined. The last proposed method uses the classical method of image object detection, more precisely, the one in which some features are extracted from the images, followed by the classification step. In this case, the classification was done by using a support vector machine. Just as in the first method, the sensitivity, specificity, Dice similarity coefficient and accuracy are determined. A comparison of the obtained results from all the methods is then done. As mentioned above, the novelty of this paper is the integration of these methods in a global fusion-based decision system that uses the results obtained by each individual method to establish the fusion weights. The results obtained by carrying out the experiments on two different free databases shows that the proposed system offers higher accuracy results.

Advanced UAV-WSN System for Intelligent Monitoring in Precision Agriculture.

The growing need for food worldwide requires the development of a high-performance, high-productivity, and sustainable agriculture, which implies the introduction of new technologies into monitoring activities related to control and decision-making. In this regard, this paper presents a hierarchical structure based on the collaboration between unmanned aerial vehicles (UAVs) and federated wireless sensor networks (WSNs) for crop monitoring in precision agriculture. The integration of UAVs with intelligent, ground WSNs, and IoT proved to be a robust and efficient solution for data collection, control, analysis, and decisions in such specialized applications. Key advantages lay in online data collection and relaying to a central monitoring point, while effectively managing network load and latency through optimized UAV trajectories and in situ data processing. Two important aspects of the collaboration were considered: designing the UAV trajectories for efficient data collection and implementing effective data processing algorithms (consensus and symbolic aggregate approximation) at the network level for the transmission of the relevant data. The experiments were carried out at a Romanian research institute where different crops and methods are developed. The results demonstrate that the collaborative UAV-WSN-IoT approach increases the performances in both precision agriculture and ecological agriculture.

A Survey of Collaborative UAV-WSN Systems for Efficient Monitoring.

Integrated systems based on wireless sensor networks (WSNs) and unmanned aerial vehicles (UAVs) with electric propulsion are emerging as state-of-the-art solutions for large scale monitoring. Main advances stemming both from complex system architectures as well as powerful embedded computing and communication platforms, advanced sensing and networking protocols have been leveraged to prove the viability of this concept. The design of suitable algorithms for data processing, communication and control across previously disparate domains has thus currently become an intensive area of interdisciplinary research. The paper was focused on the collaborative aspects of UAV-WSN systems and the reference papers were analyzed from this point of view, on each functional module. The paper offers a timely review of recent advances in this area of critical interest with focus on a comparative perspective across multiple recent theoretical and applied contributions. A systematic approach is carried out in order to structure a unitary from conceptual design towards key implementation aspects. Focus areas are identified and discussed such as distributed data processing algorithms, hierarchical multi-protocol networking aspects and high level WSN-constrained UAV-control. Application references are highlighted in various domains such as environmental, agriculture, emergency situations and homeland security. Finally, a research agenda is outlined to advance the field towards tangible economic and social impact.

A Collaborative UAV-WSN Network for Monitoring Large Areas.

Large-scale monitoring systems have seen rapid development in recent years. Wireless sensor networks (WSN), composed of thousands of sensing, computing and communication nodes, form the backbone of such systems. Integration with unmanned aerial vehicles (UAVs) leads to increased monitoring area and to better overall performance. This paper presents a hybrid UAV-WSN network which is self-configured to improve the acquisition of environmental data across large areas. A prime objective and novelty of the heterogeneous multi-agent scheme proposed here is the optimal generation of reference trajectories, parameterized after inter- and intra-line distances. The main contribution is the trajectory design, optimized to avoid interdicted regions, to pass near predefined way-points, with guaranteed communication time, and to minimize total path length. Mixed-integer description is employed into the associated constrained optimization problem. The second novelty is the sensor localization and clustering method for optimal ground coverage taking into account the communication information between UAV and a subset of ground sensors (i.e., the cluster heads). Results show improvements in both network and data collection efficiency metrics by implementing the proposed algorithms. These are initially evaluated by means of simulation and then validated on a realistic WSN-UAV test-bed, thus bringing significant practical value.

Unmanned Aerial Vehicle Systems for Remote Estimation of Flooded Areas Based on Complex Image Processing.

Floods are natural disasters which cause the most economic damage at the global level. Therefore, flood monitoring and damage estimation are very important for the population, authorities and insurance companies. The paper proposes an original solution, based on a hybrid network and complex image processing, to this problem. As first novelty, a multilevel system, with two components, terrestrial and aerial, was proposed and designed by the authors as support for image acquisition from a delimited region. The terrestrial component contains a Ground Control Station, as a coordinator at distance, which communicates via the internet with more Ground Data Terminals, as a fixed nodes network for data acquisition and communication. The aerial component contains mobile nodes-fixed wing type UAVs. In order to evaluate flood damage, two tasks must be accomplished by the network: area coverage and image processing. The second novelty of the paper consists of texture analysis in a deep neural network, taking into account new criteria for feature selection and patch classification. Color and spatial information extracted from chromatic co-occurrence matrix and mass fractal dimension were used as well. Finally, the experimental results in a real mission demonstrate the validity of the proposed methodologies and the performances of the algorithms.

Neurotrophin-3, TNF-alpha and IL-6 relations in serum and cerebrospinal fluid of ischemic stroke patients.

Pro-inflammatory cytokines and neurotrophins in the central nervous system (CNS) have been recognized as mediators of both neurodegenerative and neuroprotective mechanisms in a number of CNS pathologies. A rapid, sustained elevation of these molecules was recently reported after traumatic and ischemic brain injury. Inflammatory mechanisms and immune activation have been hypothesized to play a role in the pathogenesis of cerebral ischemia. Stroke is the third largest cause of death next to heart disease and cancer in the world, and it is an important cause of death and disability in developed countries. Role of excitatory amino acids receptors activation, calcium overload, nitric oxide and oxidative stress in the pathogenesis of ischemic brain damage is well established. Stroke may modulate peripheral neurotrophic factors levels. In experimental animal models, neurotrophin-3 (NT-3) has been shown to be produced by glial cells as an adaptability response to hypoxia. In spite of substantial research and significant number of neuroprotective drugs that have been developed to limit ischemic brain damage and to improve the outcome for stroke patients, no specific therapy for stroke is available. The neurotrophins have been proposed as therapeutic agents for the treatment of neurodegenerative disorders and ischemic injury. In the present work, we investigated the possible correlation of NT-3 with tumor necrosis factor-alpha (TNF-alpha) and interleukin-6 (IL-6) in the serum and cerebrospinal fluid (CSF) from patients with ischemic stroke (IS).