Estimation of non-symmetric and unbounded region of attraction using shifted shape function and R-composition.

Sum-of-squares programming is widely used for region of attraction (ROA) estimations of asymptotically stable equilibrium points of nonlinear polynomial systems. However, existing methods yield conservative results, especially for non-symmetric and unbounded regions. In this study, a cost-effective approach for ROA estimation is proposed based on the Lyapunov theory and shape functions. In contrast to existing methods, the proposed method iteratively places the center of a shifted shape function (SSF) close to the boundary of the acquired invariant subset. The set of obtained SSFs yields robust ROA subsets, and R-composition is employed to express these independent sets as a single but richer-shaped level set. Several benchmark examples show that the proposed method significantly improves ROA estimations, especially for non-symmetric or unbounded ROA without a significant computational burden.

A Probabilistic-Geometric Approach for UAV Detection and Avoidance Systems.

This paper proposes a collision avoidance algorithm for the detection and avoidance capabilities of Unmanned Aerial Vehicles (UAVs). The proposed algorithm aims to ensure minimum separation between UAVs and geofencing with multiple no-fly zones, considering the sensor uncertainties. The main idea is to compute the collision probability and to initiate collision avoidance manoeuvres determined by the differential geometry concept. The proposed algorithm is validated by both theoretical and numerical analysis. The results indicate that the proposed algorithm ensures minimum separation, efficiency, and scalability compared with other benchmark algorithms.

Consensus Tracking of Nonlinear Agents Using Distributed Nonlinear Dynamic Inversion with Switching Leader-Follower Connection.

In this paper, a consensus tracking protocol for nonlinear agents is presented, which is based on the Nonlinear Dynamic Inversion (NDI) technique. Implementation of such a technique is new in the context of the consensus tracking problem. The tracking capability of nonlinear dynamic inversion (NDI) is exploited for a leader-follower multi-agent scenario. We have provided all the mathematical details to establish its theoretical foundation. Additionally, a convergence study is provided to show the efficiency of the proposed controller. The performance of the proposed controller is evaluated in the presence of both (a) random switching topology among the agents and (b) random switching of leader-follower connections, which is realistic and not reported in the literature. The follower agents track various trajectories generated by a dynamic leader, which describes the tracking capability of the proposed controller. The results obtained from the simulation study show how efficiently this controller can handle the switching topology and switching leader-follower connections.

Defects Recognition Algorithm Development from Visual UAV Inspections.

Aircraft maintenance plays a key role in the safety of air transport. One of its most significant procedures is the visual inspection of the aircraft skin for defects. This is mainly carried out manually and involves a high skilled human walking around the aircraft. It is very time consuming, costly, stressful and the outcome heavily depends on the skills of the inspector. In this paper, we propose a two-step process for automating the defect recognition and classification from visual images. The visual inspection can be carried out with the use of an unmanned aerial vehicle (UAV) carrying an image sensor to fully automate the procedure and eliminate any human error. With our proposed method in the first step, we perform the crucial part of recognizing the defect. If a defect is found, the image is fed to an ensemble of classifiers for identifying the type. The classifiers are a combination of different pretrained convolution neural network (CNN) models, which we retrained to fit our problem. For achieving our goal, we created our own dataset with defect images captured from aircrafts during inspection in TUI's maintenance hangar. The images were preprocessed and used to train different pretrained CNNs with the use of transfer learning. We performed an initial training of 40 different CNN architectures to choose the ones that best fitted our dataset. Then, we chose the best four for fine tuning and further testing. For the first step of defect recognition, the DenseNet201 CNN architecture performed better, with an overall accuracy of 81.82%. For the second step for the defect classification, an ensemble of different CNN models was used. The results show that even with a very small dataset, we can reach an accuracy of around 82% in the defect recognition and even 100% for the classification of the categories of missing or damaged exterior paint and primer and dents.

Bipartite Consensus of Nonlinear Agents in the Presence of Communication Noise.

In this paper, a Distributed Nonlinear Dynamic Inversion (DNDI)-based consensus protocol is designed to achieve the bipartite consensus of nonlinear agents over a signed graph. DNDI inherits the advantage of nonlinear dynamic inversion theory, and the application to the bipartite problem is a new idea. Moreover, communication noise is considered to make the scenario more realistic. The convergence study provides a solid theoretical base, and a realistic simulation study shows the effectiveness of the proposed protocol.

Neuro-adaptive augmented distributed nonlinear dynamic inversion for consensus of nonlinear agents with unknown external disturbance.

This paper presents a novel neuro-adaptive augmented distributed nonlinear dynamic inversion (N-DNDI) controller for consensus of nonlinear multi-agent systems in the presence of unknown external disturbance. N-DNDI is a blending of neural network and distributed nonlinear dynamic inversion (DNDI), a new consensus control technique that inherits the features of Nonlinear Dynamic Inversion (NDI) and is capable of handling the unknown external disturbance. The implementation of NDI based consensus control along with neural networks is unique in the context of multi-agent consensus. The mathematical details provided in this paper show the solid theoretical base, and simulation results prove the effectiveness of the proposed scheme.

Design and Implementation of Deep Neural Network-Based Control for Automatic Parking Maneuver Process.

This article focuses on the design, test, and validation of a deep neural network (DNN)-based control scheme capable of predicting optimal motion commands for autonomous ground vehicles (AGVs) during the parking maneuver process. The proposed design utilizes a multilayer structure. In the first layer, a desensitized trajectory optimization method is iteratively performed to establish a set of time-optimal parking trajectories with the consideration of noise-perturbed initial configurations. Subsequently, by using the preplanned optimal parking trajectory data set, several DNNs are trained in order to learn the functional relationship between the system state-control actions in the second layer. To obtain further improvements regarding the DNN performances, a simple yet effective data aggregation approach is designed and applied. These trained DNNs are then utilized as the motion controllers to generate feedback actions in real time. Numerical results were executed to demonstrate the effectiveness and the real-time applicability of using the proposed control scheme to plan and steer the AGV parking maneuver. Experimental results were also provided to justify the algorithm performance in real-world implementations.

Relation3DMOT: Exploiting Deep Affinity for 3D Multi-Object Tracking from View Aggregation.

Autonomous systems need to localize and track surrounding objects in 3D space for safe motion planning. As a result, 3D multi-object tracking (MOT) plays a vital role in autonomous navigation. Most MOT methods use a tracking-by-detection pipeline, which includes both the object detection and data association tasks. However, many approaches detect objects in 2D RGB sequences for tracking, which lacks reliability when localizing objects in 3D space. Furthermore, it is still challenging to learn discriminative features for temporally consistent detection in different frames, and the affinity matrix is typically learned from independent object features without considering the feature interaction between detected objects in the different frames. To settle these problems, we first employ a joint feature extractor to fuse the appearance feature and the motion feature captured from 2D RGB images and 3D point clouds, and then we propose a novel convolutional operation, named RelationConv, to better exploit the correlation between each pair of objects in the adjacent frames and learn a deep affinity matrix for further data association. We finally provide extensive evaluation to reveal that our proposed model achieves state-of-the-art performance on the KITTI tracking benchmark.

Efficient Allocation for Downlink Multi-Channel NOMA Systems Considering Complex Constraints.

To enable an efficient dynamic power and channel allocation (DPCA) for users in the downlink multi-channel non-orthogonal multiple access (MC-NOMA) systems, this paper regards the optimization as the combinatorial problem, and proposes three heuristic solutions, i.e., stochastic algorithm, two-stage greedy randomized adaptive search (GRASP), and two-stage stochastic sample greedy (SSD). Additionally, multiple complicated constraints are taken into consideration according to practical scenarios, for instance, the capacity for per sub-channel, power budget for per sub-channel, power budget for users, minimum data rate, and the priority control during the allocation. The effectiveness of the algorithms is compared by demonstration, and the algorithm performance is compared by simulations. Stochastic solution is useful for the overwhelmed sub-channel resources, i.e., spectrum dense environment with less data rate requirement. With small sub-channel number, i.e., spectrum scarce environment, both GRASP and SSD outperform the stochastic algorithm in terms of bigger data rate (achieve more than six times higher data rate) while having a shorter running time. SSD shows benefits with more channels compared with GRASP due to the low computational complexity (saves 66% running time compared with GRASP while maintaining similar data rate outcomes). With a small sub-channel number, GRASP shows a better performance in terms of the average data rate, variance, and time consumption than SSG.

Two-Dimensional Quantum Genetic Algorithm: Application to Task Allocation Problem.

This paper presents a Two-Dimensional Quantum Genetic Algorithm (2D-QGA), which is a new variety of QGA. This variety will allow the user to take the advantages of quantum computation while solving the problems which are suitable for two-dimensional (2D) representation or can be represented in tabular form. The performance of 2D-QGA is compared to two-dimensional GA (2D-GA), which is used to solve two-dimensional problems as well. The comparison study is performed by applying both the algorithm to the task allocation problem. The performance of 2D-QGA is better than 2D-GA while comparing execution time, convergence iteration, minimum cost generated, and population size.

Modeling and Performance Analysis of Opportunistic Link Selection For UAV Communication.

In anticipation of wide implementation of 5G technologies, the scarcity of spectrum resources for the unmanned aerial vehicles (UAVs) communication remains one of the major challenges in arranging safe drone operations. Dynamic spectrum management among multiple UAVs as a tool that is able to address this issue, requires integrated solutions with considerations of heterogeneous link types and support of the multi-UAV operations. This paper proposes a synthesized resource allocation and opportunistic link selection (RA-OLS) scheme for the air-to-ground (A2G) UAV communication with dynamic link selections. The link opportunities using link hopping sequences (LHSs) are allocated in the GCSs for alleviating the internal collisions within the UAV network, offloading the on-board computations in the spectrum processing function, and avoiding the contention in the air. In this context, exclusive technical solutions are proposed to form the prototype system. A sub-optimal allocation method based on the greedy algorithm is presented for addressing the resource allocation problem. A mathematical model of the RA-OLS throughput with above propositions is formulated for the spectrum dense and scarce environments. An interference factor is introduced to measure the protection effects on the primary users. The proposed throughput model approximates the simulated communication under requirements of small errors in the spectrum dense environment and the spectrum scarce environment, where the sensitivity analysis is implemented. The proposed RA-OLS outperforms the static communication scheme in terms of the utilization rate by over 50 % in case when multiple links are available. It also enables the collaborative communication when the spectral resources are in scarcity. The impacts from diverse parameters on the RA-OLS communication performance are analyzed.

Multiobjective Overtaking Maneuver Planning for Autonomous Ground Vehicles.

Constrained autonomous vehicle overtaking trajectories are usually difficult to generate due to certain practical requirements and complex environmental limitations. This problem becomes more challenging when multiple contradicting objectives are required to be optimized and the on-road objects to be overtaken are irregularly placed. In this article, a novel swarm intelligence-based algorithm is proposed for producing the multiobjective optimal overtaking trajectory of autonomous ground vehicles. The proposed method solves a multiobjective optimal control model in order to optimize the maneuver time duration, the trajectory smoothness, and the vehicle visibility, while taking into account different types of mission-dependent constraints. However, one problem that could have an impact on the optimization process is the selection of algorithm control parameters. To desensitize the negative influence, a novel fuzzy adaptive strategy is proposed and embedded in the algorithm framework. This allows the optimization process to dynamically balance the local exploitation and global exploration, thereby exploring the tradeoff between objectives more effectively. The performance of using the designed fuzzy adaptive multiobjective method is analyzed and validated by executing a number of simulation studies. The results confirm the effectiveness of applying the proposed algorithm to produce multiobjective optimal overtaking trajectories for autonomous ground vehicles. Moreover, the comparison to other state-of-the-art multiobjective optimization schemes shows that the designed strategy tends to be more capable in terms of producing a set of widespread and high-quality Pareto-optimal solutions.

Group Design Project in Control Engineering: Adapting to COVID-19 Pandemic.

Group Design Project (GDP) is a common education strategy in engineering. However, due to the COVID-19 pandemic, GDP cannot be fulfilled in a typical lab condition. The paper describes an example of delivering intensive hands-on, group project-based engineering course Autonomous Vehicle Dynamics and Control at Cranfield University. The project was designed to be implemented using modern simulation tools. As a result, students have not only obtained a better understanding of the engineering areas but also learned the usage of essential engineering and IT tools. The students obtained skillsets useful in modern engineering applications, where a simulation environment could improve the quality of the system before deployment and reduce a development cost.

Autonomous Addition of Agents to an Existing Group Using Genetic Algorithm.

This paper presents an idea of how new agents can be added autonomously to a group of existing agents without changing the existing communication topology among them. Autonomous agent addition to existing Multi-Agent Systems (MASs) can give a strategic advantage during the execution of a critical beyond visual line-of-sight (BVLOS) mission. The addition of the agent essentially means that new connections with existing agents are established. It is obvious that the consensus control energy increases as the number of agent increases considering a specific consensus protocol. The objective of this work is to establish the new connections in a way such that the consensus energy increase due to the new agents is minimal. The updated topology, including new connections, must contain a spanning tree to maintain the stability of the MASs network. The updated optimal topology is obtained by solving minimum additional consensus control energy using the Two-Dimensional Genetic Algorithm. The results obtained are convincing.

Comparison of Cooled and Uncooled IR Sensors by Means of Signal-to-Noise Ratio for NDT Diagnostics of Aerospace Grade Composites.

This work aims to address the effectiveness and challenges of non-destructive testing (NDT) by active infrared thermography (IRT) for the inspection of aerospace-grade composite samples and seeks to compare uncooled and cooled thermal cameras using the signal-to-noise ratio (SNR) as a performance parameter. It focuses on locating impact damages and optimising the results using several signal processing techniques. The work successfully compares both types of cameras using seven different SNR definitions, to understand if a lower-resolution uncooled IR camera can achieve an acceptable NDT standard. Due to most uncooled cameras being small, lightweight, and cheap, they are more accessible to use on an unmanned aerial vehicle (UAV). The concept of using a UAV for NDT on a composite wing is explored, and the UAV is also tracked using a localisation system to observe the exact movement in millimetres and how it affects the thermal data. It was observed that an NDT UAV can access difficult areas and, therefore, can be suggested for significant reduction of time and cost.

Improving Depth Resolution of Ultrasonic Phased Array Imaging to Inspect Aerospace Composite Structures.

In this paper, we present challenges and achievements in development and use of a compact ultrasonic Phased Array (PA) module with signal processing and imaging technology for autonomous non-destructive evaluation of composite aerospace structures. We analyse two different sets of ultrasonic scan data, acquired from 5 MHz and 10 MHz PA transducers. Although higher frequency transducers promise higher axial (depth) resolution in PA imaging, we face several signal processing challenges to detect defects in composite specimens at 10 MHz. One of the challenges is the presence of multiple echoes at the boundary of the composite layers called structural noise. Here, we propose a wavelet transform-based algorithm that is able to detect and characterize defects (depth, size, and shape in 3D plots). This algorithm uses a smart thresholding technique based on the extracted statistical mean and standard deviation of the structural noise. Finally, we use the proposed algorithm to detect and characterize defects in a standard calibration specimen and validate the results by comparing to the designed depth information.

Solving Trajectory Optimization Problems in the Presence of Probabilistic Constraints.

The objective of this paper is to present an approximation-based strategy for solving the problem of nonlinear trajectory optimization with the consideration of probabilistic constraints. The proposed method defines a smooth and differentiable function to replace probabilistic constraints by the deterministic ones, thereby converting the chance-constrained trajectory optimization model into a parametric nonlinear programming model. In addition, it is proved that the approximation function and the corresponding approximation set will converge to that of the original problem. Furthermore, the optimal solution of the approximated model is ensured to converge to the optimal solution of the original problem. Numerical results, obtained from a new chance-constrained space vehicle trajectory optimization model and a 3-D unmanned vehicle trajectory smoothing problem, verify the feasibility and effectiveness of the proposed approach. Comparative studies were also carried out to show the proposed design can yield good performance and outperform other typical chance-constrained optimization techniques investigated in this paper.

Solving Multiobjective Constrained Trajectory Optimization Problem by an Extended Evolutionary Algorithm.

Highly constrained trajectory optimization problems are usually difficult to solve. Due to some real-world requirements, a typical trajectory optimization model may need to be formulated containing several objectives. Because of the discontinuity or nonlinearity in the vehicle dynamics and mission objectives, it is challenging to generate a compromised trajectory that can satisfy constraints and optimize objectives. To address the multiobjective trajectory planning problem, this paper applies a specific multiple-shooting discretization technique with the newest NSGA-III optimization algorithm and constructs a new evolutionary optimal control solver. In addition, three constraint handling algorithms are incorporated in this evolutionary optimal control framework. The performance of using different constraint handling strategies is detailed and analyzed. The proposed approach is compared with other well-developed multiobjective techniques. Experimental studies demonstrate that the present method can outperform other evolutionary-based solvers investigated in this paper with respect to convergence ability and distribution of the Pareto-optimal solutions. Therefore, the present evolutionary optimal control solver is more attractive and can offer an alternative for optimizing multiobjective continuous-time trajectory optimization problems.

Six-DOF Spacecraft Optimal Trajectory Planning and Real-Time Attitude Control: A Deep Neural Network-Based Approach.

This brief presents an integrated trajectory planning and attitude control framework for six-degree-of-freedom (6-DOF) hypersonic vehicle (HV) reentry flight. The proposed framework utilizes a bilevel structure incorporating desensitized trajectory optimization and deep neural network (DNN)-based control. In the upper level, a trajectory data set containing optimal system control and state trajectories is generated, while in the lower level control system, DNNs are constructed and trained using the pregenerated trajectory ensemble in order to represent the functional relationship between the optimized system states and controls. These well-trained networks are then used to produce optimal feedback actions online. A detailed simulation analysis was performed to validate the real-time applicability and the optimality of the designed bilevel framework. Moreover, a comparative analysis was also carried out between the proposed DNN-driven controller and other optimization-based techniques existing in related works. Our results verify the reliability of using the proposed bilevel design for the control of HV reentry flight in real time.

Inspection of Aircraft Wing Panels Using Unmanned Aerial Vehicles.

In large civil aircraft manufacturing, a time-consuming post-production process is the non-destructive inspection of wing panels. This work aims to address this challenge and improve the defects' detection by performing automated aerial inspection using a small off-the-shelf multirotor. The UAV is equipped with a wide field-of-view camera and an ultraviolet torch for implementing non-invasive imaging inspection. In particular, the UAV is programmed to perform the complete mission and stream video, in real-time, to the ground control station where the defects' detection algorithm is executed. The proposed platform was mathematically modelled in MATLAB/SIMULINK in order to assess the behaviour of the system using a path following method during the aircraft wing inspection. In addition, two defect detection algorithms were implemented and tested on a dataset containing images obtained during inspection at Airbus facilities. The results show that for the current dataset the proposed methods can identify all the images containing defects.