eFFT: An Event-based Method for the Efficient Computation of Exact Fourier Transforms.

We introduce eFFT, an efficient method for the calculation of the exact Fourier transform of an asynchronous event stream. It is based on keeping the matrices involved in the Radix-2 FFT algorithm in a tree data structure and updating them with the new events, extensively reusing computations, and avoiding unnecessary calculations while preserving exactness. eFFT can operate event-by-event, requiring for each event only a partial recalculation of the tree since most of the stored data are reused. It can also operate with event packets, using the tree structure to detect and avoid unnecessary and repeated calculations when integrating the different events within each packet to further reduce the number of operations. eFFT has been extensively evaluated with public datasets and experiments, validating its exactness, low processing time, and feasibility for online execution on resource-constrained hardware. We release a C++ implementation of eFFT to the community.

Exponential and robust position-constrained control of robot manipulators via diffeomorphisms.

Mechanical systems subject to constraints play a essential role in the field of control engineering, profoundly influencing the design and performance of control strategies. Consequently, there is a compelling need to explore diverse control methods to effectively tackle the complex task of stabilizing nonlinear systems while ensuring the constraints are not violated. In this context, this paper proposes a design procedure for position-constrained controllers in robot manipulators. The solution relies on the construction of a diffeomorphism (a differentiable coordinate transformation) that maps all the trajectories of the constrained dynamics into an unconstrained one. The controller design is carried out in the unconstrained dynamics without dealing directly with the constraints. The proposed family of controllers employ an explicit control law which circumvents the need for additional time-consuming computation for feasibility and/or optimization. Moreover, the proposed controller is parametrized by a class of diffeomorphisms which can be selected by the designer. Exponential stability in constrained and unconstrained position states is achieved, in the certain case. For the uncertain case, the controller is augmented through sliding modes guaranteeing finite-time convergence towards the manifold and keeping the exponential convergence within the manifold dynamics. The approach is validated through experiments in an actual 2 DOF lightweight robot manipulator.

Closed-loop nonlinear optimal control design for flapping-wing flying robot (1.6 m wingspan) in indoor confined space: Prototyping, modeling, simulation, and experiment.

The flapping-wing technology has emerged recently in the application of unmanned aerial robotics for autonomous flight, control, inspection, monitoring, and manipulation. Despite the advances in applications and outdoor manual flights (open-loop control), closed-loop control is yet to be investigated. This work presents a nonlinear optimal closed-loop control design via the state-dependent Riccati equation (SDRE) for a flapping-wing flying robot (FWFR). Considering that the dynamic modeling of the flapping-wing robot is complex, a proper model for the implementation of nonlinear control methods is demanded. This work proposes an alternative approach to deliver an equivalent dynamic for the translation of the system and a simplified model for orientation, to find equivalent dynamics for the whole system. The objective is to see the effect of flapping (periodic oscillation) on behavior through a simple model in simulation. Then the SDRE controller is applied to the derived model and implemented in simulations and experiments. The robot bird is a 1.6 m wingspan flapping-wing system (six-degree-of-freedom robot) with four actuators, three in the tail, and one as the flapping input. The underactuated system has been controlled successfully in position and orientation. The control loop is closed by the motion capture system in the indoor test bed where the experiments of flight have been successfully done.

How ornithopters can perch autonomously on a branch.

Flapping wings produce lift and thrust in bio-inspired aerial robots, leading to quiet, safe and efficient flight. However, to extend their application scope, these robots must perch and land, a feat widely demonstrated by birds. Despite recent progress, flapping-wing vehicles, or ornithopters, are to this day unable to stop their flight. In this paper, we present a process to autonomously land an ornithopter on a branch. This method describes the joint operation of a pitch-yaw-altitude flapping flight controller, an optical close-range correction system and a bistable claw appendage design that can grasp a branch within 25 milliseconds and re-open. We validate this method with a 700 g robot and demonstrate the first autonomous perching flight of a flapping-wing robot on a branch, a result replicated with a second robot. This work paves the way towards the application of flapping-wing robots for long-range missions, bird observation, manipulation, and outdoor flight.

Aeroelastics-aware compensation system for soft aerial vehicle stabilization.

This paper describes a compensation system for soft aerial vehicle stabilization. Balancing the arms is one of the main challenges of soft UAVs since the propeller is freely tilting together with the flexible arm. In comparison with previous designs, in which the autopilot was adjusted to deal with these imbalances with no extra actuation, this work introduces a soft tendon-actuated system to achieve in-flight stabilization in an energy-efficient way. The controller is specifically designed for disturbance rejection of aeroelastic perturbations using the Ziegler-Nichols method, depending on the flight mode and material properties. This aerodynamics-aware compensation system allows to further bridge the gap between soft and aerial robotics, leading to an increase in the flexibility of the UAV, and the ability to deal with changes in material properties, increasing the useful life of the drone. In energetic terms, the novel system is 15-30% more efficient, and is the basis for future applications such as object grasping.

Autonomous UAV System for Cleaning Insulators in Power Line Inspection and Maintenance.

The inspection and maintenance tasks of electrical installations are very demanding. Nowadays, insulator cleaning is carried out manually by operators using scaffolds, ropes, or even helicopters. However, these operations involve potential risks for humans and the electrical structure. The use of Unmanned Aerial Vehicles (UAV) to reduce the risk of these tasks is rising. This paper presents an UAV to autonomously clean insulators on power lines. First, an insulator detection and tracking algorithm has been implemented to control the UAV in operation. Second, a cleaning tool has been designed consisting of a pump, a tank, and an arm to direct the flow of cleaning liquid. Third, a vision system has been developed that is capable of detecting soiled areas using a semantic segmentation neuronal network, calculating the trajectory for cleaning in the image plane, and generating arm trajectories to efficiently clean the insulator. Fourth, an autonomous system has been developed to land on a charging pad to charge the batteries and potentially fill the tank with cleaning liquid. Finally, the autonomous system has been validated in a controlled outdoor environment.

Localization System for Lightweight Unmanned Aerial Vehicles in Inspection Tasks.

This paper presents a localization system for Unmanned Aerial Vehicles (UAVs) especially designed to be used in infrastructure inspection, where the UAVs have to fly in challenging conditions, such as relatively high altitude (e.g., 15 m), eventually with poor or absent GNSS (Global Navigation Satellite System) signal reception, or the need for a BVLOS (Beyond Visual Line of Sight) operation in some periods. In addition, these infrastructure inspection applications impose the following requirements for the localization system: defect traceability, accuracy, reliability, and fault tolerance. Our system proposes a lightweight solution combining multiple stereo cameras with a robotic total station to comply with these requirements, providing full-state estimation (i.e., position, orientation, and linear and angular velocities) in a fixed and time-persistent reference frame. Moreover, the system can align and fuse all sensor measurements in real-time at high frequency. We have integrated this localization system in our aerial platform, and we have tested its performance for inspection in a real-world viaduct scenario, where the UAV has to operate with poor or absent GNSS signal at high altitude.

Soft-Tentacle Gripper for Pipe Crawling to Inspect Industrial Facilities Using UAVs.

This paper presents a crawling mechanism using a soft-tentacle gripper integrated into an unmanned aerial vehicle for pipe inspection in industrial environments. The objective was to allow the aerial robot to perch and crawl along the pipe, minimizing the energy consumption, and allowing to perform contact inspection. This paper introduces the design of the soft limbs of the gripper and also the internal mechanism that allows movement along pipes. Several tests have been carried out to ensure the grasping capability on the pipe and the performance and reliability of the developed system. This paper shows the complete development of the system using additive manufacturing techniques and includes the results of experiments performed in realistic environments.

Fully-Actuated Aerial Manipulator for Infrastructure Contact Inspection: Design, Modeling, Localization, and Control.

This paper presents the design, modeling and control of a fully actuated aerial robot for infrastructure contact inspection as well as its localization system. Health assessment of transport infrastructure involves measurements with sensors in contact with the bridge and tunnel surfaces and the installation of monitoring sensing devices at specific points. The design of the aerial robot presented in the paper includes a 3DoF lightweight arm with a sensorized passive joint which can measure the contact force to regulate the force applied with the sensor on the structure. The aerial platform has been designed with tilted propellers to be fully actuated, achieving independent attitude and position control. It also mounts a "docking gear" to establish full contact with the infrastructure during the inspection, minimizing the measurement errors derived from the motion of the aerial platform and allowing full contact with the surface regardless of its condition (smooth, rough, ...). The localization system of the aerial robot uses multi-sensor fusion of the measurements of a topographic laser sensor on the ground and a tracking camera and inertial sensors on-board the aerial robot, to be able to fly under the bridge deck or close to the bridge pillars where GNSS satellite signals are not available. The paper also presents the modeling and control of the aerial robot. Validation experiments of the localization system and the control system, and with the aerial robot inspecting a real bridge are also included.

An Efficient Distributed Area Division Method for Cooperative Monitoring Applications with Multiple UAVs.

This article addresses the area division problem in a distributed manner providing a solution for cooperative monitoring missions with multiple UAVs. Starting from a sub-optimal area division, a distributed online algorithm is presented to accelerate the convergence of the system to the optimal solution, following a frequency-based approach. Based on the "coordination variables" concept and on a strict neighborhood relation to share information (left, right, above and below neighbors), this technique defines a distributed division protocol to determine coherently the size and shape of the sub-area assigned to each UAV. Theoretically, the convergence time of the proposed solution depends linearly on the number of UAVs. Validation results, comparing the proposed approach with other distributed techniques, are provided to evaluate and analyze its performance following a convergence time criterion.

Novel Aerial Manipulator for Accurate and Robust Industrial NDT Contact Inspection: A New Tool for the Oil and Gas Inspection Industry.

There is a strong demand in the oil and gas industry to develop alternatives to manual inspection. This paper presents AeroX, a novel aerial robotic manipulator that provides physical contact inspection with unprecedented capabilities. AeroX has a semi-autonomous operation, which provides interesting advantages in contact inspection. In the free-flight mode, the pilot guides the robot until performing contact with its end-effector on the surface to be inspected. During contact, AeroX is in its fully-autonomous global navigation satellite system (GNSS)-free contact⁻flight mode, in which the robot keeps its relative position w.r.t. the surface contact point using only its internal sensors. During autonomous flight, the inspector can move-with uninterrupted contact-the end-effector on the surface for accurately selecting the points where to perform A-scan measurements or continuous B-scan or C-scan inspections. AeroX adopts an eight-tilted rotor configuration and a simple and efficient design, which provides high stability, maneuverability, and robustness to rotor failure. It can perform contact inspection on surfaces at any orientation, including vertical, inclined, horizontal-top or horizontal-bottom, and its operation can be easily integrated into current maintenance operations in many industries. It has been extensively validated in outdoor experiments including a refinery and has been awarded the EU Innovation Radar Prize 2017.

A Precise and GNSS-Free Landing System on Moving Platforms for Rotary-Wing UAVs.

This article presents a precise landing system that allows rotary-wing UAVs to approach and land safely on moving platforms, without using GNSS at any stage of the landing maneuver, and with a centimeter level accuracy and high level of robustness. This system implements a novel concept where the relative position and velocity between the aerial vehicle and the landing platform are calculated from the angles of a cable that physically connects the UAV and the landing platform. The use of a cable also incorporates a number of extra benefits, such as increasing the precision in the control of the UAV altitude. It also facilitates centering the UAV right on top of the expected landing position, and increases the stability of the UAV just after contacting the landing platform. The system was implemented in an unmanned helicopter and many tests were carried out under different conditions for measuring the accuracy and the robustness of the proposed solution. Results show that the developed system allowed landing with centimeter accuracy by using only local sensors and that the helicopter could follow the landing platform in multiple trajectories at different velocities.

Robotic System for Inspection by Contact of Bridge Beams Using UAVs.

This paper presents a robotic system using Unmanned Aerial Vehicles (UAVs) for bridge-inspection tasks that require physical contact between the aerial platform and the bridge surfaces, such as beam-deflection analysis or measuring crack depth with an ultrasonic sensor. The proposed system takes advantage of the aerodynamic ceiling effect that arises when the multirotor gets close to the bridge surface. Moreover, this paper describes how a UAV can be used as a sensor that is able to fly and touch the bridge to take measurements during an inspection by contact. A practical application of the system involving the measurement of a bridge's beam deflection using a laser tracking station is also presented. In order to validate our system, experiments on two different bridges involving the measurement of the deflection of their beams are shown.

Decentralized 3D Collision Avoidance for Multiple UAVs in Outdoor Environments.

The use of multiple aerial vehicles for autonomous missions is turning into commonplace. In many of these applications, the Unmanned Aerial Vehicles (UAVs) have to cooperate and navigate in a shared airspace, becoming 3D collision avoidance a relevant issue. Outdoor scenarios impose additional challenges: (i) accurate positioning systems are costly; (ii) communication can be unreliable or delayed; and (iii) external conditions like wind gusts affect UAVs' maneuverability. In this paper, we present 3D-SWAP, a decentralized algorithm for 3D collision avoidance with multiple UAVs. 3D-SWAP operates reactively without high computational requirements and allows UAVs to integrate measurements from their local sensors with positions of other teammates within communication range. We tested 3D-SWAP with our team of custom-designed UAVs. First, we used a Software-In-The-Loop simulator for system integration and evaluation. Second, we run field experiments with up to three UAVs in an outdoor scenario with uncontrolled conditions (i.e., noisy positioning systems, wind gusts, etc). We report our results and our procedures for this field experimentation.

Robot-Beacon Distributed Range-Only SLAM for Resource-Constrained Operation.

This work deals with robot-sensor network cooperation where sensor nodes (beacons) are used as landmarks for Range-Only (RO) Simultaneous Localization and Mapping (SLAM). Most existing RO-SLAM techniques consider beacons as passive devices disregarding the sensing, computational and communication capabilities with which they are actually endowed. SLAM is a resource-demanding task. Besides the technological constraints of the robot and beacons, many applications impose further resource consumption limitations. This paper presents a scalable distributed RO-SLAM scheme for resource-constrained operation. It is capable of exploiting robot-beacon cooperation in order to improve SLAM accuracy while meeting a given resource consumption bound expressed as the maximum number of measurements that are integrated in SLAM per iteration. The proposed scheme combines a Sparse Extended Information Filter (SEIF) SLAM method, in which each beacon gathers and integrates robot-beacon and inter-beacon measurements, and a distributed information-driven measurement allocation tool that dynamically selects the measurements that are integrated in SLAM, balancing uncertainty improvement and resource consumption. The scheme adopts a robot-beacon distributed approach in which each beacon participates in the selection, gathering and integration in SLAM of robot-beacon and inter-beacon measurements, resulting in significant estimation accuracies, resource-consumption efficiency and scalability. It has been integrated in an octorotor Unmanned Aerial System (UAS) and evaluated in 3D SLAM outdoor experiments. The experimental results obtained show its performance and robustness and evidence its advantages over existing methods.

Coastal Areas Division and Coverage with Multiple UAVs for Remote Sensing.

This paper tackles the problems of exact cell decomposition and partitioning of a coastal region for a team of heterogeneous Unmanned Aerial Vehicles (UAVs) with an approach that takes into account the field of view or sensing radius of the sensors on-board. An initial sensor-based exact cell decomposition of the area aids in the partitioning process, which is performed in two steps. In the first step, a growing regions algorithm performs an isotropic partitioning of the area based on the initial locations of the UAVs and their relative capabilities. Then, two novel algorithms are applied to compute an adjustment of this partitioning process, in order to solve deadlock situations that generate non-allocated regions and sub-areas above or below the relative capabilities of the UAVs. Finally, realistic simulations have been conducted for the evaluation of the proposed solution, and the obtained results show that these algorithms can compute valid and sound solutions in complex coastal region scenarios under different setups for the UAVs.

Detection, Location and Grasping Objects Using a Stereo Sensor on UAV in Outdoor Environments.

The article presents a vision system for the autonomous grasping of objects with Unmanned Aerial Vehicles (UAVs) in real time. Giving UAVs the capability to manipulate objects vastly extends their applications, as they are capable of accessing places that are difficult to reach or even unreachable for human beings. This work is focused on the grasping of known objects based on feature models. The system runs in an on-board computer on a UAV equipped with a stereo camera and a robotic arm. The algorithm learns a feature-based model in an offline stage, then it is used online for detection of the targeted object and estimation of its position. This feature-based model was proved to be robust to both occlusions and the presence of outliers. The use of stereo cameras improves the learning stage, providing 3D information and helping to filter features in the online stage. An experimental system was derived using a rotary-wing UAV and a small manipulator for final proof of concept. The robotic arm is designed with three degrees of freedom and is lightweight due to payload limitations of the UAV. The system has been validated with different objects, both indoors and outdoors.

Small UAS-Based Wind Feature Identification System Part 1: Integration and Validation.

This paper presents a system for identification of wind features, such as gusts and wind shear. These are of particular interest in the context of energy-efficient navigation of Small Unmanned Aerial Systems (UAS). The proposed system generates real-time wind vector estimates and a novel algorithm to generate wind field predictions. Estimations are based on the integration of an off-the-shelf navigation system and airspeed readings in a so-called direct approach. Wind predictions use atmospheric models to characterize the wind field with different statistical analyses. During the prediction stage, the system is able to incorporate, in a big-data approach, wind measurements from previous flights in order to enhance the approximations. Wind estimates are classified and fitted into a Weibull probability density function. A Genetic Algorithm (GA) is utilized to determine the shaping and scale parameters of the distribution, which are employed to determine the most probable wind speed at a certain position. The system uses this information to characterize a wind shear or a discrete gust and also utilizes a Gaussian Process regression to characterize continuous gusts. The knowledge of the wind features is crucial for computing energy-efficient trajectories with low cost and payload. Therefore, the system provides a solution that does not require any additional sensors. The system architecture presents a modular decentralized approach, in which the main parts of the system are separated in modules and the exchange of information is managed by a communication handler to enhance upgradeability and maintainability. Validation is done providing preliminary results of both simulations and Software-In-The-Loop testing. Telemetry data collected from real flights, performed in the Seville Metropolitan Area in Andalusia (Spain), was used for testing. Results show that wind estimation and predictions can be calculated at 1 Hz and a wind map can be updated at 0.4 Hz . Predictions show a convergence time with a 95% confidence interval of approximately 30 s .

Extracting Objects for Aerial Manipulation on UAVs Using Low Cost Stereo Sensors.

Giving unmanned aerial vehicles (UAVs) the possibility to manipulate objects vastly extends the range of possible applications. This applies to rotary wing UAVs in particular, where their capability of hovering enables a suitable position for in-flight manipulation. Their manipulation skills must be suitable for primarily natural, partially known environments, where UAVs mostly operate. We have developed an on-board object extraction method that calculates information necessary for autonomous grasping of objects, without the need to provide the model of the object's shape. A local map of the work-zone is generated using depth information, where object candidates are extracted by detecting areas different to our floor model. Their image projections are then evaluated using support vector machine (SVM) classification to recognize specific objects or reject bad candidates. Our method builds a sparse cloud representation of each object and calculates the object's centroid and the dominant axis. This information is then passed to a grasping module. Our method works under the assumption that objects are static and not clustered, have visual features and the floor shape of the work-zone area is known. We used low cost cameras for creating depth information that cause noisy point clouds, but our method has proved robust enough to process this data and return accurate results.

An adaptive scheme for robot localization and mapping with dynamically configurable inter-beacon range measurements.

This work is motivated by robot-sensor network cooperation techniques where sensor nodes (beacons) are used as landmarks for range-only (RO) simultaneous localization and mapping (SLAM). This paper presents a RO-SLAM scheme that actuates over the measurement gathering process using mechanisms that dynamically modify the rate and variety of measurements that are integrated in the SLAM filter. It includes a measurement gathering module that can be configured to collect direct robot-beacon and inter-beacon measurements with different inter-beacon depth levels and at different rates. It also includes a supervision module that monitors the SLAM performance and dynamically selects the measurement gathering configuration balancing SLAM accuracy and resource consumption. The proposed scheme has been applied to an extended Kalman filter SLAM with auxiliary particle filters for beacon initialization (PF-EKF SLAM) and validated with experiments performed in the CONET Integrated Testbed. It achieved lower map and robot errors (34% and 14%, respectively) than traditional methods with a lower computational burden (16%) and similar beacon energy consumption.