Real-Time Pipe and Valve Characterisation and Mapping for Autonomous Underwater Intervention Tasks.

Nowadays, more frequently, it is necessary to perform underwater operations such as surveying an area or inspecting and intervening on industrial infrastructures such as offshore oil and gas rigs or pipeline networks. Recently, the use of Autonomous Underwater Vehicles (AUV) has grown as a way to automate these tasks, reducing risks and execution time. One of the used sensing modalities is vision, providing RGB high-quality information in the mid to low range, making it appropriate for manipulation or detail inspection tasks. This work presents the use of a deep neural network to perform pixel-wise 3D segmentation of pipes and valves on underwater point clouds generated using a stereo pair of cameras. In addition, two novel algorithms are built to extract information from the detected instances, providing pipe vectors, gripping points, the position of structural elements such as elbows or connections, and valve type and orientation. The information extracted on spatially referenced point clouds can be unified to form an information map of an inspected area. Results show outstanding performance on the network segmentation task, achieving a mean F1-score value of 88.0% at a pixel-wise level and of 95.3% at an instance level. The information extraction algorithm also showcased excellent metrics when extracting information from pipe instances and their structural elements and good enough metrics when extracting data from valves. Finally, the neural network and information algorithms are implemented on an AUV and executed in real-time, validating that the output information stream frame rate of 0.72 fps is high enough to perform manipulation tasks and to ensure full seabed coverage during inspection tasks. The used dataset, along with a trained model and the information algorithms, are provided to the scientific community.

Xiroi II, an Evolved ASV Platform for Marine Multirobot Operations.

In this paper, we present the design, development and a practical use of an Autonomous Surface Vehicle (ASV) as a modular and flexible platform for a large variety of marine tasks including the coordination strategies with other marine robots. This work tackles the integration of an open-source Robot-Operating-System (ROS)-based control architecture that provides the ASV with a wide variety of navigation behaviors. These new ASV capabilities can be used to acquire useful data from the environment to survey, map, and characterize marine habitats. In addition, the ASV is used as a radio frequency relay point between an Autonomous Underwater Vehicle (AUV) and the ground station as well as to enhance the Acoustic Communication Link (ACL) with the AUV. In order to improve the quality of the ACL, a new Marine Multirobot System (MMRS) coordination strategy has been developed that aims to keep both vehicles close to each other. The entire system has been successfully designed, implemented, and tested in real marine environment robotic tasks. The experimental tests show satisfactory results both in ROS-based navigation architecture and the MMRS coordination strategy resulting in a significant improvement of the quality of the ACL.

Evaluating the impact of sewage discharges on the marine environment with a lightweight AUV.

Environmental studies that use small Autonomous Underwater Vehicles (AUVs) can survey wider and deeper areas, compared to traditional methods, at a reasonable cost. Thanks to the precise vehicle navigation systems, the data collected can be accurately geolocalized. Besides, lightweight vehicles can be deployed from the shore or from small boats and programmed by means of user-friendly graphical interfaces, thus reducing and simplifying the need of human resources and infrastructures. Based on such a technology, this paper presents a framework to assess the environmental impact of a marine sewage outfall set in the Bay of Palma (Mallorca, Spain). We report the results of the analysis of the images recorded in the course of six missions conducted with an AUV. The plan was designed after a microbiological analysis detected the presence of cyanobacteria in a sample of sand and water collected by scuba divers close to the sewer pipe mouth.

I-AUV Docking and Panel Intervention at Sea.

The use of commercially available autonomous underwater vehicles (AUVs) has increased during the last fifteen years. While they are mainly used for routine survey missions, there is a set of applications that nowadays can be only addressed by manned submersibles or work-class remotely operated vehicles (ROVs) equipped with teleoperated arms: the intervention applications. To allow these heavy vehicles controlled by human operators to perform intervention tasks, underwater structures like observatory facilities, subsea panels or oil-well Christmas trees have been adapted, making them more robust and easier to operate. The TRITON Spanish founded project proposes the use of a light-weight intervention AUV (I-AUV) to carry out intervention applications simplifying the adaptation of these underwater structures and drastically reducing the operational cost. To prove this concept, the Girona 500 I-AUV is used to autonomously dock into an adapted subsea panel and once docked perform an intervention composed of turning a valve and plugging in/unplugging a connector. The techniques used for the autonomous docking and manipulation as well as the design of an adapted subsea panel with a funnel-based docking system are presented in this article together with the results achieved in a water tank and at sea.

Optical Sensors and Methods for Underwater 3D Reconstruction.

This paper presents a survey on optical sensors and methods for 3D reconstruction in underwater environments. The techniques to obtain range data have been listed and explained, together with the different sensor hardware that makes them possible. The literature has been reviewed, and a classification has been proposed for the existing solutions. New developments, commercial solutions and previous reviews in this topic have also been gathered and considered.

Inertial sensor self-calibration in a visually-aided navigation approach for a micro-AUV.

This paper presents a new solution for underwater observation, image recording, mapping and 3D reconstruction in shallow waters. The platform, designed as a research and testing tool, is based on a small underwater robot equipped with a MEMS-based IMU, two stereo cameras and a pressure sensor. The data given by the sensors are fused, adjusted and corrected in a multiplicative error state Kalman filter (MESKF), which returns a single vector with the pose and twist of the vehicle and the biases of the inertial sensors (the accelerometer and the gyroscope). The inclusion of these biases in the state vector permits their self-calibration and stabilization, improving the estimates of the robot orientation. Experiments in controlled underwater scenarios and in the sea have demonstrated a satisfactory performance and the capacity of the vehicle to operate in real environments and in real time.