Spatial Localization of Transformer Inspection Robot Based on Adaptive Denoising and SCOT-ß Generalized Cross-Correlation.

In the detection process of the internal defects of large oil-immersed transformers, due to the huge size of large transformers and metal-enclosed structures, the positional localization of miniature inspection robots inside the transformer faces great difficulties. To address this problem, this paper proposes a three-dimensional positional localization method based on adaptive denoising and the SCOT weighting function with the addition of the exponent ß (SCOT-ß) generalized cross-correlation for L-type ultrasonic arrays of transformer internal inspection robots. Aiming at the strong noise interference in the field, the original signal is decomposed by an improved Empirical Mode Decomposition (EMD) method, and the optimal center frequency and bandwidth of each mode are adaptively searched. By extracting the modes in the frequency band of the positional localization signal, suppressing the modes in the noise frequency band, and reconstructing the Intrinsic Mode Function (IMF) of the independently selected superior modal components, a signal with a high signal-to-noise ratio is obtained. In addition, for the traditional mutual correlation algorithm with a large delay estimation error at a low signal-to-noise ratio, this paper adopts an improved generalized joint weighting function, SCOT-ß, which improves the anti-jamming ability of the generalized mutual correlation method at a low signal-to-noise ratio by adding an exponential function to the denominator term of the SCOT weighting function's generalized cross-correlation. Finally, the accurate positional localization of the transformer internal inspection robot is realized based on the quadratic L-array and search-based maximum likelihood estimation method. Simulation and experimental results show the following: the improved EMD denoising method better improves the signal-to-noise ratio of the positional localization signal with a lower distortion rate; in the transformer test tank, which is 120 cm in length, 100 cm in width, and 100 cm in height, based on the positional localization method in this paper, the average relative positional localization error of the transformer internal inspection robot in three-dimensional space is 2.27%, and the maximum positional localization error is less than 2 cm, which meets the requirements of engineering positional localization.

Spatial Localization of a Transformer Robot Based on Ultrasonic Signal Wavelet Decomposition and PHAT-ß-γ Generalized Cross Correlation.

Because large oil-immersed transformers are enclosed by a metal shell, the on-site localization means it is difficult to achieve the accurate location of the patrol micro-robot inside a given transformer. To address this issue, a spatial ultrasonic localization method based on wavelet decomposition and PHAT-ß-γ generalized cross correlation is proposed in this paper. The method is carried out with a five-element stereo ultrasonic array for the location of a transformer patrol robot. Firstly, the localization signal is decomposed into wavelet coefficients of different scales, which would realize the adaptive decomposition of the frequency of the localization signal from low frequencies to high frequencies. Then, the wavelet coefficients are denoised and reconstructed by using the semi-soft threshold function. Second, a modified phase transform-beta-gamma (PHAT-ß-γ) method is used to calculate the exact time delay between different sensors by increasing the weights of the PHAT weighting function and introducing a correlation function. Finally, by using the proposed method, the accurate localization of the transformer patrol micro-robot is achieved with a five-element stereo ultrasonic array. The simulation and test results show that inside a transformer experimental oil tank (120 cm × 100 cm × 100 cm, L × W × H), the relative error of transformer patrol micro-robot spatial localization is within 4.1%, and the maximum localization error is less than 3 cm, which meets the requirement of engineering localization.

A visual questioning answering approach to enhance robot localization in indoor environments.

Navigating robots with precision in complex environments remains a significant challenge. In this article, we present an innovative approach to enhance robot localization in dynamic and intricate spaces like homes and offices. We leverage Visual Question Answering (VQA) techniques to integrate semantic insights into traditional mapping methods, formulating a novel position hypothesis generation to assist localization methods, while also addressing challenges related to mapping accuracy and localization reliability. Our methodology combines a probabilistic approach with the latest advances in Monte Carlo Localization methods and Visual Language models. The integration of our hypothesis generation mechanism results in more robust robot localization compared to existing approaches. Experimental validation demonstrates the effectiveness of our approach, surpassing state-of-the-art multi-hypothesis algorithms in both position estimation and particle quality. This highlights the potential for accurate self-localization, even in symmetric environments with large corridor spaces. Furthermore, our approach exhibits a high recovery rate from deliberate position alterations, showcasing its robustness. By merging visual sensing, semantic mapping, and advanced localization techniques, we open new horizons for robot navigation. Our work bridges the gap between visual perception, semantic understanding, and traditional mapping, enabling robots to interact with their environment through questions and enrich their map with valuable insights. The code for this project is available on GitHub https://github.com/juandpenan/topology_nav_ros2.

Research on Positioning Accuracy of Mobile Robot in Indoor Environment Based on Improved RTABMAP Algorithm.

Visual simultaneous localization and mapping is a widely used technology for mobile robots to carry out precise positioning in the environment of GNSS technology failure. However, as the robot moves around indoors, its position accuracy will gradually decrease over time due to common and unavoidable environmental factors. In this paper, we propose an improved method called RTABMAP-VIWO, which is based on RTABMAP. The basic idea is to use an Extended Kalman Filter (EKF) framework for fusion attitude estimates from the wheel odometry and IMU, and provide new prediction values. This helps to reduce the local cumulative error of RTABMAP and make it more accurate. We compare and evaluate three kinds of SLAM methods using both public datasets and real indoor scenes. In the dataset experiments, our proposed method reduces the Root-Mean-Square Error (RMSE) coefficient by 48.1% compared to the RTABMAP, and the coefficient is also reduced by at least 29.4% in the real environment experiments. The results demonstrate that the improved method is feasible. By incorporating the IMU into the RTABMAP method, the trajectory and posture errors of the mobile robot are significantly improved.

A survey of path planning of industrial robots based on rapidly exploring random trees.

Path planning is an essential part of robot intelligence. In this paper, we summarize the characteristics of path planning of industrial robots. And owing to the probabilistic completeness, we review the rapidly-exploring random tree (RRT) algorithm which is widely used in the path planning of industrial robots. Aiming at the shortcomings of the RRT algorithm, this paper investigates the RRT algorithm for path planning of industrial robots in order to improve its intelligence. Finally, the future development direction of the RRT algorithm for path planning of industrial robots is proposed. The study results have particularly guided significance for the development of the path planning of industrial robots and the applicability and practicability of the RRT algorithm.

A robust method for approximate visual robot localization in feature-sparse sewer pipes.

Buried sewer pipe networks present many challenges for robot localization systems, which require non-standard solutions due to the unique nature of these environments: they cannot receive signals from global positioning systems (GPS) and can also lack visual features necessary for standard visual odometry algorithms. In this paper, we exploit the fact that pipe joints are equally spaced and develop a robot localization method based on pipe joint detection that operates in one degree-of-freedom along the pipe length. Pipe joints are detected in visual images from an on-board forward facing (electro-optical) camera using a bag-of-keypoints visual categorization algorithm, which is trained offline by unsupervised learning from images of sewer pipe joints. We augment the pipe joint detection algorithm with drift correction using vision-based manhole recognition. We evaluated the approach using real-world data recorded from three sewer pipes (of lengths 30, 50 and 90 m) and benchmarked against a standard method for visual odometry (ORB-SLAM3), which demonstrated that our proposed method operates more robustly and accurately in these feature-sparse pipes: ORB-SLAM3 completely failed on one tested pipe due to a lack of visual features and gave a mean absolute error in localization of approximately 12%-20% on the other pipes (and regularly lost track of features, having to re-initialize multiple times), whilst our method worked successfully on all tested pipes and gave a mean absolute error in localization of approximately 2%-4%. In summary, our results highlight an important trade-off between modern visual odometry algorithms that have potentially high precision and estimate full six degree-of-freedom pose but are potentially fragile in feature sparse pipes, versus simpler, approximate localization methods that operate in one degree-of-freedom along the pipe length that are more robust and can lead to substantial improvements in accuracy.

Exploiting redundancy for UWB anomaly detection in infrastructure-free multi-robot relative localization.

Ultra-wideband (UWB) localization methods have emerged as a cost-effective and accurate solution for GNSS-denied environments. There is a significant amount of previous research in terms of resilience of UWB ranging, with non-line-of-sight and multipath detection methods. However, little attention has been paid to resilience against disturbances in relative localization systems involving multiple nodes. This paper presents an approach to detecting range anomalies in UWB ranging measurements from the perspective of multi-robot cooperative localization. We introduce an approach to exploiting redundancy for relative localization in multi-robot systems, where the position of each node is calculated using different subsets of available data. This enables us to effectively identify nodes that present ranging anomalies and eliminate their effect within the cooperative localization scheme. We analyze anomalies created by timing errors in the ranging process, e.g., owing to malfunctioning hardware. However, our method is generic and can be extended to other types of ranging anomalies. Our approach results in a more resilient cooperative localization framework with a negligible impact in terms of the computational workload.

Ultra-Wideband Communication and Sensor Fusion Platform for the Purpose of Multi-Perspective Localization.

Localization is a keystone for a robot to work within its environment and with other robots. There have been many methods used to solve this problem. This paper deals with the use of beacon-based localization to answer the research question: Can ultra-wideband technology be used to effectively localize a robot with sensor fusion? This paper has developed an innovative solution for creating a sensor fusion platform that uses ultra-wideband communication as a localization method to allow an environment to be perceived and inspected in three dimensions from multiple perspectives simultaneously. A series of contributions have been presented, supported by an in-depth literature review regarding topics in this field of knowledge. The proposed method was then designed, built, and tested successfully in two different environments exceeding its required tolerances. The result of the testing and the ideas formulated throughout the paper were discussed and future work outlined on how to build upon this work in potential academic papers and projects.

UAPF: A UWB Aided Particle Filter Localization For Scenarios with Few Features.

Lidar-based localization doesn't have high accuracy in open scenarios with few features, and behaves poorly in robot kidnap recovery. To address this problem, an improved Particle Filter localization is proposed who could achieve robust robot kidnap detection and pose error compensation. UAPF adaptively updates the covariance by Jacobian from Ultra-wide Band information instead of predetermined parameters, and determines whether robot kidnap occurs by a novel criterion called KNP (Kidnap Probability). Besides, pose fusion of ranging-based localization and PF-based localization is conducted to decrease the uncertainty. To achieve more accurate ranging-based localization, linear regression of ranging data adopts values of maximum probability rather than average distances. Experiments show UAPF can achieve robot kidnap recovery in less than 2 s and position error is less than 0.1 m in a hall of 40 by 15 m, when the currently prevalent lidar-based localization costs more than 90 s and converges to wrong position.

Robot Localization in Water Pipes Using Acoustic Signals and Pose Graph Optimization.

One of the most fundamental tasks for robots inspecting water distribution pipes is localization, which allows for autonomous navigation, for faults to be communicated, and for interventions to be instigated. Pose-graph optimization using spatially varying information is used to enable localization within a feature-sparse length of pipe. We present a novel method for improving estimation of a robot's trajectory using the measured acoustic field, which is applicable to other measurements such as magnetic field sensing. Experimental results show that the use of acoustic information in pose-graph optimization reduces errors by 39% compared to the use of typical pose-graph optimization using landmark features only. High location accuracy is essential to efficiently and effectively target investment to maximise the use of our aging pipe infrastructure.

Comparative Study of Two Pose Measuring Systems Used to Reduce Robot Localization Error.

The performance of marker-based, six degrees of freedom (6DOF) pose measuring systems is investigated. For instruments in this class, the pose is derived from locations of a few three-dimensional (3D) points. For such configurations to be used, the rigid-body condition-which requires that the distance between any two points must be fixed, regardless of orientation and position of the configuration-must be satisfied. This report introduces metrics that gauge the deviation from the rigid-body condition. The use of these metrics is demonstrated on the problem of reducing robot localization error in assembly applications. Experiments with two different systems used to reduce the localization error of the same industrial robot yielded two conflicting outcomes. The data acquired with one system led to substantial reduction in both position and orientation error of the robot, while the data acquired with a second system led to comparable reduction in the position error only. The difference is attributed to differences between metrics used to characterize the two systems.

Automatic Waypoint Generation to Improve Robot Navigation Through Narrow Spaces.

In domestic robotics, passing through narrow areas becomes critical for safe and effective robot navigation. Due to factors like sensor noise or miscalibration, even if the free space is sufficient for the robot to pass through, it may not see enough clearance to navigate, hence limiting its operational space. An approach to facing this is to insert waypoints strategically placed within the problematic areas in the map, which are considered by the robot planner when generating a trajectory and help to successfully traverse them. This is typically carried out by a human operator either by relying on their experience or by trial-and-error. In this paper, we present an automatic procedure to perform this task that: (i) detects problematic areas in the map and (ii) generates a set of auxiliary navigation waypoints from which more suitable trajectories can be generated by the robot planner. Our proposal, fully compatible with the robotic operating system (ROS), has been successfully applied to robots deployed in different houses within the H2020 MoveCare project. Moreover, we have performed extensive simulations with four state-of-the-art robots operating within real maps. The results reveal significant improvements in the number of successful navigations for the evaluated scenarios, demonstrating its efficacy in realistic situations.

Decentralized Cooperative Localization with Fault Detection and Isolation in Robot Teams.

Robot localization, particularly multirobot localization, is an important task for multirobot teams. In this paper, a decentralized cooperative localization (DCL) algorithm with fault detection and isolation is proposed to estimate the positions of robots in mobile robot teams. To calculate the interestimate correlations in a distributed manner, the split covariance intersection filter (SCIF) is applied in the algorithm. Based on the split covariance intersection filter cooperative localization (SCIFCL) algorithm, we adopt fault detection and isolation (FDI) to improve the robustness and accuracy of the DCL results. In the proposed algorithm, the signature matrix of the original FDI algorithm is modified for application to DCL. A simulation-based comparative study is conducted to demonstrate the effectiveness of the proposed algorithm.

Stairs and Doors Recognition as Natural Landmarks Based on Clouds of 3D Edge-Points from RGB-D Sensors for Mobile Robot Localization.

Natural landmarks are the main features in the next step of the research in localization of mobile robot platforms. The identification and recognition of these landmarks are crucial to better localize a robot. To help solving this problem, this work proposes an approach for the identification and recognition of natural marks included in the environment using images from RGB-D (Red, Green, Blue, Depth) sensors. In the identification step, a structural analysis of the natural landmarks that are present in the environment is performed. The extraction of edge points of these landmarks is done using the 3D point cloud obtained from the RGB-D sensor. These edge points are smoothed through the S l 0 algorithm, which minimizes the standard deviation of the normals at each point. Then, the second step of the proposed algorithm begins, which is the proper recognition of the natural landmarks. This recognition step is done as a real-time algorithm that extracts the points referring to the filtered edges and determines to which structure they belong to in the current scenario: stairs or doors. Finally, the geometrical characteristics that are intrinsic to the doors and stairs are identified. The approach proposed here has been validated with real robot experiments. The performed tests verify the efficacy of our proposed approach.

Bio-inspired homogeneous multi-scale place recognition.

Robotic mapping and localization systems typically operate at either one fixed spatial scale, or over two, combining a local metric map and a global topological map. In contrast, recent high profile discoveries in neuroscience have indicated that animals such as rodents navigate the world using multiple parallel maps, with each map encoding the world at a specific spatial scale. While a number of theoretical-only investigations have hypothesized several possible benefits of such a multi-scale mapping system, no one has comprehensively investigated the potential mapping and place recognition performance benefits for navigating robots in large real world environments, especially using more than two homogeneous map scales. In this paper we present a biologically-inspired multi-scale mapping system mimicking the rodent multi-scale map. Unlike hybrid metric-topological multi-scale robot mapping systems, this new system is homogeneous, distinguishable only by scale, like rodent neural maps. We present methods for training each network to learn and recognize places at a specific spatial scale, and techniques for combining the output from each of these parallel networks. This approach differs from traditional probabilistic robotic methods, where place recognition spatial specificity is passively driven by models of sensor uncertainty. Instead we intentionally create parallel learning systems that learn associations between sensory input and the environment at different spatial scales. We also conduct a systematic series of experiments and parameter studies that determine the effect on performance of using different neural map scaling ratios and different numbers of discrete map scales. The results demonstrate that a multi-scale approach universally improves place recognition performance and is capable of producing better than state of the art performance compared to existing robotic navigation algorithms. We analyze the results and discuss the implications with respect to several recent discoveries and theories regarding how multi-scale neural maps are learnt and used in the mammalian brain.

Afocal optical flow sensor for reducing vertical height sensitivity in indoor robot localization and navigation.

This paper introduces a novel afocal optical flow sensor (OFS) system for odometry estimation in indoor robotic navigation. The OFS used in computer optical mouse has been adopted for mobile robots because it is not affected by wheel slippage. Vertical height variance is thought to be a dominant factor in systematic error when estimating moving distances in mobile robots driving on uneven surfaces. We propose an approach to mitigate this error by using an afocal (infinite effective focal length) system. We conducted experiments in a linear guide on carpet and three other materials with varying sensor heights from 30 to 50 mm and a moving distance of 80 cm. The same experiments were repeated 10 times. For the proposed afocal OFS module, a 1 mm change in sensor height induces a 0.1% systematic error; for comparison, the error for a conventional fixed-focal-length OFS module is 14.7%. Finally, the proposed afocal OFS module was installed on a mobile robot and tested 10 times on a carpet for distances of 1 m. The average distance estimation error and standard deviation are 0.02% and 17.6%, respectively, whereas those for a conventional OFS module are 4.09% and 25.7%, respectively.

Sonar sensor models and their application to mobile robot localization.

This paper presents a novel approach to mobile robot localization using sonar sensors. This approach is based on the use of particle filters. Each particle is augmented with local environment information which is updated during the mission execution. An experimental characterization of the sonar sensors used is provided in the paper. A probabilistic measurement model that takes into account the sonar uncertainties is defined according to the experimental characterization. The experimental results quantitatively evaluate the presented approach and provide a comparison with other localization strategies based on both the sonar and the laser. Some qualitative results are also provided for visual inspection.