Fully automated structured light scanning for high-fidelity 3D reconstruction via graph optimization.

Convenient and high-fidelity 3D model reconstruction is crucial for industries like manufacturing, medicine and archaeology. Current scanning approaches struggle with high manual costs and the accumulation of errors in large-scale modeling. This paper is dedicated to achieving industrial-grade seamless and high-fidelity 3D reconstruction with minimal manual intervention. The innovative method proposed transforms the multi-frame registration into a graph optimization problem, addressing the issue of error accumulation encountered in frame-by-frame registration. Initially, a global consistency cost is established based on point cloud cross-multipath registration, followed by using the geometric and color differences of corresponding points as dynamic nonlinear weights. Finally, the iteratively reweighted least squares (IRLS) method is adopted to perform the bundle adjustment (BA) optimization of all poses. Significantly enhances registration accuracy and robustness under the premise of maintaining near real-time efficiency. Additionally, for generating watertight, seamless surface models, a local-to-global transitioning strategy for multiframe fusion is introduced. This method facilitates efficient correction of normal vector consistency, addressing mesh discontinuities in surface reconstruction resulting from normal flips. To validate our algorithm, we designed a 3D reconstruction platform enabling spatial viewpoint transformations. We collected extensive real and simulated model data. These datasets were rigorously evaluated against advanced methods, roving the effectiveness of our approach. Our data and implementation is made available on GitHub for community development.

Extrinsic calibration for multi-LiDAR systems involving heterogeneous laser scanning models.

In the realm of autonomous driving, there is a pressing demand for heightened perceptual capabilities, giving rise to a plethora of multisensory solutions. Among these, multi-LiDAR systems have gained significant popularity. Within the spectrum of available combinations, the integration of repetitive and non-repetitive LiDAR configurations emerges as a balanced approach, offering a favorable trade-off between sensing range and cost. However, the calibration of such systems remains a challenge due to the diverse nature of point clouds, low-common-view, and distinct densities. This study proposed a novel targetless calibration algorithm for extrinsic calibration between Hybrid-Solid-State-LiDAR(SSL) and Mechanical-LiDAR systems, each employing different scanning modes. The algorithm harnesses planar features within the scene to construct matching costs, while proposing the adoption of the Gaussian Mixture Model (GMM) to address outliers, thereby mitigating the issue of overlapping points. Dynamic trust-region-based optimization is incorporated during iterative processes to enhance nonlinear convergence speed. Comprehensive evaluations across diverse simulated and real-world scenarios affirm the robustness and precision of our algorithm, outperforming current state-of-the-art methods.

Laser reflectance feature assisted accurate extrinsic calibration for non-repetitive scanning LiDAR and camera systems.

Non-repetitive scanning Light Detection And Ranging(LiDAR)-Camera systems are commonly used in autonomous navigation industries, benefiting from their low-cost and high-perception characteristics. However, due to the irregular scanning pattern of LiDAR, feature extraction on point cloud encounters the problem of non-uniformity distribution of density and reflectance intensity, accurate extrinsic calibration remains a challenging task. To solve this problem, this paper presented an open-source calibration method using only a printed chessboard. We designed a two-stage coarse-to-fine pipeline for 3D corner extraction. Firstly, a Gaussian Mixture Model(GMM)-based intensity cluster approach is proposed to adaptively identify point segments in different color blocks of the chessboard. Secondly, a novel Iterative Lowest-cost Pose(ILP) algorithm is designed to fit the chessboard grid and refine the 3D corner iteratively. This scheme is unique for turning the corner feature extraction problem into a grid align problem. After the corresponding 3D-2D points are solved, by applying the PnP(Perspective-n-Point) method, along with nonlinear-optimization refinement, the extrinsic parameters are obtained. Extensive simulation and real-world experimental results show that our method achieved subpixel-level precision in terms of reprojection error. The comparison demonstrated that the effectiveness and accuracy of the proposed method outperformed existing methods.

Feature homogenization strategy using optical flow for vision-related simultaneous localization and mapping in a complex environment.

Vision-related state estimation usually extracts multiple feature points from images captured by the camera. In this paper, we propose a robust feature homogenization method for resolving the problem of feature clustering. The proposed method deduced the depth of feature points from optical flow magnitude, and the homogenization of feature points was acquired by adaptively enforcing the minimum distance between neighboring feature points. With the assistance of optical flow, the proposed method develops a preference for feature points with smaller depths in feature homogenization. Experimental results show that the proposed method improves the system's global consistency and tracking stability by using optical flow information.

Target classification of multislit streak tube imaging lidar based on deep learning.

To reduce the impact of the image reconstruction process and improve the identification efficiency of the multislit streak tube imaging lidar (MS-STIL) system, an object classification method based on the echo of the MS-STIL system is proposed. A streak image data set is constructed that contains a total of 240 common outdoor targets in 6 categories. Additionally, the deep-learning network model based on ResNet is chosen to implement streak image classification. The effects of two classification methods based on streak images and reconstructed depth images are compared. To verify the maximum classification capability of the proposed method, the recognition effects are investigated under 6 and 20 classes. The results show that the classification accuracy decreases from 99.42% to 67.64%. After the data set is expanded, the classification accuracy improved to 85.35% when the class number of the target is 20.

Denoising of the multi-slit streak tube imaging LiDAR system using a faster non-local mean method.

Combined with the characteristic of the multi-slit streak tube imaging LiDAR (MS-STIL) system where the imaging areas corresponding to each slit do not interfere with each other, we denoised the streak images by an improved fast non-local mean filtering algorithm. Experiments were performed to investigate the effectiveness of the method. The experimental results show that the spatial resolution of the system is improved from 22 to 16 mm; the relative distance error is reduced by an average of 22.76%; and the intensity accuracy improved significantly when the distance is 10 m. Additionally, the overall denoising effect is comprehensively verified by long-range target imaging. The mean square error of the reconstructed depth image and intensity image are reduced from 0.0836, 0.0067 to 0.0433, 0.0037, respectively. The applicability of the proposed method was verified through comparative experiments in different environments.