Feasibility of Hyperspectral Single Photon Lidar for Robust Autonomous Vehicle Perception.

Autonomous vehicle perception systems typically rely on single-wavelength lidar sensors to obtain three-dimensional information about the road environment. In contrast to cameras, lidars are unaffected by challenging illumination conditions, such as low light during night-time and various bidirectional effects changing the return reflectance. However, as many commercial lidars operate on a monochromatic basis, the ability to distinguish objects based on material spectral properties is limited. In this work, we describe the prototype hardware for a hyperspectral single photon lidar and demonstrate the feasibility of its use in an autonomous-driving-related object classification task. We also introduce a simple statistical model for estimating the reflectance measurement accuracy of single photon sensitive lidar devices. The single photon receiver frame was used to receive 30 12.3 nm spectral channels in the spectral band 1200-1570 nm, with a maximum channel-wise intensity of 32 photons. A varying number of frames were used to accumulate the signal photon count. Multiple objects covering 10 different categories of road environment, such as car, dry asphalt, gravel road, snowy asphalt, wet asphalt, wall, granite, grass, moss, and spruce tree, were included in the experiments. We test the influence of the number of spectral channels and the number of frames on the classification accuracy with random forest classifier and find that the spectral information increases the classification accuracy in the high-photon flux regime from 50% to 94% with 2 channels and 30 channels, respectively. In the low-photon flux regime, the classification accuracy increases from 30% to 38% with 2 channels and 6 channels, respectively. Additionally, we visualize the data with the t-SNE algorithm and show that the photon shot noise in the single photon sensitive hyperspectral data contributes the most to the separability of material specific spectral signatures. The results of this study provide support for the use of hyperspectral single photon lidar data on more advanced object detection and classification methods, and motivates the development of advanced single photon sensitive hyperspectral lidar devices for use in autonomous vehicles and in robotics.

Improving distribution models of riparian vegetation with mobile laser scanning and hydraulic modelling.

This study aimed at illustrating how direct measurements, mobile laser scanning and hydraulic modelling can be combined to quantify environmental drivers, improve vegetation models and increase our understanding of vegetation patterns in a sub-arctic river valley. Our results indicate that the resultant vegetation models successfully predict riparian vegetation patterns (Rho = 0.8 for total species richness, AUC = 0.97 for distribution) and highlight differences between eight functional species groups (Rho 0.46-0.84; AUC 0.79-0.93; functional group-specific effects). In our study setting, replacing the laser scanning-based and hydraulic modelling-based variables with a proxy variable elevation did not significantly weaken the models. However, using directly measured and modelled variables allows relating species patterns to e.g. stream power or the length of the flood-free period. Substituting these biologically relevant variables with proxies mask important processes and may reduce the transferability of the results into other sites. At the local scale, the amount of litter is a highly important driver of total species richness, distribution and abundance patterns (relative influences 49, 72 and 83%, respectively) and across all functional groups (13-57%; excluding lichen species richness) in the sub-arctic river valley. Moreover, soil organic matter and soil water content shape vegetation patterns (on average 16 and 7%, respectively). Fluvial disturbance is a key limiting factor only for lichen, bryophyte and dwarf shrub species in this environment (on average 37, 6 and 10%, respectively). Fluvial disturbance intensity is the most important component of disturbance for most functional groups while the length of the disturbance-free period is more relevant for lichens. We conclude that striving for as accurate quantifications of environmental drivers as possible may reveal important processes and functional group differences and help anticipate future changes in vegetation. Mobile laser scanning, high-resolution digital elevation models and hydraulic modelling offer useful methodology for improving correlative vegetation models.

NAVIS-An UGV indoor positioning system using laser scan matching for large-area real-time applications.

Laser scan matching with grid-based maps is a promising tool for real-time indoor positioning of mobile Unmanned Ground Vehicles (UGVs). While there are critical implementation problems, such as the ability to estimate the position by sensing the unknown indoor environment with sufficient accuracy and low enough latency for stable vehicle control, further development work is necessary. Unfortunately, most of the existing methods employ heuristics for quick positioning in which numerous accumulated errors easily lead to loss of positioning accuracy. This severely restricts its applications in large areas and over lengthy periods of time. This paper introduces an efficient real-time mobile UGV indoor positioning system for large-area applications using laser scan matching with an improved probabilistically-motivated Maximum Likelihood Estimation (IMLE) algorithm, which is based on a multi-resolution patch-divided grid likelihood map. Compared with traditional methods, the improvements embodied in IMLE include: (a) Iterative Closed Point (ICP) preprocessing, which adaptively decreases the search scope; (b) a totally brute search matching method on multi-resolution map layers, based on the likelihood value between current laser scan and the grid map within refined search scope, adopted to obtain the global optimum position at each scan matching; and (c) a patch-divided likelihood map supporting a large indoor area. A UGV platform called NAVIS was designed, manufactured, and tested based on a low-cost robot integrating a LiDAR and an odometer sensor to verify the IMLE algorithm. A series of experiments based on simulated data and field tests with NAVIS proved that the proposed IMEL algorithm is a better way to perform local scan matching that can offer a quick and stable positioning solution with high accuracy so it can be part of a large area localization/mapping, application. The NAVIS platform can reach an updating rate of 12 Hz in a feature-rich environment and 2 Hz even in a feature-poor environment, respectively. Therefore, it can be utilized in a real-time application.

Possibilities of a personal laser scanning system for forest mapping and ecosystem services.

A professional-quality, personal laser scanning (PLS) system for collecting tree attributes was demonstrated in this paper. The applied system, which is wearable by human operators, consists of a multi-constellation navigation system and an ultra-high-speed phase-shift laser scanner mounted on a rigid baseplate and consisting of a single sensor block. A multipass-corridor-mapping method was developed to process PLS data and a 2,000 m2 forest plot was utilized in the test. The tree stem detection accuracy was 82.6%; the root mean square error (RMSE) of the estimates of tree diameter at breast height (DBH) was 5.06 cm; the RMSE of the estimates of tree location was 0.38 m. The relative RMSE of the DBH estimates was 14.63%. The results showed, for the first time, the potential of the PLS system in mapping large forest plots. Further research on mapping accuracy in various forest conditions, data correction methods and multi-sensoral positioning techniques is needed. The utilization of this system in different applications, such as harvester operations, should also be explored. In addition to collecting tree-level and plot-level data for forest inventory, other possible applications of PLS for forest ecosystem services include mapping of canopy gaps, measuring leaf area index of large areas, documenting and visualizing forest routes feasible for recreation, hiking and berry and mushroom picking.

Tree height growth measurement with single-scan airborne, static terrestrial and mobile laser scanning.

This study explores the feasibility of applying single-scan airborne, static terrestrial and mobile laser scanning for improving the accuracy of tree height growth measurement. Specifically, compared to the traditional works on forest growth inventory with airborne laser scanning, two issues are regarded: "Can the new technique characterize the height growth for each individual tree?" and "Can this technique refine the minimum growth-discernable temporal interval further?" To solve these two puzzles, the sampling principles of the three laser scanning modes were first examined, and their error sources against the task of tree-top capturing were also analyzed. Next, the three-year growths of 58 Nordic maple trees (Crimson King) for test were intermittently surveyed with one type of laser scanning each time and then analyzed by statistics. The evaluations show that the height growth of each individual tree still cannot be reliably characterized even by single-scan terrestrial laser scanning, and statistical analysis is necessary in this scenario. After Gaussian regression, it is found that the minimum temporal interval with distinguishable tree height growths can be refined into one month based on terrestrial laser scanning, far better than the two years deduced in the previous works based on airborne laser scanning. The associated mean growth was detected to be about 0.12 m. Moreover, the parameter of tree height generally under-estimated by airborne and even mobile laser scanning can be relatively revised by means of introducing static terrestrial laser scanning data. Overall, the effectiveness of the proposed technique is primarily validated.

Tree classification with fused mobile laser scanning and hyperspectral data.

Mobile Laser Scanning data were collected simultaneously with hyperspectral data using the Finnish Geodetic Institute Sensei system. The data were tested for tree species classification. The test area was an urban garden in the City of Espoo, Finland. Point clouds representing 168 individual tree specimens of 23 tree species were determined manually. The classification of the trees was done using first only the spatial data from point clouds, then with only the spectral data obtained with a spectrometer, and finally with the combined spatial and hyperspectral data from both sensors. Two classification tests were performed: the separation of coniferous and deciduous trees, and the identification of individual tree species. All determined tree specimens were used in distinguishing coniferous and deciduous trees. A subset of 133 trees and 10 tree species was used in the tree species classification. The best classification results for the fused data were 95.8% for the separation of the coniferous and deciduous classes. The best overall tree species classification succeeded with 83.5% accuracy for the best tested fused data feature combination. The respective results for paired structural features derived from the laser point cloud were 90.5% for the separation of the coniferous and deciduous classes and 65.4% for the species classification. Classification accuracies with paired hyperspectral reflectance value data were 90.5% for the separation of coniferous and deciduous classes and 62.4% for different species. The results are among the first of their kind and they show that mobile collected fused data outperformed single-sensor data in both classification tests and by a significant margin.

Retrieval Algorithms for Road Surface Modelling Using Laser-Based Mobile Mapping.

Automated processing of the data provided by a laser-based mobile mapping system will be a necessity due to the huge amount of data produced. In the future, vehiclebased laser scanning, here called mobile mapping, should see considerable use for road environment modelling. Since the geometry of the scanning and point density is different from airborne laser scanning, new algorithms are needed for information extraction. In this paper, we propose automatic methods for classifying the road marking and kerbstone points and modelling the road surface as a triangulated irregular network. On the basis of experimental tests, the mean classification accuracies obtained using automatic method for lines, zebra crossings and kerbstones were 80.6%, 92.3% and 79.7%, respectively.