Angle-dependent spectral reflectance material dataset based on 945 nm time-of-flight camera measurements.

The main objective of this article is to provide angle-dependent spectral reflectance measurements of various materials in the near infrared spectrum. In contrast to already existing reflectance libraries, e.g., NASA ECOSTRESS and Aster reflectance libraries, which consider only perpendicular reflectance measurements, the presented dataset includes angular resolution of the material reflectance. To conduct the angle-dependent spectral reflectance material measurements, a new measurement device based on a 945 nm time-of-flight camera is used, which was calibrated using Lambertian targets with defined reflectance values at 10, 50, and 95%. The spectral reflectance material measurements are taken for an angle range of 0° to 80° with 10° incremental steps and stored in table format. The developed dataset is categorized with a novel material classification, divided into four different levels of detail considering material properties and distinguishing predominantly between mutually exclusive material classes (level 1) and material types (level 2). The dataset is published open access on the open repository Zenodo with record number 7467552 and version 1.0.1 [1]. Currently, the dataset contains 283 measurements and is continuously extended in new versions on Zenodo.

Development and Experimental Validation of an Intelligent Camera Model for Automated Driving.

The virtual testing and validation of advanced driver assistance system and automated driving (ADAS/AD) functions require efficient and realistic perception sensor models. In particular, the limitations and measurement errors of real perception sensors need to be simulated realistically in order to generate useful sensor data for the ADAS/AD function under test. In this paper, a novel sensor modeling approach for automotive perception sensors is introduced. The novel approach combines kernel density estimation with regression modeling and puts the main focus on the position measurement errors. The modeling approach is designed for any automotive perception sensor that provides position estimations at the object level. To demonstrate and evaluate the new approach, a common state-of-the-art automotive camera (Mobileye 630) was considered. Both sensor measurements (Mobileye position estimations) and ground-truth data (DGPS positions of all attending vehicles) were collected during a large measurement campaign on a Hungarian highway to support the development and experimental validation of the new approach. The quality of the model was tested and compared to reference measurements, leading to a pointwise position error of 9.60% in the lateral and 1.57% in the longitudinal direction. Additionally, the modeling of the natural scattering of the sensor model output was satisfying. In particular, the deviations of the position measurements were well modeled with this approach.

Configurable Sensor Model Architecture for the Development of Automated Driving Systems.

Sensor models provide the required environmental perception information for the development and testing of automated driving systems in virtual vehicle environments. In this article, a configurable sensor model architecture is introduced. Based on methods of model-based systems engineering (MBSE) and functional decomposition, this approach supports a flexible and continuous way to use sensor models in automotive development. Modeled sensor effects, representing single-sensor properties, are combined to an overall sensor behavior. This improves reusability and enables adaptation to specific requirements of the development. Finally, a first practical application of the configurable sensor model architecture is demonstrated, using two exemplary sensor effects: the geometric field of view (FoV) and the object-dependent FoV.

Fault Detection, Isolation, Identification and Recovery (FDIIR) Methods for Automotive Perception Sensors Including a Detailed Literature Survey for Lidar.

Perception sensors such as camera, radar, and lidar have gained considerable popularity in the automotive industry in recent years. In order to reach the next step towards automated driving it is necessary to implement fault diagnosis systems together with suitable mitigation solutions in automotive perception sensors. This is a crucial prerequisite, since the quality of an automated driving function strongly depends on the reliability of the perception data, especially under adverse conditions. This publication presents a systematic review on faults and suitable detection and recovery methods for automotive perception sensors and suggests a corresponding classification schema. A systematic literature analysis has been performed with focus on lidar in order to review the state-of-the-art and identify promising research opportunities. Faults related to adverse weather conditions have been studied the most, but often without providing suitable recovery methods. Issues related to sensor attachment and mechanical damage of the sensor cover were studied very little and provide opportunities for future research. Algorithms, which use the data stream of a single sensor, proofed to be a viable solution for both fault detection and recovery.

Automotive Lidar Modelling Approach Based on Material Properties and Lidar Capabilities.

Development and validation of reliable environment perception systems for automated driving functions requires the extension of conventional physical test drives with simulations in virtual test environments. In such a virtual test environment, a perception sensor is replaced by a sensor model. A major challenge for state-of-the-art sensor models is to represent the large variety of material properties of the surrounding objects in a realistic manner. Since lidar sensors are considered to play an essential role for upcoming automated vehicles, this paper presents a new lidar modelling approach that takes material properties and corresponding lidar capabilities into account. The considered material property is the incidence angle dependent reflectance of the illuminated material in the infrared spectrum and the considered lidar property its capability to detect a material with a certain reflectance up to a certain range. A new material classification for lidar modelling in the automotive context is suggested, distinguishing between 7 material classes and 23 subclasses. To measure angle dependent reflectance in the infrared spectrum, a new measurement device based on a time of flight camera is introduced and calibrated using Lambertian targets with defined reflectance values at 10 % , 50 % , and 95 % . Reflectance measurements of 9 material subclasses are presented and 488 spectra from the NASA ECOSTRESS library are considered to evaluate the new measurement device. The parametrisation of the lidar capabilities is illustrated by presenting a lidar measurement campaign with a new Infineon lidar prototype and relevant data from 12 common lidar types.

Sea ice drift data for Fram Strait derived from a feature-tracking algorithm applied on Sentinel-1 SAR imagery.

1541 Sentinel-1 SAR images, acquired over Fram Strait between 2014 and 2016, were considered for sea ice drift retrieval using an open-source feature tracking algorithm. Based on this SAR image data set, 2026 and 3120 image pairs in HH and HV polarisation were used to calculate monthly mean sea ice velocities at 79 N.

GPS data from sea ice trackers deployed in Fram Strait in 2016.

Three GPS trackers have been deployed on sea ice in Fram Strait collecting GPS positions between 7th July 2016 until 10th September 2016 with an interval between 5 and 30 min. For an easy understanding and usage, corresponding satellite images and python scripts are added to the GPS data.