Road User Position and Speed Estimation via Deep Learning from Calibrated Fisheye Videos.

In this paper, we present a deep learning processing flow aimed at Advanced Driving Assistance Systems (ADASs) for urban road users. We use a fine analysis of the optical setup of a fisheye camera and present a detailed procedure to obtain Global Navigation Satellite System (GNSS) coordinates along with the speed of the moving objects. The camera to world transform incorporates the lens distortion function. YOLOv4, re-trained with ortho-photographic fisheye images, provides road user detection. All the information extracted from the image by our system represents a small payload and can easily be broadcast to the road users. The results show that our system is able to properly classify and localize the detected objects in real time, even in low-light-illumination conditions. For an effective observation area of 20 m × 50 m, the error of the localization is in the order of one meter. Although an estimation of the velocities of the detected objects is carried out by offline processing with the FlowNet2 algorithm, the accuracy is quite good, with an error below one meter per second for urban speed range (0 to 15 m/s). Moreover, the almost ortho-photographic configuration of the imaging system ensures that the anonymity of all street users is guaranteed.

Contextual Detection of Pedestrians and Vehicles in Orthophotography by Fusion of Deep Learning Algorithms.

In the context of smart cities, monitoring pedestrian and vehicle movements is essential to recognize abnormal events and prevent accidents. The proposed method in this work focuses on analyzing video streams captured from a vertically installed camera, and performing contextual road user detection. The final detection is based on the fusion of the outputs of three different convolutional neural networks. We are simultaneously interested in detecting road users, their motion, and their location respecting the static environment. We use YOLOv4 for object detection, FC-HarDNet for background semantic segmentation, and FlowNet 2.0 for motion detection. FC-HarDNet and YOLOv4 were retrained with our orthophotographs dataset. The last step involves a data fusion module. The presented results show that the method allows one to detect road users, identify the surfaces on which they move, quantify their apparent velocity, and estimate their actual velocity.

Series AC Arc Fault Detection Method Based on High-Frequency Coupling Sensor and Convolution Neural Network.

Arc faults induced by residential low-voltage distribution network lines are still one of the main causes of residential fires. When a series arc fault occurs on the line, the value of the fault current in the circuit is limited by the load. Traditional circuit protection devices cannot detect series arcs and generate a trip signal to implement protection. This paper proposes a novel high-frequency coupling sensor for extracting the features of low-voltage series arc faults. This sensor is used to collect the high-frequency feature signals of various loads in series arc state and normal working state. The signal will be transformed into two-dimensional feature gray images according to the temporal-domain sequence. A neural network with a three-layer structure based on convolution neural network is designed, trained and tested using the various typical loads' arc states and normal states data sets composed of these images. This detection method can simultaneously accurately identify series arc, as well as the load type. Seven different domestic appliances were selected for experimental verification, including a desktop computer, vacuum cleaner, induction cooker, fluorescent lamp, dimmer, heater and electric drill. Then, the stability and universality of the detection algorithm is also verified by using electronic load with adjustable power factor and peak factor. The experimental results show that the designed sensor has the advantages of simple structure and wide frequency response range. The detection algorithm comparison confirms that the classification accuracy of the seven domestic appliances' work states in the fourteen categories could reach 98.36%. The adjustable load in the two categories could reach above 99%. The feasibility of hardware implementation based on FPGA of this method is also evaluated.