Data-driven artificial and spiking neural networks for inverse kinematics in neurorobotics.

Inverse kinematics is fundamental for computational motion planning. It is used to derive an appropriate state in a robot's configuration space, given a target position in task space. In this work, we investigate the performance of fully connected and residual artificial neural networks as well as recurrent, learning-based, and deep spiking neural networks for conventional and geometrically constrained inverse kinematics. We show that while highly parameterized data-driven neural networks with tens to hundreds of thousands of parameters exhibit sub-ms inference time and sub-mm accuracy, learning-based spiking architectures can provide reasonably good results with merely a few thousand neurons. Moreover, we show that spiking neural networks can perform well in geometrically constrained task space, even when configured to an energy-conserved spiking rate, demonstrating their robustness. Neural networks were evaluated on NVIDIA's Xavier and Intel's neuromorphic Loihi chip.

LiDAR-driven spiking neural network for collision avoidance in autonomous driving.

Facilitated by advances in real-time sensing, low and high-level control, and machine learning, autonomous vehicles draw ever-increasing attention from many branches of knowledge. Neuromorphic (brain-inspired) implementation of robotic control has been shown to outperform conventional control paradigms in terms of energy efficiency, robustness to perturbations, and adaptation to varying conditions. Here we propose LiDAR-driven neuromorphic control of both vehicle's speed and steering. We evaluated and compared neuromorphic PID control and online learning for autonomous vehicle control in static and dynamic environments, finally suggesting proportional learning as a preferred control scheme. We employed biologically plausible basal-ganglia and thalamus neural models for steering and collision-avoidance, finally extending them to support a null controller and a target-reaching optimization, significantly increasing performance.

Neuromorphic NEF-Based Inverse Kinematics and PID Control.

Neuromorphic implementation of robotic control has been shown to outperform conventional control paradigms in terms of robustness to perturbations and adaptation to varying conditions. Two main ingredients of robotics are inverse kinematic and Proportional-Integral-Derivative (PID) control. Inverse kinematics is used to compute an appropriate state in a robot's configuration space, given a target position in task space. PID control applies responsive correction signals to a robot's actuators, allowing it to reach its target accurately. The Neural Engineering Framework (NEF) offers a theoretical framework for a neuromorphic encoding of mathematical constructs with spiking neurons for the implementation of functional large-scale neural networks. In this work, we developed NEF-based neuromorphic algorithms for inverse kinematics and PID control, which we used to manipulate 6 degrees of freedom robotic arm. We used online learning for inverse kinematics and signal integration and differentiation for PID, offering high performing and energy-efficient neuromorphic control. Algorithms were evaluated in simulation as well as on Intel's Loihi neuromorphic hardware.