Optic flow estimation on trajectories generated by bio-inspired closed-loop flight.

We generated panoramic imagery by simulating a fly-like robot carrying an imaging sensor, moving in free flight through a virtual arena bounded by walls, and containing obstructions. Flight was conducted under closed-loop control by a bio-inspired algorithm for visual guidance with feedback signals corresponding to the true optic flow that would be induced on an imager (computed by known kinematics and position of the robot relative to the environment). The robot had dynamics representative of a housefly-sized organism, although simplified to two-degree-of-freedom flight to generate uniaxial (azimuthal) optic flow on the retina in the plane of travel. Surfaces in the environment contained images of natural and man-made scenes that were captured by the moving sensor. Two bio-inspired motion detection algorithms and two computational optic flow estimation algorithms were applied to sequences of image data, and their performance as optic flow estimators was evaluated by estimating the mutual information between outputs and true optic flow in an equatorial section of the visual field. Mutual information for individual estimators at particular locations within the visual field was surprisingly low (less than 1 bit in all cases) and considerably poorer for the bio-inspired algorithms that the man-made computational algorithms. However, mutual information between weighted sums of these signals and comparable sums of the true optic flow showed significant increases for the bio-inspired algorithms, whereas such improvement did not occur for the computational algorithms. Such summation is representative of the spatial integration performed by wide-field motion-sensitive neurons in the third optic ganglia of flies.

Control theoretic interpretation of directional motion preferences in optic flow processing interneurons.

In this article, we formalize the processing of optic flow in identified fly lobula plate tangential cells and develop a control theoretic framework that suggests how the signals of these cells may be combined and used to achieve reflex-like navigation behavior. We show that this feedback gain synthesis task can be cast as a combined static state estimation and linear feedback control problem. Our framework allows us to analyze and determine the relationship between optic flow measurements and actuator commands, which greatly simplifies the implementation of biologically inspired control architectures on terrestrial and aerial robotic platforms.