Recent advances in insect vision in a 3D world: looming stimuli and escape behaviour.

Detecting looming motion directly towards the insect is vital to its survival. Looming detection in two insects, flies and locusts, is described and contrasted. Pathways using looming detectors to trigger action and their topographical layout in the brain is explored in relation to facilitating behavioural selection. Similar visual stimuli, such as looming motion, are processed by nearby glomeruli in the brain. Insect-inspired looming motion detectors are combined to detect and avoid collision in different scenarios by robots, vehicles and unmanned aerial vehicle (UAV)s.

The complex synaptic pathways onto a looming-detector neuron revealed using serial block-face scanning electron microscopy.

The ability of locusts to detect looming stimuli and avoid collisions or predators depends on a neuronal circuit in the locust's optic lobe. Although comprehensively studied for over three decades, there are still major questions about the computational steps of this circuit. We used fourth instar larvae of Locusta migratoria to describe the connection between the lobula giant movement detector 1 (LGMD1) neuron in the lobula complex and the upstream neuropil, the medulla. Serial block-face scanning electron microscopy (SBEM) was used to characterize the morphology of the connecting neurons termed trans-medullary afferent (TmA) neurons and their synaptic connectivity. This enabled us to trace neurons over several hundred micrometers between the medulla and the lobula complex while identifying their synapses. We traced two different TmA neurons, each from a different individual, from their synapses with the LGMD in the lobula complex up into the medulla and describe their synaptic relationships. There is not a simple downstream transmission of the signal from a lamina neuron onto these TmA neurons; there is also a feedback loop in place with TmA neurons making outputs as well as receiving inputs. More than one type of neuron shapes the signal of the TmA neurons in the medulla. We found both columnar and trans-columnar neurons connected with the traced TmA neurons in the medulla. These findings indicate that there are computational steps in the medulla that have not been included in models of the neuronal pathway for looming detection.

A Robust Collision Perception Visual Neural Network With Specific Selectivity to Darker Objects.

Building an efficient and reliable collision perception visual system is a challenging problem for future robots and autonomous vehicles. The biological visual neural networks, which have evolved over millions of years in nature and are working perfectly in the real world, could be ideal models for designing artificial vision systems. In the locust's visual pathways, a lobula giant movement detector (LGMD), that is, the LGMD2, has been identified as a looming perception neuron that responds most strongly to darker approaching objects relative to their backgrounds; similar situations which many ground vehicles and robots are often faced with. However, little has been done on modeling the LGMD2 and investigating its potential in robotics and vehicles. In this article, we build an LGMD2 visual neural network which possesses the similar collision selectivity of an LGMD2 neuron in locust via the modeling of biased-ON and -OFF pathways splitting visual signals into parallel ON/OFF channels. With stronger inhibition (bias) in the ON pathway, this model responds selectively to darker looming objects. The proposed model has been tested systematically with a range of stimuli including real-world scenarios. It has also been implemented in a micro-mobile robot and tested with real-time experiments. The experimental results have verified the effectiveness and robustness of the proposed model for detecting darker looming objects against various dynamic and cluttered backgrounds.

Burst Firing in Bee Gustatory Neurons Prevents Adaptation.

Animals detect changes in the environment using modality-specific, peripheral sensory neurons. The insect gustatory system encodes tastant identity and concentration through the independent firing of gustatory receptor neurons (GRNs) that spike rapidly at stimulus onset and quickly adapt. Here, we show the first evidence that concentrated sugar evokes a temporally structured burst pattern of spiking involving two GRNs within the gustatory sensilla of bumblebees. Bursts of spikes resulted when a sucrose-activated GRN was inhibited by another GRN at a frequency of ∼22 Hz during the first 1 s of stimulation. Pharmacological blockade of gap junctions abolished bursting, indicating that bee GRNs have electrical synapses that produce a temporal pattern of spikes when one GRN is activated by a sugar ligand. Bursting permitted bee GRNs to maintain a high rate of spiking and to exhibit the slowest rate of adaptation of any insect species. Feeding bout duration correlated with coherent bursting; only sugar concentrations that produced bursting evoked the bumblebee's feeding reflex. Volume of solution imbibed was a direct function of time in contact with food. We propose that gap junctions among GRNs enable a sustained rate of GRN spiking that is necessary to drive continuous feeding by the bee proboscis.

Two identified looming detectors in the locust: ubiquitous lateral connections among their inputs contribute to selective responses to looming objects.

In locusts, two lobula giant movement detector neurons (LGMDs) act as looming object detectors. Their reproducible responses to looming and their ethological significance makes them models for single neuron computation. But there is no comprehensive picture of the neurons that connect directly to each LGMD. We used high-through-put serial block-face scanning-electron-microscopy to reconstruct the network of input-synapses onto the LGMDs over spatial scales ranging from single synapses and small circuits, up to dendritic branches and total excitatory input. Reconstructions reveal that many trans-medullary-afferents (TmAs) connect the eye with each LGMD, one TmA per facet per LGMD. But when a TmA synapses with an LGMD it also connects laterally with another TmA. These inter-TmA synapses are always reciprocal. Total excitatory input to the LGMD 1 and 2 comes from 131,000 and 186,000 synapses reaching densities of 3.1 and 2.6 synapses per µm2 respectively. We explored the computational consequences of reciprocal synapses between each TmA and 6 others from neighbouring columns. Since any lateral interactions between LGMD inputs have always been inhibitory we may assume these reciprocal lateral connections are most likely inhibitory. Such reciprocal inhibitory synapses increased the LGMD's selectivity for looming over passing objects, particularly at the beginning of object approach.

Optimizing the 3D-reconstruction technique for serial block-face scanning electron microscopy.

BACKGROUND: Elucidating the anatomy of neuronal circuits and localizing the synaptic connections between neurons, can give us important insights in how the neuronal circuits work. We are using serial block-face scanning electron microscopy (SBEM) to investigate the anatomy of a collision detection circuit including the Lobula Giant Movement Detector (LGMD) neuron in the locust, Locusta migratoria. For this, thousands of serial electron micrographs are produced that allow us to trace the neuronal branching pattern. NEW METHOD: The reconstruction of neurons was previously done manually by drawing cell outlines of each cell in each image separately. This approach was very time consuming and troublesome. To make the process more efficient a new interactive software was developed. It uses the contrast between the neuron under investigation and its surrounding for semi-automatic segmentation. RESULTS: For segmentation the user sets starting regions manually and the algorithm automatically selects a volume within the neuron until the edges corresponding to the neuronal outline are reached. Internally the algorithm optimizes a 3D active contour segmentation model formulated as a cost function taking the SEM image edges into account. This reduced the reconstruction time, while staying close to the manual reference segmentation result. COMPARISON WITH EXISTING METHODS: Our algorithm is easy to use for a fast segmentation process, unlike previous methods it does not require image training nor an extended computing capacity. CONCLUSION: Our semi-automatic segmentation algorithm led to a dramatic reduction in processing time for the 3D-reconstruction of identified neurons.

A look into the cockpit of the developing locust: looming detectors and predator avoidance.

For many animals, the visual detection of looming stimuli is crucial at any stage of their lives. For example, human babies of only 6 days old display evasive responses to looming stimuli (Bower et al. [1971]: Percept Psychophys 9: 193-196). This means the neuronal pathways involved in looming detection should mature early in life. Locusts have been used extensively to examine the neural circuits and mechanisms involved in sensing looming stimuli and triggering visually evoked evasive actions, making them ideal subjects in which to investigate the development of looming sensitivity. Two lobula giant movement detectors (LGMD) neurons have been identified in the lobula region of the locust visual system: the LGMD1 neuron responds selectively to looming stimuli and provides information that contributes to evasive responses such as jumping and emergency glides. The LGMD2 responds to looming stimuli and shares many response properties with the LGMD1. Both neurons have only been described in the adult. In this study, we describe a practical method combining classical staining techniques and 3D neuronal reconstructions that can be used, even in small insects, to reveal detailed anatomy of individual neurons. We have used it to analyze the anatomy of the fan-shaped dendritic tree of the LGMD1 and the LGMD2 neurons in all stages of the post-embryonic development of Locusta migratoria. We also analyze changes seen during the ontogeny of escape behaviors triggered by looming stimuli, specially the hiding response.

Looming detection by identified visual interneurons during larval development of the locust Locusta migratoria.

Insect larvae clearly react to visual stimuli, but the ability of any visual neuron in a newly hatched insect to respond selectively to particular stimuli has not been directly tested. We characterised a pair of neurons in locust larvae that have been extensively studied in adults, where they are known to respond selectively to objects approaching on a collision course: the lobula giant motion detector (LGMD) and its postsynaptic partner, the descending contralateral motion detector (DCMD). Our physiological recordings of DCMD axon spikes reveal that at the time of hatching, the neurons already respond selectively to objects approaching the locust and they discriminate between stimulus approach speeds with differences in spike frequency. For a particular approaching stimulus, both the number and peak frequency of spikes increase with instar. In contrast, the number of spikes in responses to receding stimuli decreases with instar, so performance in discriminating approaching from receding stimuli improves as the locust goes through successive moults. In all instars, visual movement over one part of the visual field suppresses a response to movement over another part. Electron microscopy demonstrates that the anatomical substrate for the selective response to approaching stimuli is present in all larval instars: small neuronal processes carrying information from the eye make synapses both onto LGMD dendrites and with each other, providing pathways for lateral inhibition that shape selectivity for approaching objects.

Predator versus prey: locust looming-detector neuron and behavioural responses to stimuli representing attacking bird predators.

Many arthropods possess escape-triggering neural mechanisms that help them evade predators. These mechanisms are important neuroethological models, but they are rarely investigated using predator-like stimuli because there is often insufficient information on real predator attacks. Locusts possess uniquely identifiable visual neurons (the descending contralateral movement detectors, DCMDs) that are well-studied looming motion detectors. The DCMDs trigger 'glides' in flying locusts, which are hypothesised to be appropriate last-ditch responses to the looms of avian predators. To date it has not been possible to study glides in response to stimuli simulating bird attacks because such attacks have not been characterised. We analyse video of wild black kites attacking flying locusts, and estimate kite attack speeds of 10.8±1.4 m/s. We estimate that the loom of a kite's thorax towards a locust at these speeds should be characterised by a relatively low ratio of half size to speed (l/|v|) in the range 4-17 ms. Peak DCMD spike rate and gliding response occurrence are known to increase as l/|v| decreases for simple looming shapes. Using simulated looming discs, we investigate these trends and show that both DCMD and behavioural responses are strong to stimuli with kite-like l/|v| ratios. Adding wings to looming discs to produce a more realistic stimulus shape did not disrupt the overall relationships of DCMD and gliding occurrence to stimulus l/|v|. However, adding wings to looming discs did slightly reduce high frequency DCMD spike rates in the final stages of object approach, and slightly delay glide initiation. Looming discs with or without wings triggered glides closer to the time of collision as l/|v| declined, and relatively infrequently before collision at very low l/|v|. However, the performance of this system is in line with expectations for a last-ditch escape response.

Developmental studies of transgenic maize expressing Cry1Ab on the African stem borer, Busseola fusca; effects on midgut cellular structure.

BACKGROUND: Busseola fusca is a major pest of maize in Africa but unfortunately is difficult to control using chemical insecticides. Insect-resistant transgenic crops may provide an alternative viable strategy to control this pest. RESULTS: Recombinant Cry1Ab (1%) reduced larval weight by 60% over the trial period, while larval weight in the control group increased by 25%; no effects on mortality were observed. Insect survival, developmental rate and pupal and adult weight were significantly reduced (P < 0.05) on maize expressing Cry1Ab (MON810) compared with the non-transformed parental line. These differences were more pronounced with second-instar larvae than with third-instar larvae. Leaf area consumed by Bacillus thuringiensis (Bt)-fed larvae was significantly lower (0.5 cm(2) larva(-1) day(-1)) compared with the area consumed by control-fed insects (3.3 cm(2) larva(-1) day(-1)). EM studies revealed that consumption of Bt maize deleteriously affected gut integrity. Effects were observed in columnar cells of the midgut epithelium, with the cytoplasm becoming highly vacuolated; the microvilli were disorganised, the mitochondria were abnormal and there was an increase in the number of lysosomal bodies. The rough endoplasmic reticulum had also become dilated. CONCLUSION: This study confirms the potential for Bt maize, when used as part of an IPM programme, for control of B. fusca.

Structural organization of the presynaptic density at identified synapses in the locust central nervous system.

In a synaptic active zone, vesicles aggregate around a densely staining structure called the presynaptic density. We focus on its three-dimensional architecture and a major molecular component in the locust. We used electron tomography to study the presynaptic density in synapses made in the brain by identified second-order neuron of the ocelli. Here, vesicles close to the active zone are organized in two rows on either side of the presynaptic density, a level of organization not previously reported in insect central synapses. The row of vesicles that is closest to the density's base includes vesicles docked with the presynaptic membrane and thus presumably ready for release, whereas the outer row of vesicles does not include any that are docked. We show that a locust ortholog of the Drosophila protein Bruchpilot is localized to the presynaptic density, both in the ocellar pathway and compound eye visual neurons. An antibody recognizing the C-terminus of the Bruchpilot ortholog selectively labels filamentous extensions of the presynaptic density that reach out toward vesicles. Previous studies on Bruchpilot have focused on its role in neuromuscular junctions in Drosophila, and our study shows it is also a major functional component of presynaptic densities in the central nervous system of an evolutionarily distant insect. Our study thus reveals Bruchpilot executes similar functions in synapses that can sustain transmission of small graded potentials as well as those relaying large, spike-evoked signals.

Tarantulas cling to smooth vertical surfaces by secreting silk from their feet.

Like all spiders, tarantulas (family Theraphosidae) synthesize silk in specialized glands and extrude it from spinnerets on their abdomen. In one species of large tarantula, Aphonopelma seemanni, it has been suggested that silk can also be secreted from the tarsi but this claim was later refuted. We provide evidence of silk secretion directly from spigots (nozzles) on the tarsi of three distantly related tarantula species: the Chilean rose, Grammostola rosea; the Indian ornamental, Poecilotheria regalis; and the Mexican flame knee, Brachypelma auratum, suggesting tarsal silk secretion is widespread among tarantulas. We demonstrate that multiple strands of silk are produced as a footprint when the spider begins to slip down a smooth vertical surface. The nozzle-like setae on the tarsi responsible for silk deposition have shanks reinforced by cuticular thickenings, which serve to prevent the shanks' internal collapse while still maintaining their flexibility. This is important as the spigots occur on the ventral surface of the tarsus, projecting beyond the finely divided setae of the dry attachment pads. We also reveal the structure and disposition of the silk-secreting spigots on the abdominal spinnerets of the three tarantula species and find they are very similar to those from the earliest known proto-spider spinneret from the Devonian period, giving another indication that silk secretion in tarantulas is close to the ancestral condition.

Escapes with and without preparation: the neuroethology of visual startle in locusts.

Locusts respond to the images of approaching (looming) objects with responses that include gliding while in flight and jumping while standing. For both of these responses there is good evidence that the DCMD neuron (descending contralateral movement detector), which carries spike trains from the brain to the thoracic ganglia, is involved. Sudden glides during flight, which cause a rapid loss of height, are last-chance manoeuvres without prior preparation. Jumps from standing require preparation over several tens of milliseconds because of the need to store muscle-derived energy in a catapult-like mechanism. Locusts' DCMD neurons respond selectively to looming stimuli, and make connections with some motor neurons and interneurons known to be involved in flying and jumping. For glides, a burst of high-frequency DCMD spikes is a key trigger. For jumping, a similar burst can influence timing, but neither the DCMD nor any other single interneuron has been shown to be essential for triggering any stage in preparation or take-off. Responses by the DCMD to looming stimuli can alter in different behavioural contexts: in a flying locust, arousal ensures a high level of both DCMD responsiveness and glide occurrence; and there are significant differences in DCMD activity between locusts in the gregarious and the solitarious phase.

Arousal facilitates collision avoidance mediated by a looming sensitive visual neuron in a flying locust.

Locusts have two large collision-detecting neurons, the descending contralateral movement detectors (DCMDs) that signal object approach and trigger evasive glides during flight. We sought to investigate whether vision for action, when the locust is in an aroused state rather than a passive viewer, significantly alters visual processing in this collision-detecting pathway. To do this we used two different approaches to determine how the arousal state of a locust affects the prolonged periods of high-frequency spikes typical of the DCMD response to approaching objects that trigger evasive glides. First, we manipulated arousal state in the locust by applying a brief mechanical stimulation to the hind leg; this type of change of state occurs when gregarious locusts accumulate in high-density swarms. Second, we examined DCMD responses during flight because flight produces a heightened physiological state of arousal in locusts. When arousal was induced by either method we found that the DCMD response recovered from a previously habituated state; that it followed object motion throughout approach; and--most important--that it was significantly more likely to generate the maintained spike frequencies capable of evoking gliding dives even with extremely short intervals (1.8 s) between approaches. Overall, tethered flying locusts responded to 41% of simulated approaching objects (sets of 6 with 1.8 s ISI). When we injected epinastine, the neuronal octopamine receptor antagonist, into the hemolymph responsiveness declined to 12%, suggesting that octopamine plays a significant role in maintaining responsiveness of the DCMD and the locust to visual stimuli during flight.

Preparing for escape: an examination of the role of the DCMD neuron in locust escape jumps.

Many animals begin to escape by moving away from a threat the instant it is detected. However, the escape jumps of locusts take several hundred milliseconds to produce and the locust must therefore be prepared for escape before the jumping movement can be triggered. In this study we investigate a locust's preparations to escape a looming stimulus and concurrent spiking activity in its pair of uniquely identifiable looming-detector neurons (the descending contralateral movement detectors; DCMDs). We find that hindleg flexion in preparation for a jump occurs at the same time as high frequency DCMD spikes. However, spikes in a DCMD are not necessary for triggering hindleg flexion, since this hindleg flexion still occurs when the connective containing a DCMD axon is severed or in response to stimuli that cause no high frequency DCMD spikes. Such severing of the connective containing a DCMD axon does, however, increase the variability in flexion timing. We therefore propose that the DCMD contributes to hindleg flexion in preparation for an escape jump, but that its activity affects only flexion timing and is not necessary for the occurrence of hindleg flexion.

A synthetic vision system using directionally selective motion detectors to recognize collision.

Reliably recognizing objects approaching on a collision course is extremely important. A synthetic vision system is proposed to tackle the problem of collision recognition in dynamic environments. The system combines the outputs of four whole-field motion-detecting neurons, each receiving inputs from a network of neurons employing asymmetric lateral inhibition to suppress their responses to one direction of motion. An evolutionary algorithm is then used to adjust the weights between the four motion-detecting neurons to tune the system to detect collisions in two test environments. To do this, a population of agents, each representing a proposed synthetic visual system, either were shown images generated by a mobile Khepera robot navigating in a simplified laboratory environment or were shown images videoed outdoors from a moving vehicle. The agents had to cope with the local environment correctly in order to survive. After 400 generations, the best agent recognized imminent collisions reliably in the familiar environment where it had evolved. However, when the environment was swapped, only the agent evolved to cope in the robotic environment still signaled collision reliably. This study suggests that whole-field direction-selective neurons, with selectivity based on asymmetric lateral inhibition, can be organized into a synthetic vision system, which can then be adapted to play an important role in collision detection in complex dynamic scenes.

A bio-inspired visual collision detection mechanism for cars: combining insect inspired neurons to create a robust system.

The lobula giant movement detector (LGMD) of locusts is a visual interneuron that responds with an increasing spike frequency to an object approaching on a direct collision course. Recent studies involving the use of LGMD models to detect car collisions showed that it could detect collisions, but the neuron produced collision alerts to non-colliding, translating, stimuli in many cases. This study presents a modified model to address these problems. It shows how the neurons pre-synaptic to the LGMD show a remarkable ability to filter images, and only colliding and translating stimuli produce excitation in the neuron. It then integrates the LGMD network with models based on the elementary movement detector (EMD) neurons from the fly visual system, which are used to analyse directional excitation patterns in the biologically filtered images. Combining the information from the LGMD neuron and four directionally sensitive neurons produces a robust collision detection system for a wide range of automotive test situations.

Collision detection in complex dynamic scenes using an LGMD-based visual neural network with feature enhancement.

The lobula giant movement detector (LGMD) is an identified neuron in the locust brain that responds most strongly to the images of an approaching object such as a predator. Its computational model can cope with unpredictable environments without using specific object recognition algorithms. In this paper, an LGMD-based neural network is proposed with a new feature enhancement mechanism to enhance the expanded edges of colliding objects via grouped excitation for collision detection with complex backgrounds. The isolated excitation caused by background detail will be filtered out by the new mechanism. Offline tests demonstrated the advantages of the presented LGMD-based neural network in complex backgrounds. Real time robotics experiments using the LGMD-based neural network as the only sensory system showed that the system worked reliably in a wide range of conditions; in particular, the robot was able to navigate in arenas with structured surrounds and complex backgrounds.

Role of an identified looming-sensitive neuron in triggering a flying locust's escape.

Flying locusts perform a characteristic gliding dive in response to predator-sized stimuli looming from one side. These visual looming stimuli trigger trains of spikes in the descending contralateral movement detector (DCMD) neuron that increase in frequency as the stimulus gets nearer. Here we provide evidence that high-frequency (>150 Hz) DCMD spikes are involved in triggering the glide: the DCMD is the only excitatory input to a key gliding motor neuron during a loom; DCMD-mediated EPSPs only summate significantly in this motor neuron when they occur at >150 Hz; when a looming stimulus ceases approach prematurely, high-frequency DCMD spikes are removed from its response and the occurrence of gliding is reduced; and an axon important for glide triggering descends in the nerve cord contralateral to the eye detecting a looming stimulus, as the DCMD does. DCMD recordings from tethered flying locusts showed that glides follow high-frequency spikes in a DCMD, but analyses could not identify a feature of the DCMD response alone that was reliably associated with glides in all trials. This was because, for a glide to be triggered, the high-frequency spikes must be timed appropriately within the wingbeat cycle to coincide with wing elevation. We interpret this as flight-gating of the DCMD response resulting from rhythmic modulation of the flight motor neuron's membrane potential during flight. This means that the locust's escape behavior can vary in response to the same looming stimulus, meaning that a predator cannot exploit predictability in the locust's collision avoidance behavior.

Motor activity and trajectory control during escape jumping in the locust Locusta migratoria.

We investigated the escape jumps that locusts produce in response to approaching objects. Hindleg muscular activity during an escape jump is similar to that during a defensive kick. Locusts can direct their escape jumps up to 50 degrees either side of the direction of their long axis at the time of hindleg flexion, allowing them to consistently jump away from the side towards which an object is approaching. Variation in jump trajectory is achieved by rolling and yawing movements of the body that are controlled by the fore- and mesothoracic legs. During hindleg flexion, a locust flexes the foreleg ipsilateral to its eventual jump trajectory and then extends the contralateral foreleg. These foreleg movements continue throughout co-contraction of the hindleg tibial muscles, pivoting the locust's long axis towards its eventual jump trajectory. However, there are no bilateral differences in the motor programs of the left and right hindlegs that correlate with jump trajectory. Foreleg movements enable a locust to control its jump trajectory independent of the hindleg motor program, allowing a decision on jump trajectory to be made after the hindlegs have been cocked in preparation for a jump.