Binocular responsiveness of projection neurons of the praying mantis optic lobe in the frontal visual field.

Praying mantids are the only insects proven to have stereoscopic vision (stereopsis): the ability to perceive depth from the slightly shifted images seen by the two eyes. Recently, the first neurons likely to be involved in mantis stereopsis were described and a speculative neuronal circuit suggested. Here we further investigate classes of neurons in the lobula complex of the praying mantis brain and their tuning to stereoscopically-defined depth. We used sharp electrode recordings with tracer injections to identify visual projection neurons with input in the optic lobe and output in the central brain. In order to measure binocular response fields of the cells the animals watched a vertical bar stimulus in a 3D insect cinema during recordings. We describe the binocular tuning of 19 neurons projecting from the lobula complex and the medulla to central brain areas. The majority of neurons (12/19) were binocular and had receptive fields for both eyes that overlapped in the frontal region. Thus, these neurons could be involved in mantis stereopsis. We also find that neurons preferring different contrast polarity (bright vs dark) tend to be segregated in the mantis lobula complex, reminiscent of the segregation for small targets and widefield motion in mantids and other insects.

Pattern and Speed Interact to Hide Moving Prey.

Evolutionary biologists have long been fascinated by camouflage patterns that help animals reduce their chances of being detected by predators [1-4]. However, patterns that hide prey when they remain stationary, such as those that match their backgrounds [5, 6], are rendered ineffective once prey are moving [7-10]. The question remains: can a moving animal ever be patterned in a way that helps reduce detection by predators? One long-standing idea is that high-contrast patterns with repeated elements, such as stripes, which are highly visible when prey are stationary, can actually conceal prey when they move fast enough [11-14]. This is predicted by the "flicker fusion effect," which occurs when prey move with sufficient speed that their pattern appears to blur, making them appear more featureless and become less conspicuous against the background [2, 8]. However, although this idea suggests a way to camouflage moving prey, it has not been empirically tested, and it is not clear that it would work at speeds that are biologically relevant to a predator [13]. Combining psychophysics and behavioral approaches, we show that speed and pattern interact to determine the detectability of prey to the praying mantis (Sphodromantis lineola) and, crucially, that prey with high-contrast stripes become less visible than prey with background-matching patterns when moving with sufficient speed. We show that stripes can reduce the detection of moving prey by exploiting the spatiotemporal limitations of predator perception, and that the camouflaging effect of a pattern depends upon the speed of prey movement.

A neuronal correlate of insect stereopsis.

A puzzle for neuroscience-and robotics-is how insects achieve surprisingly complex behaviours with such tiny brains. One example is depth perception via binocular stereopsis in the praying mantis, a predatory insect. Praying mantids use stereopsis, the computation of distances from disparities between the two retinal images, to trigger a raptorial strike of their forelegs when prey is within reach. The neuronal basis of this ability is entirely unknown. Here we show the first evidence that individual neurons in the praying mantis brain are tuned to specific disparities and eccentricities, and thus locations in 3D-space. Like disparity-tuned cortical cells in vertebrates, the responses of these mantis neurons are consistent with linear summation of binocular inputs followed by an output nonlinearity. Our study not only proves the existence of disparity sensitive neurons in an insect brain, it also reveals feedback connections hitherto undiscovered in any animal species.

Motion-in-depth perception and prey capture in the praying mantis Sphodromantis lineola.

Perceiving motion-in-depth is essential to detecting approaching or receding objects, predators and prey. This can be achieved using several cues, including binocular stereoscopic cues such as changing disparity and interocular velocity differences, and monocular cues such as looming. Although these have been studied in detail in humans, only looming responses have been well characterized in insects and we know nothing about the role of stereoscopic cues and how they might interact with looming cues. We used our 3D insect cinema in a series of experiments to investigate the role of the stereoscopic cues mentioned above, as well as looming, in the perception of motion-in-depth during predatory strikes by the praying mantis Sphodromantis lineola Our results show that motion-in-depth does increase the probability of mantis strikes but only for the classic looming stimulus, an expanding luminance edge. Approach indicated by radial motion of a texture or expansion of a motion-defined edge, or by stereoscopic cues, all failed to elicit increased striking. We conclude that mantises use stereopsis to detect depth but not motion-in-depth, which is detected via looming.

Contrast thresholds reveal different visual masking functions in humans and praying mantises.

Recently, we showed a novel property of the Hassenstein-Reichardt detector, namely that insect motion detection can be masked by 'undetectable' noise, i.e. visual noise presented at spatial frequencies at which coherently moving gratings do not elicit a response (Tarawneh et al., 2017). That study compared the responses of human and insect motion detectors using different ways of quantifying masking (contrast threshold in humans and masking tuning function in insects). In addition, some adjustments in experimental procedure, such as presenting the stimulus at a short viewing distance, were necessary to elicit a response in insects. These differences offer alternative explanations for the observed difference between human and insect responses to visual motion noise. Here, we report the results of new masking experiments in which we test whether differences in experimental paradigm and stimulus presentation between humans and insects can account for the undetectable noise effect reported earlier. We obtained contrast thresholds at two signal and two noise frequencies in both humans and praying mantises (Sphodromantis lineola), and compared contrast threshold differences when noise has the same versus different spatial frequency as the signal. Furthermore, we investigated whether differences in viewing geometry had any qualitative impact on the results. Consistent with our earlier finding, differences in contrast threshold show that visual noise masks much more effectively when presented at signal spatial frequency in humans (compared to a lower or higher spatial frequency), while in insects, noise is roughly equivalently effective when presented at either the signal spatial frequency or lower (compared to a higher spatial frequency). The characteristic difference between human and insect responses was unaffected by correcting for the stimulus distortion caused by short viewing distances in insects. These findings constitute stronger evidence that the undetectable noise effect reported earlier is a genuine difference between human and insect motion processing, and not an artefact caused by differences in experimental paradigms.

A Novel Form of Stereo Vision in the Praying Mantis.

Stereopsis is the ability to estimate distance based on the different views seen in the two eyes [1-5]. It is an important model perceptual system in neuroscience and a major area of machine vision. Mammalian, avian, and almost all machine stereo algorithms look for similarities between the luminance-defined images in the two eyes, using a series of computations to produce a map showing how depth varies across the scene [3, 4, 6-14]. Stereopsis has also evolved in at least one invertebrate, the praying mantis [15-17]. Mantis stereopsis is presumed to be simpler than vertebrates' [15, 18], but little is currently known about the underlying computations. Here, we show that mantis stereopsis uses a fundamentally different computational algorithm from vertebrate stereopsis-rather than comparing luminance in the two eyes' images directly, mantis stereopsis looks for regions of the images where luminance is changing. Thus, while there is no evidence that mantis stereopsis works at all with static images, it successfully reveals the distance to a moving target even in complex visual scenes with targets that are perfectly camouflaged against the background in terms of texture. Strikingly, these insects outperform human observers at judging stereoscopic distance when the pattern of luminance in the two eyes does not match. Insect stereopsis has thus evolved to be computationally efficient while being robust to poor image resolution and to discrepancies in the pattern of luminance between the two eyes. VIDEO ABSTRACT.

Apparent Motion Perception in the Praying Mantis: Psychophysics and Modelling.

Apparent motion is the perception of motion created by rapidly presenting still frames in which objects are displaced in space. Observers can reliably discriminate the direction of apparent motion when inter-frame object displacement is below a certain limit, Dmax . Earlier studies of motion perception in humans found that Dmax is lower-bounded at around 15 arcmin, and thereafter scales with the size of the spatial elements in the images. Here, we run corresponding experiments in the praying mantis Sphodromantis lineola to investigate how Dmax scales with the element size. We use random moving chequerboard patterns of varying element and displacement step sizes to elicit the optomotor response, a postural stabilization mechanism that causes mantids to lean in the direction of large-field motion. Subsequently, we calculate Dmax as the displacement step size corresponding to a 50% probability of detecting an optomotor response in the same direction as the stimulus. Our main findings are that the mantis Dmax scales roughly as a square-root of element size and that, in contrast to humans, it is not lower-bounded. We present two models to explain these observations: a simple high-level model based on motion energy in the Fourier domain and a more-detailed one based on the Reichardt Detector. The models present complementary intuitive and physiologically-realistic accounts of how Dmax scales with the element size in insects. We conclude that insect motion perception is limited by only a single stage of spatial filtering, reflecting the optics of the compound eye. In contrast, human motion perception reflects a second stage of spatial filtering, at coarser scales than imposed by human optics, likely corresponding to the magnocellular pathway. After this spatial filtering, mantis and human motion perception and Dmax are qualitatively very similar.

Invisible noise obscures visible signal in insect motion detection.

The motion energy model is the standard account of motion detection in animals from beetles to humans. Despite this common basis, we show here that a difference in the early stages of visual processing between mammals and insects leads this model to make radically different behavioural predictions. In insects, early filtering is spatially lowpass, which makes the surprising prediction that motion detection can be impaired by "invisible" noise, i.e. noise at a spatial frequency that elicits no response when presented on its own as a signal. We confirm this prediction using the optomotor response of praying mantis Sphodromantis lineola. This does not occur in mammals, where spatially bandpass early filtering means that linear systems techniques, such as deriving channel sensitivity from masking functions, remain approximately valid. Counter-intuitive effects such as masking by invisible noise may occur in neural circuits wherever a nonlinearity is followed by a difference operation.

The optomotor response of the praying mantis is driven predominantly by the central visual field.

The optomotor response has been widely used to investigate insect sensitivity to contrast and motion. Several studies have revealed the sensitivity of this response to frequency and contrast, but we know less about the spatial integration underlying this response. Specifically, few studies have investigated how the horizontal angular extent of stimuli influences the optomotor response. We presented mantises with moving gratings of varying horizontal extents at three different contrasts in the central or peripheral regions of their visual fields. We assessed the relative effectivity of different regions to elicit the optomotor response and modelled the dependency of the response on the angular extent subtended by stimuli at these different regions. Our results show that the optomotor response is governed by stimuli in the central visual field and not in the periphery. The model also shows that in the central region, the probability of response increases linearly with increase in horizontal extent up to a saturation point. Furthermore, the dependency of the optomotor response on the angular extent of the stimulus is modulated by contrast. We discuss the implications of our results for different modes of stimulus presentation and for models of the underlying mechanisms of motion detection in the mantis.

Small or far away? Size and distance perception in the praying mantis.

Stereo or '3D' vision is an important but costly process seen in several evolutionarily distinct lineages including primates, birds and insects. Many selective advantages could have led to the evolution of stereo vision, including range finding, camouflage breaking and estimation of object size. In this paper, we investigate the possibility that stereo vision enables praying mantises to estimate the size of prey by using a combination of disparity cues and angular size cues. We used a recently developed insect 3D cinema paradigm to present mantises with virtual prey having differing disparity and angular size cues. We predicted that if they were able to use these cues to gauge the absolute size of objects, we should see evidence for size constancy where they would strike preferentially at prey of a particular physical size, across a range of simulated distances. We found that mantises struck most often when disparity cues implied a prey distance of 2.5 cm; increasing the implied distance caused a significant reduction in the number of strikes. We, however, found no evidence for size constancy. There was a significant interaction effect of the simulated distance and angular size on the number of strikes made by the mantis but this was not in the direction predicted by size constancy. This indicates that mantises do not use their stereo vision to estimate object size. We conclude that other selective advantages, not size constancy, have driven the evolution of stereo vision in the praying mantis.This article is part of the themed issue 'Vision in our three-dimensional world'.

Insect stereopsis demonstrated using a 3D insect cinema.

Stereopsis - 3D vision - has become widely used as a model of perception. However, all our knowledge of possible underlying mechanisms comes almost exclusively from vertebrates. While stereopsis has been demonstrated for one invertebrate, the praying mantis, a lack of techniques to probe invertebrate stereopsis has prevented any further progress for three decades. We therefore developed a stereoscopic display system for insects, using miniature 3D glasses to present separate images to each eye, and tested our ability to deliver stereoscopic illusions to praying mantises. We find that while filtering by circular polarization failed due to excessive crosstalk, "anaglyph" filtering by spectral content clearly succeeded in giving the mantis the illusion of 3D depth. We thus definitively demonstrate stereopsis in mantises and also demonstrate that the anaglyph technique can be effectively used to deliver virtual 3D stimuli to insects. This method opens up broad avenues of research into the parallel evolution of stereoscopic computations and possible new algorithms for depth perception.

The contrast sensitivity function of the praying mantis Sphodromantis lineola.

The detection of visual motion and its direction is a fundamental task faced by several visual systems. The motion detection system of insects has been widely studied with the majority of studies focussing on flies and bees. Here we characterize the contrast sensitivity of motion detection in the praying mantis Sphodromantis lineola, an ambush predator that stays stationary for long periods of time while preying on fast-moving prey. In this, its visual behaviour differs from previously studied insects and we might therefore expect its motion detection system to differ from theirs. To investigate the sensitivity of the mantis we analyzed its optomotor response in response to drifting gratings with different contrasts and spatio-temporal frequencies. We find that the contrast sensitivity of the mantis depends on the spatial and temporal frequencies present in the stimulus and is separably tuned to spatial and temporal frequency rather than specifically to object velocity. Our results also suggest that mantises are sensitive to a broad range of velocities, in which they differ from bees and are more similar to hoverflies. We discuss our results in relation to the contrast sensitivities of other insects and the visual ecology of the mantis.