Motion-In-Depth Perception and Prey Capture in the Praying Mantis Sphodromantis Lineola
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
The Hodgkin-Huxley Neuron Model for Motion Detection in Image Sequences Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray
The Hodgkin-Huxley neuron model for motion detection in image sequences Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray To cite this version: Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray. The Hodgkin-Huxley neuron model for motion detection in image sequences. Neural Computing and Applications, Springer Verlag, In press, 10.1007/s00521-021-06446-0. hal-03331961 HAL Id: hal-03331961 https://hal.archives-ouvertes.fr/hal-03331961 Submitted on 2 Sep 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Noname manuscript No. (will be inserted by the editor) The Hodgkin{Huxley neuron model for motion detection in image sequences Hayat Yedjour · Boudjelal Meftah · Dounia Yedjour · Olivier L´ezoray Received: date / Accepted: date Abstract In this paper, we consider a biologically-inspired spiking neural network model for motion detection. The proposed model simulates the neu- rons' behavior in the cortical area MT to detect different kinds of motion in image sequences. We choose the conductance-based neuron model of the Hodgkin-Huxley to define MT cell responses. Based on the center-surround antagonism of MT receptive fields, we model the area MT by its great pro- portion of cells with directional selective responses. -
3D Computational Modeling and Perceptual Analysis of Kinetic Depth Effects
Computational Visual Media DOI 10.1007/s41095-xxx-xxxx-x Vol. x, No. x, month year, xx–xx Research Article 3D Computational Modeling and Perceptual Analysis of Kinetic Depth Effects Meng-Yao Cui1, Shao-Ping Lu1( ), Miao Wang2, Yong-Liang Yang3, Yu-Kun Lai4, and Paul L. Rosin4 c The Author(s) 2020. This article is published with open access at Springerlink.com Abstract Humans have the ability to perceive 3D shapes from 2D projections of rotating 3D objects, which is called Kinetic Depth Effects. This process is based on a variety of visual cues such as lighting and shading effects. However, when such cues are weakened or missing, perception can become faulty, as demonstrated by the famous silhouette illusion example – the Spinning Dancer. Inspired by this, we establish objective and subjective evaluation models of rotated 3D objects by taking their projected 2D images as input. We investigate five different cues: ambient Fig. 1 The Spinning Dancer. Due to the lack of visual cues, it confuses humans luminance, shading, rotation speed, perspective, and color as to whether rotation is clockwise or counterclockwise. Here we show 3 of 34 difference between the objects and background. In the frames from the original animation [21]. Image courtesy of Nobuyuki Kayahara. objective evaluation model, we first apply 3D reconstruction algorithms to obtain an objective reconstruction quality 1 Introduction metric, and then use a quadratic stepwise regression analysis method to determine the weights among depth cues to The human perception mechanism of the 3D world has represent the reconstruction quality. In the subjective long been studied. -
Capture of Stereopsis and Apparent Motion by Illusory Contours
Perception & Psychophysics 1986, 39 (5), 361-373 Capture of stereopsis and apparent motion by illusory contours V. S. RAMACHANDRAN University of California, San Diego, La Jolla, California The removal of right-angle sectors from four circular black disks created the impression of a white "subjective" square with its four corners occluding the disks ("illusory contours"). The dis play in one eye was identical to that in the other except that for one eye a horizontal disparity was introduced between the edges of the cut sectors so that an illusory white square floated out in front of the paper. When a "template" ofthis stereogram was superimposed on a vertical square wave grating (6 cycles/deg) the illusory square pulled the corresponding lines of grating forward even though the grating was at zero disparity. (Capture was not observed if the template was superimposed on horizontal gratings; the grating remained flush with the background). Analo gous effects were observed in apparent motion ("motion capture"). Removal of sectors from disks in an appropriately timed sequence generated apparent motion of an illusory square. When a template of this display was superimposed on a grating, the lines appeared to move vividly with the square even though they were physically stationary. It was concluded that segmentation of the visual scene into surfaces and objects can profoundly influence the early visual processing of stereopsis and apparent motion. However, there are interesting differences between stereo cap ture and motion capture, which probably reflect differences in natural constraints. The implica tions of these findings for computational models of vision are discussed. -
Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: from Events to Global Motion Perception
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019 1 Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception Federico Paredes-Valles´ , Kirk Y. W. Scheper , and Guido C. H. E. de Croon , Member, IEEE Abstract—The combination of spiking neural networks and event-based vision sensors holds the potential of highly efficient and high-bandwidth optical flow estimation. This paper presents the first hierarchical spiking architecture in which motion (direction and speed) selectivity emerges in an unsupervised fashion from the raw stimuli generated with an event-based camera. A novel adaptive neuron model and stable spike-timing-dependent plasticity formulation are at the core of this neural network governing its spike-based processing and learning, respectively. After convergence, the neural architecture exhibits the main properties of biological visual motion systems, namely feature extraction and local and global motion perception. Convolutional layers with input synapses characterized by single and multiple transmission delays are employed for feature and local motion perception, respectively; while global motion selectivity emerges in a final fully-connected layer. The proposed solution is validated using synthetic and real event sequences. Along with this paper, we provide the cuSNN library, a framework that enables GPU-accelerated simulations of large-scale spiking neural networks. Source code and samples are available at https://github.com/tudelft/cuSNN. Index Terms—Event-based vision, feature extraction, motion detection, neural nets, neuromorphic computing, unsupervised learning F 1 INTRODUCTION HENEVER an animal endowed with a visual system interconnected cells for motion estimation, among other W navigates through an environment, turns its gaze, or tasks. -
Interacting with Autostereograms
See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/336204498 Interacting with Autostereograms Conference Paper · October 2019 DOI: 10.1145/3338286.3340141 CITATIONS READS 0 39 5 authors, including: William Delamare Pourang Irani Kochi University of Technology University of Manitoba 14 PUBLICATIONS 55 CITATIONS 184 PUBLICATIONS 2,641 CITATIONS SEE PROFILE SEE PROFILE Xiangshi Ren Kochi University of Technology 182 PUBLICATIONS 1,280 CITATIONS SEE PROFILE Some of the authors of this publication are also working on these related projects: Color Perception in Augmented Reality HMDs View project Collaboration Meets Interactive Spaces: A Springer Book View project All content following this page was uploaded by William Delamare on 21 October 2019. The user has requested enhancement of the downloaded file. Interacting with Autostereograms William Delamare∗ Junhyeok Kim Kochi University of Technology University of Waterloo Kochi, Japan Ontario, Canada University of Manitoba University of Manitoba Winnipeg, Canada Winnipeg, Canada [email protected] [email protected] Daichi Harada Pourang Irani Xiangshi Ren Kochi University of Technology University of Manitoba Kochi University of Technology Kochi, Japan Winnipeg, Canada Kochi, Japan [email protected] [email protected] [email protected] Figure 1: Illustrative examples using autostereograms. a) Password input. b) Wearable e-mail notification. c) Private space in collaborative conditions. d) 3D video game. e) Bar gamified special menu. Black elements represent the hidden 3D scene content. ABSTRACT practice. This learning effect transfers across display devices Autostereograms are 2D images that can reveal 3D content (smartphone to desktop screen). when viewed with a specific eye convergence, without using CCS CONCEPTS extra-apparatus. -
The Genus Metallyticus Reviewed (Insecta: Mantodea)
See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/228623877 The genus Metallyticus reviewed (Insecta: Mantodea) Article · September 2008 CITATIONS READS 11 353 1 author: Frank Wieland Pfalzmuseum für Naturkunde - POLLICHIA-… 33 PUBLICATIONS 113 CITATIONS SEE PROFILE All in-text references underlined in blue are linked to publications on ResearchGate, Available from: Frank Wieland letting you access and read them immediately. Retrieved on: 24 October 2016 Species, Phylogeny and Evolution 1, 3 (30.9.2008): 147-170. The genus Metallyticus reviewed (Insecta: Mantodea) Frank Wieland Johann-Friedrich-Blumenbach-Institut für Zoologie & Anthropologie und Zoologisches Museum der Georg-August-Universität, Abteilung für Morphologie, Systematik und Evolutionsbiologie, Berliner Str. 28, 37073 Göttingen, Germany [[email protected]] Abstract Metallyticus Westwood, 1835 (Insecta: Dictyoptera: Mantodea) is one of the most fascinating praying mantids but little is known of its biology. Several morphological traits are plesiomorphic, such as the short prothorax, characters of the wing venation and possibly also the lack of discoidal spines on the fore femora. On the other hand, Metallyticus has autapomor- phies which are unique among extant Mantodea, such as the iridescent bluish-green body coloration and the enlargement of the first posteroventral spine of the fore femora. The present publication reviews our knowledge of Metallyticus thus providing a basis for further research. Data on 115 Metallyticus specimens are gathered and interpreted. The Latin original descriptions of the five Metallyticus species known to date, as well as additional descriptions and a key to species level that were originally published by Giglio-Tos (1927) in French, are translated into English. -
Stereopsis and Stereoblindness
Exp. Brain Res. 10, 380-388 (1970) Stereopsis and Stereoblindness WHITMAN RICHARDS Department of Psychology, Massachusetts Institute of Technology, Cambridge (USA) Received December 20, 1969 Summary. Psychophysical tests reveal three classes of wide-field disparity detectors in man, responding respectively to crossed (near), uncrossed (far), and zero disparities. The probability of lacking one of these classes of detectors is about 30% which means that 2.7% of the population possess no wide-field stereopsis in one hemisphere. This small percentage corresponds to the probability of squint among adults, suggesting that fusional mechanisms might be disrupted when stereopsis is absent in one hemisphere. Key Words: Stereopsis -- Squint -- Depth perception -- Visual perception Stereopsis was discovered in 1838, when Wheatstone invented the stereoscope. By presenting separate images to each eye, a three dimensional impression could be obtained from two pictures that differed only in the relative horizontal disparities of the components of the picture. Because the impression of depth from the two combined disparate images is unique and clearly not present when viewing each picture alone, the disparity cue to distance is presumably processed and interpreted by the visual system (Ogle, 1962). This conjecture by the psychophysicists has received recent support from microelectrode recordings, which show that a sizeable portion of the binocular units in the visual cortex of the cat are sensitive to horizontal disparities (Barlow et al., 1967; Pettigrew et al., 1968a). Thus, as expected, there in fact appears to be a physiological basis for stereopsis that involves the analysis of spatially disparate retinal signals from each eye. Without such an analysing mechanism, man would be unable to detect horizontal binocular disparities and would be "stereoblind". -
Arthropod Grasping and Manipulation: a Literature Review
Arthropod Grasping and Manipulation A Literature Review Aaron M. Dollar Harvard BioRobotics Laboratory Technical Report Department of Engineering and Applied Sciences Harvard University April 5, 2001 www.biorobotics.harvard.edu Introduction The purpose of this review is to report on the existing literature on the subject of arthropod grasping and manipulation. In order to gain a proper understanding of the state of the knowledge in this rather broad topic, it is necessary and appropriate to take a step backwards and become familiar with the basics of entomology and arthropod physiology. Once these principles have been understood it will then be possible to proceed towards the more specific literature that has been published in the field. The structure of the review follows this strategy. General background information will be presented first, followed by successively more specific topics, and ending with a review of the refereed journal articles related to arthropod grasping and manipulation. Background The phylum Arthropoda is the largest of the phyla, and includes all animals that have an exoskeleton, a segmented body in series, and six or more jointed legs. There are nine classes within the phylum, five of which the average human is relatively familiar with – insects, arachnids, crustaceans, centipedes, and millipedes. Of all known species of animals on the planet, 82% are arthropods (c. 980,000 species)! And this number just reflects the known species. Estimates put the number of arthropod species remaining to be discovered and named at around 9-30 million, or 10-30 times more than are currently known. And this is just the number of species; the population of each is another matter altogether. -
Portia Perceptions: the Umwelt of an Araneophagic Jumping Spider
Portia Perceptions: The Umwelt of an Araneophagic Jumping 1 Spider Duane P. Harland and Robert R. Jackson The Personality of Portia Spiders are traditionally portrayed as simple, instinct-driven animals (Savory, 1928; Drees, 1952; Bristowe, 1958). Small brain size is perhaps the most compelling reason for expecting so little flexibility from our eight-legged neighbors. Fitting comfortably on the head of a pin, a spider brain seems to vanish into insignificance. Common sense tells us that compared with large-brained mammals, spiders have so little to work with that they must be restricted to a circumscribed set of rigid behaviors, flexibility being a luxury afforded only to those with much larger central nervous systems. In this chapter we review recent findings on an unusual group of spiders that seem to be arachnid enigmas. In a number of ways the behavior of the araneophagic jumping spiders is more comparable to that of birds and mammals than conventional wisdom would lead us to expect of an arthropod. The term araneophagic refers to these spiders’ preference for other spiders as prey, and jumping spider is the common English name for members of the family Saltici- dae. Although both their common and the scientific Latin names acknowledge their jumping behavior, it is really their unique, complex eyes that set this family of spiders apart from all others. Among spiders (many of which have very poor vision), salticids have eyes that are by far the most specialized for resolving fine spatial detail. We focus here on the most extensively studied genus, Portia. Before we discuss the interrelationship between the salticids’ uniquely acute vision, their predatory strategies, and their apparent cognitive abilities, we need to offer some sense of what kind of animal a jumping spider is; to do this, we attempt to offer some insight into what we might call Portia’s personality. -
Relative Importance of Binocular Disparity and Motion Parallax for Depth Estimation: a Computer Vision Approach
remote sensing Article Relative Importance of Binocular Disparity and Motion Parallax for Depth Estimation: A Computer Vision Approach Mostafa Mansour 1,2 , Pavel Davidson 1,* , Oleg Stepanov 2 and Robert Piché 1 1 Faculty of Information Technology and Communication Sciences, Tampere University, 33720 Tampere, Finland 2 Department of Information and Navigation Systems, ITMO University, 197101 St. Petersburg, Russia * Correspondence: pavel.davidson@tuni.fi Received: 4 July 2019; Accepted: 20 August 2019; Published: 23 August 2019 Abstract: Binocular disparity and motion parallax are the most important cues for depth estimation in human and computer vision. Here, we present an experimental study to evaluate the accuracy of these two cues in depth estimation to stationary objects in a static environment. Depth estimation via binocular disparity is most commonly implemented using stereo vision, which uses images from two or more cameras to triangulate and estimate distances. We use a commercial stereo camera mounted on a wheeled robot to create a depth map of the environment. The sequence of images obtained by one of these two cameras as well as the camera motion parameters serve as the input to our motion parallax-based depth estimation algorithm. The measured camera motion parameters include translational and angular velocities. Reference distance to the tracked features is provided by a LiDAR. Overall, our results show that at short distances stereo vision is more accurate, but at large distances the combination of parallax and camera motion provide better depth estimation. Therefore, by combining the two cues, one obtains depth estimation with greater range than is possible using either cue individually. -
Chromostereo.Pdf
ChromoStereoscopic Rendering for Trichromatic Displays Le¨ıla Schemali1;2 Elmar Eisemann3 1Telecom ParisTech CNRS LTCI 2XtremViz 3Delft University of Technology Figure 1: ChromaDepth R glasses act like a prism that disperses incoming light and induces a differing depth perception for different light wavelengths. As most displays are limited to mixing three primaries (RGB), the depth effect can be significantly reduced, when using the usual mapping of depth to hue. Our red to white to blue mapping and shading cues achieve a significant improvement. Abstract The chromostereopsis phenomenom leads to a differing depth per- ception of different color hues, e.g., red is perceived slightly in front of blue. In chromostereoscopic rendering 2D images are produced that encode depth in color. While the natural chromostereopsis of our human visual system is rather low, it can be enhanced via ChromaDepth R glasses, which induce chromatic aberrations in one Figure 2: Chromostereopsis can be due to: (a) longitunal chro- eye by refracting light of different wavelengths differently, hereby matic aberration, focus of blue shifts forward with respect to red, offsetting the projected position slightly in one eye. Although, it or (b) transverse chromatic aberration, blue shifts further toward might seem natural to map depth linearly to hue, which was also the the nasal part of the retina than red. (c) Shift in position leads to a basis of previous solutions, we demonstrate that such a mapping re- depth impression. duces the stereoscopic effect when using standard trichromatic dis- plays or printing systems. We propose an algorithm, which enables an improved stereoscopic experience with reduced artifacts. -
Biodiversity Journal, 2020,11 (3): 799–802
Biodiversity Journal, 2020, 11 (3): 799–802 https://doi.org/10.31396/Biodiv.Jour.2020.11.3.799.802 Where two giants meet: the first records of Sphodromantis viridis in Sicily and Greece and the spread in Europe of Hiero- dula tenuidentata (Insecta Mantoidea) show new crossroads of mantids in the Mediterranean Roberto Battiston1, Simone Andria1, Domenico Borgese2, William Di Pietro1 & Alberto Manciagli2 1World Biodiversity Association Onlus, c/o Museo Civico di Storia Naturale, Lungadige Porta Vittoria 9, Verona, Italy 2Dipartimento di Scienze Biologiche, Geologiche e Ambientali dell’Università degli Studi di Catania, Via A. Longo, 19, Catania, Italy ABSTRACT The first presence records of the Giant African Mantis Sphodromantis viridis (Forskål, 1775) (Insecta Mantoidea) are reported for Sicily and Greece, with new evidences on the human- mediated spreading of this species in the Mediterranean area. In Greece, Sphodromantis viridis meets the distribution of the Giant Asian Mantis Hierodula tenuidentata (Saussure, 1869), and these two mantids have been recorded together in the same locality. Some single records from France and Corsica also open the possible expansion of this species in more northern regions. These different spreading dynamics, taking place in the Mediterranean area, in a fast-evolving scenario, are here discussed. KEY WORDS Giant mantises, distribution, new records, human impact, invasive species. Received 10.07.2020; accepted 23.08.2020; published online 30.09.2020 INTRODUCTION in a fast-changing scenario (Schwarz & Ehrmann, 2018). During the last few years, the mantid popula- The Giant African Mantis Sphodromantis viridis tions in the Euro-Mediterranean area have signifi- (Forskål, 1775) is also spreading in the Mediter- cantly changed.