Eye Movements During the Handwriting of Words: Individually and Within Sentences ⇑ Jodi C

Total Page:16

File Type:pdf, Size:1020Kb

Eye Movements During the Handwriting of Words: Individually and Within Sentences ⇑ Jodi C Human Movement Science xxx (2015) xxx–xxx Contents lists available at ScienceDirect Human Movement Science journal homepage: www.elsevier.com/locate/humov Eye movements during the handwriting of words: Individually and within sentences ⇑ Jodi C. Sita a,b, , Katelyn A. Taylor b a Department of Allied Health, Faculty of Health Sciences, Australian Catholic University, Victoria, Australia b Department of Public Health and Human Biosciences, Faculty of Health Sciences, La Trobe University, Victoria, Australia article info abstract Article history: Handwriting, a complex motor process involves the coordination of Available online xxxx both the upper limb and visual system. The gaze behavior that occurs during the handwriting process is an area that has been little studied. PsycINFO classification: This study investigated the eye-movements of adults during writing 2330 and reading tasks. Eye and handwriting movements were recorded 2323 for six different words over three different tasks. The results com- Keywords: pared reading and handwriting the same words, a between condition Eye tracking comparison and a comparison between the two handwriting tasks. Handwriting Compared to reading, participants produced more fixations during Motor processes handwriting tasks and the average fixation durations were longer. Visual perception When reading fixations were found to be mostly around the center of word, whereas fixations when writing appear to be made for each letter in a written word and were located around the base of letters and flowed in a left to right direction. Between the two writing tasks more fixations were made when words were written individually compared to within sentences, yet fixation durations were no differ- ent. Correlation of the number of fixations made to kinematic variables revealed that horizontal size and road length held a strong correlation with the number of fixations made by participants. Ó 2015 Elsevier B.V. All rights reserved. 1. Introduction During writing, perceptual, motor, and cognitive processes interact. Handwriting is understood as a process that is characterized by spatial and kinematic parameters (Tucha, Tucha, & Lange, 2008). ⇑ Corresponding author at: Department of Allied Health, Faculty of Health Sciences, Australian Catholic University, Victoria, Australia. http://dx.doi.org/10.1016/j.humov.2015.01.011 0167-9457/Ó 2015 Elsevier B.V. All rights reserved. Please cite this article in press as: Sita, J. C., & Taylor, K. A. Eye movements during the handwriting of words: Indi- vidually and within sentences. Human Movement Science (2015), http://dx.doi.org/10.1016/j.humov.2015.01.011 2 J.C. Sita, K.A. Taylor / Human Movement Science xxx (2015) xxx–xxx Accompanying movements like writing, the eyes alternate between fixations (maintaining a visual gaze on a location) and fast saccadic movements between fixation points (Crawford, Mendendorp, & Marotta, 2004), however how often they occur and to which aspects of the written trace or its sur- rounds they are located has not been reported. Regarding the role of vision in handwriting, it is com- mon knowledge that writing can occur quite easily without vision. However, Van Doorn and Keuss (1993) found that when completing handwriting tasks most individuals visually track their ongoing work, suggesting that vision plays an important role in handwriting. It has also been reported that in the absence of vision or under altered visual conditions, handwritten text contains more errors, with more repetitions, deletions, insertions and substitutions of both letters and strokes, and that the speed, spacing, sizing and spatial arrangement of the words along the line are effected (Feder & Majnemer, 2007; Smyth & Silvers, 1987; Van Doorn & Keuss, 1992; Van Doorn & Keuss, 1993). This suggests that there are two distinct functions for vision in the control of handwriting; the overall spatial arrangement of words on a horizontal line and the accurate production of movement sequences. Where overt visual attention is paid to handwriting the speed of handwriting has been reported to decrease (Marquardt, Gentz, & Mai, 1996). This is thought to be related to the automated movements associated with hand- writing, typically averaging 4–6 Hz, being too fast for the eyes to foveate (Marquardt et al., 1996). Instead, visions role in handwriting is proffered to be used to guide the hand, a role that increases in importance with the speed of movement (Marquardt et al., 1996; Van Doorn & Keuss, 1993). Siebner et al. (2001) reported that writing under normal circumstances uses mainly feed-forward mechanisms to adjust the kinematics of writing movements and that sensory feedback (including vision) is only required to monitor the approximate range of the movement and not the distinct details. In most situations fixations and saccades are used together to locate and observe what we are attending to and to gather visual information for the purpose of guiding behavior. Eye movements have been studied during many everyday activities involving body movements; driving and steering a car (Land & Lee, 1994), food preparation (Land & Hayhoe, 2001), pointing and drawing (Gowen & Miall, 2006; Reina & Schwartz, 2003; Tchalenko, 2007), tracing (Gowen & Miall, 2006), playing sports (Land & Furneaux, 1997; Land & McLeod, 2000) and building with blocks (Ballard, Hayhoe, & Pelz, 1995). For many of these tasks, the major role of the eye movements involved appears to be two fold; in one instance, vision is used as a guiding aide, locating reference areas or targets that may assist or be involved in precuing parameters for future movements, and in the other instance, the eye functions as part of the feedback mechanism, relaying visual feedback about movements performed. Reading is closely associated with writing as we often need to read what we have written. Much research has been conducted examining eye gaze during reading and an extensive review by Rayner (1998) covers much of the important work in this area. Reading requires particular eye-move- ment strategies which allows an individual to acquire visual information and process it, giving mean- ing to the text (Land, 2006). It is thought that when reading, top-down processes dominate gaze shifts as cognitive skills required for lexical interpretation influence eye movements (Avallone, De Stefano, Gambone, & Marcelli, 2009; Rayner, Xingshan, Williams, Cave, & Well, 2007). During reading the eye moves between two and five times per second in order to bring the text into foveal vision (Land, 2006; Salthouse & Ellis, 1980). Rayner (1998) posits that the mean fixation duration during silent reading tasks is approximately 225 ms and 275 ms for oral reading tasks. During the first 50–70 ms of a fixa- tion it has been hypothesized that the information needed for reading is obtained (Land, 2006), how- ever longer or more difficult words produce longer fixations as the lexical and linguistic information takes longer to process (Land, 2006; Rayner et al., 2007). When reading English, typically the eyes move in a linear pattern of fixations, moving from left to right allowing the words to be interpreted by the reader (Land, 2006). An effect often called the ‘preferred viewing location’ outlines that in read- ing most readers initially fixate about half way between the beginning of a word and the middle of the word (Rayner, 1979; Deutsch & Rayner, 1999; McConkie, Kerr, Reddix, & Zola, 1988; Rayner, Sereno, & Raney, 1996). Eye-tracking techniques can be used to explore issues regarding the cognitive processes that may occur during the real time production of graphomotor output (Pepe, Rogers, & Sita, 2012). There are only a small number of reported studies on eye movements in activities closely related to writing, where the hand uses a stylus to create a drawn artefact; these are drawing, tracing, copying, sketching and signature forgery. In signature simulation tasks, (Pepe & Sita, 2014, chap. 6; Pepe et al., 2012)it Please cite this article in press as: Sita, J. C., & Taylor, K. A. Eye movements during the handwriting of words: Indi- vidually and within sentences. Human Movement Science (2015), http://dx.doi.org/10.1016/j.humov.2015.01.011 J.C. Sita, K.A. Taylor / Human Movement Science xxx (2015) xxx–xxx 3 was reported that significantly more fixations were made on the model signatures than on the signa- tures being produced. Signature simulation, is a highly complex version of a normal copying task and the findings reflect the complexity of the stimuli attempting to be copied. Interestingly the duration of fixations made on the reproductions did not differ between signatures, yet were significantly shorter than fixations made on the exemplar signatures where information was being gathered. Drawing is a task that relies heavily on visuomotor coordination (Coen-cagli et al., 2009), as it involves continu- ously processing a stream of visual stimuli and converting this information into a motor plan that can be performed. During a drawing task Tchalenko (2007) reported that when drawing simple lines, two basic eye-hand interaction modes were used; close pursuit and target locking. Close pursuit behavior involved fixations closely following the pencil trace with a sequence of small saccades con- tinually catching up to it, where target locking behavior saw a stable fixation made on the end-point of the line throughout the entire drawing action (Tchalenko, 2007). When comparing drawing and trac- ing tasks Gowen and Miall (2006) found that hand and eye movements were much more closely cou- pled during the tracing tasks than for freehand drawing tasks; and that for the tracing tasks, the eyes followed the pen tip closely, with small saccades just in front of the pen, while during drawing the saccades made were fewer and larger. In a study where expert artists copied images (Tchalenko, 2009), the expert artists segmented the original drawing into simple line sections that were copied one at a time using a direct eye–hand strategy appearing not to require intermediate encoding into visual memory, suggesting that segmentation into simple lines defines the task-specific process of accurately copying.
Recommended publications
  • Functional MRI, DTI and Neurophysiology in Horizontal Gaze Palsy with Progressive Scoliosis
    Neuroradiology (2008) 50:453–459 DOI 10.1007/s00234-007-0359-1 FUNCTIONAL NEURORADIOLOGY Functional MRI, DTI and neurophysiology in horizontal gaze palsy with progressive scoliosis Sven Haller & Stephan G. Wetzel & Jürg Lütschg Received: 19 August 2007 /Accepted: 14 December 2007 /Published online: 24 January 2008 # Springer-Verlag 2008 Abstract suspected HGPPS, any technique appears appropriate for Introduction Horizontal gaze palsy with progressive scoliosis further investigation. Auditory fMRI suggests that a (HGPPS) is an autosomal recessive disease due to a mutation monaural auditory system with bilateral auditory activations in the ROBO3 gene. This rare disease is of particular interest might be a physiological advantage as compared to a because the absence, or at least reduction, of crossing of the binaural yet only unilateral auditory system, in analogy to ascending lemniscal and descending corticospinal tracts in the anisometropic amblyopia. Moving-head fMRI studies in the medulla predicts abnormal ipsilateral sensory and motor future might show whether the compensatory head move- systems. ments instead of normal eye movements activate the eye- Methods We evaluated the use of functional magnetic movement network. resonance imaging (fMRI) for the first time in this disease and compared it to diffusion tensor imaging (DTI) Keywords Functional MRI . HGPPS . ROBO3 tractography and neurophysiological findings in the same patient with genetically confirmed ROBO3 mutation. Abbreviations Results As expected, motor fMRI, somatosensory evoked BAEP brainstem auditory evoked potentials potentials (SSEP) and motor evoked potentials (MEP) were BOLD blood oxygenation level dependent dominantly ipsilateral to the stimulation side. DTI tractography DTI diffusion tensor imaging revealed ipsilateral ascending and descending connectivity in fMRI functional magnetic resonance imaging the brainstem yet normal interhemispheric connections in the FEF frontal eye field corpus callosum.
    [Show full text]
  • Sounds, Spectra, Audio Illusions, and Data Representations
    Sounds, spectra, audio illusions, and data representations Edoardo Milotti, Dipartimento di Fisica, Università di Trieste Introduction to Signal Processing Techniques A. Y. 2016-17 Piano notes Pure 440 Hz sound BacK to the initial recording, left channel amplitude (volt, ampere, normalized amplitude units … ) time (sample number) amplitude (volt, ampere, normalized amplitude units … ) 0.004 0.002 0.000 -0.002 -0.004 0 1000 2000 3000 4000 5000 time (sample number) amplitude (volt, ampere, normalized amplitude units … ) 0.004 0.002 0.000 -0.002 -0.004 0 1000 2000 3000 4000 5000 time (sample number) squared amplitude frequency (frequency index) Short Time Fourier Transform (STFT) Fourier Transform A single blocK of data Segmented data Fourier Transform squared amplitude frequency (frequency index) squared amplitude frequency (frequency index) amplitude of most important Fourier component time Spectrogram time frequency • Original audio file • Reconstruction with the largest amplitude frequency component only • Reconstruction with 7 frequency components • Reconstruction with 7 frequency components + phase information amplitude (volt, ampere, normalized amplitude units … ) time (sample number) amplitude (volt, ampere, normalized amplitude units … ) time (sample number) squared amplitude frequency (frequency index) squared amplitude frequency (frequency index) squared amplitude Include only Fourier components with amplitudes ABOVE a given threshold 18 Fourier components frequency (frequency index) squared amplitude Include only Fourier components with amplitudes ABOVE a given threshold 39 Fourier components frequency (frequency index) squared amplitude frequency (frequency index) Glissando In music, a glissando [ɡlisˈsando] (plural: glissandi, abbreviated gliss.) is a glide from one pitch to another. It is an Italianized musical term derived from the French glisser, to glide.
    [Show full text]
  • Distributed Hierarchical Processing in the Primate Cerebral Cortex
    Distributed Hierarchical Processing Daniel J. Felleman1 and David C. Van Essen2 in the Primate Cerebral Cortex 1 Department of Neurobiology and Anatomy, University of Texas Medical School, Houston, Texas 77030, and 2 Division of Biology, California Institute of Technology, Pasadena, California 91125 In recent years, many new cortical areas have been During the past decade, there has been an explosion identified in the macaque monkey. The number of iden- of information about the organization and connectiv- tified connections between areas has increased even ity of sensory and motor areas in the mammalian ce- more dramatically. We report here on (1) a summary of rebral cortex. Many laboratories have concentrated the layout of cortical areas associated with vision and their efforts on the visual cortex of macaque monkeys, with other modalities, (2) a computerized database for whose superb visual capacities in many ways rival storing and representing large amounts of information those of humans. In this article, we survey recent on connectivity patterns, and (3) the application of these progress in charting the layout of different cortical data to the analysis of hierarchical organization of the areas in the macaque and in analyzing the hierarchical cerebral cortex. Our analysis concentrates on the visual relationships among these areas, particularly in the Downloaded from system, which includes 25 neocortical areas that are visual system. predominantly or exclusively visual in function, plus an The original notion of hierarchical processing in additional 7 areas that we regard as visual-association the visual cortex was put forward by Hubel and Wiesel areas on the basis of their extensive visual inputs.
    [Show full text]
  • Graduate Neuroanatomy GSBS GS141181
    Page 1 Graduate Neuroanatomy GSBS GS141181 Laboratory Guide Offered and Coordinated by the Department of Neurobiology and Anatomy The University of Texas Health Science Center at Houston. This course guide was adatped from the Medical Neuroscience Laboratory Guide. Nachum Dafny, Ph.D., Course Director; Michael Beierlein, Ph.D., Laboratory Coordinator. Online teaching materials are available at https://oac22.hsc.uth.tmc.edu/courses/neuroanatomy/ Other course information available at http://openwetware.org/wiki/Beauchamp:GraduateNeuroanatomy Contents © 2000-Present University of Texas Health Science Center at Houston. All Rights Reserved. Unauthorized use of contents subject to civil and/or criminal prosecution. Graduate Neuroanatomy : Laboratory Guide Page 2 Table of Contents Overview of the Nervous System ................................................................................................................ 3 Laboratory Exercise #1: External Anatomy of the Brain ......................................................................... 19 Laboratory Exercise #2: Internal Organization of the Brain ..................................................................... 35 Graduate Neuroanatomy : Laboratory Guide Page 3 Overview of the Nervous System Nachum Dafny, Ph.D. The human nervous system is divided into the central nervous system (CNS) and the peripheral nervous system (PNS). The CNS, in turn, is divided into the brain and the spinal cord, which lie in the cranial cavity of the skull and the vertebral canal, respectively. The CNS and the PNS, acting in concert, integrate sensory information and control motor and cognitive functions. The Central Nervous System (CNS) The adult human brain weighs between 1200 to 1500g and contains about one trillion cells. It occupies a volume of about 1400cc - approximately 2% of the total body weight, and receives 20% of the blood, oxygen, and calories supplied to the body. The adult spinal cord is approximately 40 to 50cm long and occupies about 150cc.
    [Show full text]
  • Traveling Cortical Netwaves Compose a Mindstream
    bioRxiv preprint doi: https://doi.org/10.1101/705947; this version posted April 29, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC 4.0 International license. Traveling cortical netwaves compose a mindstream Ernst Rudolf M. Hülsmann 26 Rue de Bonn. CH-3186 Guin. Switzerland. [email protected] ABSTRACT The brain creates a physical response out of signals in a cascade of streaming transformations. These transfor- mations occur over networks, which have been described in anatomical, cyto-, myeloarchitectonic and functional research. The totality of these networks has been modelled and synthesised in phases across a continuous time- space-function axis, through ascending and descending hierarchical levels of association1-3 via changing coalitions of traveling netwaves4-6, where localised disorders might spread locally throughout the neighbouring tissues. This study quantified the model empirically with time-resolving functional magnetic resonance imaging of an imperative, visually-triggered, self-delayed, therefor double-event related response task. The resulting time series unfold in the range of slow cortical potentials the spatio-temporal integrity of a cortical pathway from the source of perception to the mouth of reaction in and out of known functional, anatomical and cytoarchitectonic networks. These pathways are consolidated in phase images described by a small vector matrix, which leads to massive simplification of cortical field theory and even to simple technical applications. INTRODUCTION On a first sight it seems to be self-evident that a local perturbation within the cortical sheet should spread locally.
    [Show full text]
  • Clinical Anatomy of the Cranial Nerves Clinical Anatomy of the Cranial Nerves
    Clinical Anatomy of the Cranial Nerves Clinical Anatomy of the Cranial Nerves Paul Rea AMSTERDAM • BOSTON • HEIDELBERG • LONDON NEW YORK • OXFORD • PARIS • SAN DIEGO SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO Academic Press is an imprint of Elsevier Academic Press is an imprint of Elsevier 32 Jamestown Road, London NW1 7BY, UK The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, UK Radarweg 29, PO Box 211, 1000 AE Amsterdam, The Netherlands 225 Wyman Street, Waltham, MA 02451, USA 525 B Street, Suite 1800, San Diego, CA 92101-4495, USA First published 2014 Copyright r 2014 Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangement with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods, professional practices, or medical treatment may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods, compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility.
    [Show full text]
  • A Circuit for Pupil Orienting Responses: Implications for Cognitive
    Available online at www.sciencedirect.com ScienceDirect A circuit for pupil orienting responses: implications for cognitive modulation of pupil size Chin-An Wang and Douglas P Munoz Pupil size, as a component of orienting, changes rapidly in target detection, perception, learning, memory, and de- response to local salient events in the environment, in addition cision making (e.g. [5–12]). to its well-known illumination-dependent modulation. Recent research has shown that visual, auditory, or audiovisual stimuli Changes in pupil size have also been associated with the can elicit transient pupil dilation, and the timing and size of the orienting response [13,14], we refer to these responses as evoked responses are systematically modulated by stimulus orienting-related pupil responses. The presentation of a salience. Moreover, weak microstimulation of the superior salient stimulus initiates a series of responses to orient the colliculus (SC), a midbrain structure involved in eye movements body for appropriate action, including not only saccades and attention, evokes similar transient pupil dilation, and attentional shifts [15,16], but also transient pupil suggesting that the SC coordinates the orienting response dilation [1,17 ,18 ,19 ]. The function of this pupil dila- which includes transient pupil dilation. Projections from the SC tion is thought to increase visual sensitivity [13], although to the pupil control circuitry provide a novel neural substrate empirical evidence to support the argument is lacking underlying pupil modulation
    [Show full text]
  • Repetition Suppression and Its Contextual Determinants in Predictive Coding
    cortex 80 (2016) 125e140 Available online at www.sciencedirect.com ScienceDirect Journal homepage: www.elsevier.com/locate/cortex Special issue: Review Repetition suppression and its contextual determinants in predictive coding * Ryszard Auksztulewicz and Karl Friston Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United Kingdom article info abstract Article history: This paper presents a review of theoretical and empirical work on repetition suppression in Received 8 June 2015 the context of predictive coding. Predictive coding is a neurobiologically plausible scheme Reviewed 27 August 2015 explaining how biological systems might perform perceptual inference and learning. From Revised 7 September 2015 this perspective, repetition suppression is a manifestation of minimising prediction error Accepted 11 November 2015 through adaptive changes in predictions about the content and precision of sensory inputs. Published online 19 January 2016 Simulations of artificial neural hierarchies provide a principled way of understanding how repetition suppression e at different time scales e can be explained in terms of inference Keywords: and learning implemented under predictive coding. This formulation of repetition sup- Repetition suppression pression is supported by results of numerous empirical studies of repetition suppression Predictive coding and its contextual determinants. Mismatch negativity © 2016 The Authors. Published by Elsevier Ltd. This is an open access article under the CC Perceptual inference BY license (http://creativecommons.org/licenses/by/4.0/). Perceptual learning Egner, 2008). The predictive coding framework provides a 1. Introduction principled explanation of repetition effects in terms of perceptual inference and learning, mediated by changes in The effect of stimulus repetition on neural responses is one of synaptic efficacy (Friston, 2005).
    [Show full text]
  • Dynamic Causal Modelling of Active Vision
    This Accepted Manuscript has not been copyedited and formatted. The final version may differ from this version. Research Articles: Systems/Circuits Dynamic causal modelling of active vision Thomas Parr1, M. Berk Mirza1, Hayriye Cagnan2,3 and Karl J Friston1 1Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, WC1N 3BG, UK. 2MRC Brain Network Dynamics Unit at the University of Oxford 3Nuffield Department of Clinical Neurosciences, University of Oxford https://doi.org/10.1523/JNEUROSCI.2459-18.2019 Received: 24 September 2018 Revised: 8 March 2019 Accepted: 11 March 2019 Published: 10 June 2019 Author contributions: T.P. and K.F. designed research; T.P. performed research; T.P. analyzed data; T.P. wrote the first draft of the paper; T.P., M.B.M., H.C., and K.F. edited the paper; M.B.M., H.C., and K.F. wrote the paper. Conflict of Interest: The authors declare no competing financial interests. TP is supported by the Rosetrees Trust (Award Number 173346). KJF is a Wellcome Principal Research Fellow (Ref: 088130/Z/09/Z). MBM is a member of PACE (Perception and Action in Complex Environments) supported by the European Union's Horizon 2020 (Marie Sklodowska-Curie Grant Agreement 642961). HC is supported by the MRC (MR/R020418/1). We are grateful to David Bradbury and Eric Featherstone for their technical support and to the WCHN MEG group for helpful discussions. Correspondence: Thomas Parr, The Wellcome Centre for Human Neuroimaging, Institute of Neurology, 12 Queen Square, London, UK WC1N 3BG, [email protected] Cite as: J.
    [Show full text]
  • Spatial Realization of Escher's Impossible World
    Asia Pacific Mathematics Newsletter Spatial Realization of Escher’s Impossible World Kokichi Sugihara Abstract— M. C. Escher, a Dutch artist, created a series of endless loop of stairs can be realized as a solid model, as shown in lithographs presenting “impossible” objects and “impossible” Fig. 1 [17], [18]. We call this trick the “non-rectangularity trick”, motions. Although they are usually called “impossible”, some because those solid objects have non-rectangular face angles that of them can be realized as solid objects and physical motions in look rectangular. the three-dimensional space. The basic idea for these realizations is to use the degrees of freedom in the reconstruction of solids from pictures. First, the set of all solids represented by a given picture is represented by a system of linear equations and inequalities. Next the distribution of the freedom is characterized by a matroid extracted from this system. Then, a robust method for reconstructing solids is constructed and applied to the spatial realization of the “impossible” world. I. INTRODUCTION There is a class of pictures called “anomalous pictures” or “pictures of impossible objects”. These pictures generate optical illusion; when we see them, we have impressions of three- (a) (b) dimensional object structures, but at the same time we feel that such objects are not realizable. The Penrose triangle [13] is one of the oldest such pictures. Since the discovery of this triangle, many pictures belonging to this class have been discovered and studied in the field of visual psychology [9], [14]. The pictures of impossible objects have also been studied from a mathematical point of view.
    [Show full text]
  • Multisensory Interaction in Saccadic Reaction Time: a Time-Window-Of-Integration Model
    Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model Hans Colonius1 and Adele Diederich2 Abstract & Saccadic reaction time to visual targets tends to be faster transformations necessary for coordinated head and eye when stimuli from another modality (in particular, audition movements. However, because these models do not capture and touch) are presented in close temporal or spatial the temporal coincidences critical for multisensory integration proximity even when subjects are instructed to ignore the to occur, they cannot easily predict multisensory effects accessory input (focused attention task). Multisensory inter- observed in behavioral data such as saccadic reaction times. action effects measured in neural structures involved in This article proposes a quantitative stochastic framework, the saccade generation (in particular, the superior colliculus) have time-window-of-integration model, to account for the tempo- demonstrated a similar spatio-temporal dependence. Neural ral rules of multisensory integration. Saccadic responses network models of multisensory spatial integration have been collected from a visual–tactile focused attention task are shown to generate convergence of the visual, auditory, and shown to be consistent with the time-window-of-integration tactile reference frames and the sensorimotor coordinate model predictions. & INTRODUCTION an area clearly involved in saccade generation (Robin- Saccades are fast, voluntary movements of the eyes to son, 1972). Multisensory neurons in SC of anesthetized align the high-resolution fovea with objects and events cats (Meredith & Stein, 1986a, 1986b; Stein, Magalhaes- of interest. In a natural environment, saccades are part Castro, & Kruger, 1976) and monkeys (Wallace, Wilkin- of a rapid goal-directed orienting response, often includ- son, & Stein, 1996) show an enhanced response to ing head movements, to stimuli occurring in the periph- particular combinations of visual, auditory, and tactile ery.
    [Show full text]
  • Eye Movements While Ascending and Descending Staircases in Koshien Hotel: Comparison with Architecture Studio
    Intercultural Understanding, 2011, volume 1, pages 59-71 Eye Movements while Ascending and Descending Staircases in Koshien Hotel: Comparison with Architecture Studio Toshitomo Suzuki1 and Shigeyuki Okazaki1 1 Department of Architecture, Mukogawa Women’s University, Nishinomiya, Japan Corresponding author: Toshitomo Suzuki, Department of Architecture, Mukogawa Women’s University, 1-13 Tozaki-cho, Nishinomiya, Hyogo, 663-8121, Japan, E-mail: [email protected] Keywords: eye movement, staircase, Koshien Hotel, visual perception, ambulation, occluding edge, fixation Abstract: We conducted experiments in which participants wearing an eye camera ascended and descended two staircases in the former Koshien Hotel designed by Arata Endo and one staircase in the Architecture Studio, a contemporary university building. Analyses and discussion, which concentrated on the relationship among footings, visible occluding edges, distributions of eye movement direction, and total fixation time by fixation spot, found similarities and differences of eye movement directions and fixation spots among the staircases. The staircases in the Koshien Hotel were probably designed for rich spatial experiences while ascending them due to great changes of eye movements. However, they were also designed for changes of eye movements while descending them. 1. Introduction architectural masterpiece, and the staircase in the Architecture Studio, a contemporary university building completed in 2007. We grasp such living spaces as architectural and urban spaces The Koshien Hotel was designed by Arata Endo and and gardens through visual perception and ambulation. We completed in 1930. Endo studied architectural design from Frank cannot walk without visual perception, and we cannot grasp Lloyd Wright, and together they designed the Imperial Hotel and intricately shaped spaces without ambulation.
    [Show full text]