Emo Onally Looking Eyes

Total Page:16

File Type:pdf, Size:1020Kb

Emo Onally Looking Eyes Emo$onally Looking Eyes 2012 Winter vacaon internship Gahye Park Introduc$on • Overview – Review – Goal • Progress summary • Progress – Weekly progress & Difficules • Conclusion Overview - Review • Volume Rendering – Rendering data set like a group of 2D slice images ac quired by a CT, MRI, or MicroCT scanner • Volume ray cas$ng – Ray cas$ng, Sampling, Shading, Composing Overview - Review • Exis$ng eyeball rendering – Eyeball • Ar$ficial 3D model – Iris • Paste texture • Overlapped semi-transparent layers – Ar$ficial data – Lack of depth informaon Overview - Goal • Rendering emo$onally looking eyes – Real anatomical data – Include human $ssue informaon → Natural liveliness Progress Summary • Find eyeball or similar 3rd • Learn voreen (video, programming tutorials) • Render data similar to eyeball by • Find volume data and render it by voreen week voreen(VOlume REndering ENgine) • Learn voreen(slides tutorial) th • Get scanned eyeball data 4 • Find dicom data for segmentaon • Extract and refine eyeball data week • Extract eyes and check this briefly using Seg3D and voreen • 30, 2/1 : hci 2013 5th • Refine and finish extrac:ng 2 ct results • Adjust OTF(Opacity Transfer Func$on) week table • Parcipate HCI conference 1st • Finish adJus:ng o table • Adjust OTF table and shader week • Learn volume rendering tutorial for shader coding 2nd • Adjust OTF table and shader week • vacaon • Lunar new year & Vacaon rd • vacaon 3 • Vacaon week • Analyze results and improvement 4th • Consider expected effect • Analyze exis:ng shader code week • Complete the project • Prepare progress the presentaon Progress (Jan. 3rd week) • Find volume data set – The Volume Library head data set Descripon Picture MRI Head 14M 256x256x256 MRI Woman 7.7M 256x256x109 CT Visible Male 2.8M 128x256x256 Progress (Jan. 3rd week) • Refine and render the data by voreen Clip glslRaycaster Adjust OTF Table → singleVolumeRaycaster Voreen(VOlume REndering ENgine) • Framework – Core library : Processors, ports, proper$es – Qt library : GUI components Progress (Jan. 3rd week) • Difficules – no separated eyeball data → segmentaon method is required – low resoluon → find other data Progress (Jan. 4th week) • DICOM(Digital Imaging and Communicaons in Medi cine) sample image sets – Available for segmentaon (image series) – Higher resolu$on – 2 ct samples and 2 mr samples Progress (Jan. 4th week) • Extract eyes and check briefly using Seg3D and voreen Progress (Jan. 4th week) • Difficules – MR data is sparse → use ct data Progress (Jan. 5th week) • Refine and finish extrac$ng 2 ct results – segment again • Adjust OTF Table Progress (Jan. 5th week) • Difficules – Segment and Adjust o table manually – Insufficient in adjus$ng glsl raycaster OTF Table Progress (Feb. 1st week) • Learn local volume illuminaon tutorial – Prepare to shader coding – part of euro graphics 2006 – ambient + diffuse + specular – Volume illuminaon types • Alenuaon and single/mul$ple scaering Progress (Feb. 1st week) • Volume lighng : normalized gradient vector – Es$mate by finite differences • Forward, backward, central difference – Gradient-based illuminaon • Pre-computed Gradients : Use an addi$onal texture • On-the-fly Gradient Es$maon • On-the-fly Direc$onal Derivave : Approximate dot product Progress (Feb. 4th week) • Analyze exis$ng shader code – glsl raycaster Processor • Support ray cas$ng based on GLSL(shading language for OpenGL) • Have Shader property – Vertex shader, fragment shader, geometry shader – Shader code : .frag file Progress (Feb. 4th week) • Analyze exis$ng shader code Progress (Feb. 4th week) Progress (Feb. 4th week) Conclusion • Compleon – Adjust glsl raycaster OTF Table – Modify Shader code – Complement Eye ball CT data by combining MRI dat a • Impression Thank you .
Recommended publications
  • The Table Lens: Merging Graphical and Symbolic Representations in an Interactive Focus+ Context Visualization for Tabular Information
    HumanFac(orsinComputingSystems CHI’94 0 “Celebra/i//ghrferdepende)~cc” The Table Lens: Merging Graphical and Symbolic Representations in an Interactive Focus+ Context Visualization for Tabular Information Ramana Rao and Stuart K. Card Xerox Palo Alto Research Center 3333 Coyote Hill Road Palo Alto, CA 94304 Gao,carcM@parc. xerox.com ABSTRACT (at cell size of 100 by 15 pixels, 82dpi). The Table Lens can We present a new visualization, called the Table Lens, for comfortably manage about 30 times as many cells and can visualizing and making sense of large tables. The visual- display up to 100 times as many cells in support of many ization uses a focus+ccmtext (fisheye) technique that works tasks. The scale advantage is obtained by using a so-called effectively on tabular information because it allows display “focus+context” or “fisheye” technique. These techniques of crucial label information and multiple distal focal areas. allow interaction with large information structures by dynam- In addition, a graphical mapping scheme for depicting table ically distorting the spatial layout of the structure according to contents has been developed for the most widespread kind the varying interest levels of its parts. The design of the Table of tables, the cases-by-variables table. The Table Lens fuses Lens technique has been guided by the particular properties symbolic and gaphical representations into a single coherent and uses of tables. view that can be fluidly adjusted by the user. This fusion and A second contribution of our work is the merging of graphical interactivity enables an extremely rich and natural style of representations directly into the process of table visualization direct manipulation exploratory data analysis.
    [Show full text]
  • Army Acquisition Workforce Dependency on E-Mail for Formal
    ARMY ACQUISITION WORKFORCE DEPENDENCY ON E-MAIL FOR FORMAL WORK COORDINATION: FINDINGS AND OPPORTUNITIES FOR WORKFORCE PERFORMANCE IMPROVEMENT THROUGH E-MAIL-BASED SOCIAL NETWORK ANALYSIS KENNETH A. LORENTZEN May 2013 PUBLISHED BY THE DEFENSE ACQUISITION UNIVERSITY PRESS PROJECT ADVISOR: BOB SKERTIC CAPITAL AND NORTHEAST REGION, DAU THE SENIOR SERVICE COLLEGE FELLOWSHIP PROGRAM ABERDEEN PROVING GROUND, MD PAGE LEFT BLANK INTENTIONALLY .ARMY ACQUISITION WORKFORCE DEPENDENCY ON E-MAIL FOR FORMAL WORK COORDINATION: FINDINGS AND OPPORTUNITIES FOR WORKFORCE PERFORMANCE IMPROVEMENT THROUGH E-MAIL-BASED SOCIAL NETWORK ANALYSIS KENNETH A. LORENTZEN May 2013 PUBLISHED BY THE DEFENSE ACQUISITION UNIVERSITY PRESS PROJECT ADVISOR: BOB SKERTIC CAPITAL AND NORTHEAST REGION, DAU THE SENIOR SERVICE COLLEGE FELLOWSHIP PROGRAM ABERDEEN PROVING GROUND, MD PAGE LEFT BLANK INTENTIONALLY ii Table of Contents Table of Contents ............................................................................................................................ ii List of Figures ................................................................................................................................ vi Abstract ......................................................................................................................................... vii Chapter 1—Introduction ................................................................................................................. 1 Background and Motivation .................................................................................................
    [Show full text]
  • Geotime As an Adjunct Analysis Tool for Social Media Threat Analysis and Investigations for the Boston Police Department Offeror: Uncharted Software Inc
    GeoTime as an Adjunct Analysis Tool for Social Media Threat Analysis and Investigations for the Boston Police Department Offeror: Uncharted Software Inc. 2 Berkeley St, Suite 600 Toronto ON M5A 4J5 Canada Business Type: Canadian Small Business Jurisdiction: Federally incorporated in Canada Date of Incorporation: October 8, 2001 Federal Tax Identification Number: 98-0691013 ATTN: Jenny Prosser, Contract Manager, [email protected] Subject: Acquiring Technology and Services of Social Media Threats for the Boston Police Department Uncharted Software Inc. (formerly Oculus Info Inc.) respectfully submits the following response to the Technology and Services of Social Media Threats RFP. Uncharted accepts all conditions and requirements contained in the RFP. Uncharted designs, develops and deploys innovative visual analytics systems and products for analysis and decision-making in complex information environments. Please direct any questions about this response to our point of contact for this response, Adeel Khamisa at 416-203-3003 x250 or [email protected]. Sincerely, Adeel Khamisa Law Enforcement Industry Manager, GeoTime® Uncharted Software Inc. [email protected] 416-203-3003 x250 416-708-6677 Company Proprietary Notice: This proposal includes data that shall not be disclosed outside the Government and shall not be duplicated, used, or disclosed – in whole or in part – for any purpose other than to evaluate this proposal. If, however, a contract is awarded to this offeror as a result of – or in connection with – the submission of this data, the Government shall have the right to duplicate, use, or disclose the data to the extent provided in the resulting contract. GeoTime as an Adjunct Analysis Tool for Social Media Threat Analysis and Investigations 1.
    [Show full text]
  • Inviwo — a Visualization System with Usage Abstraction Levels
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, VOL X, NO. Y, MAY 2019 1 Inviwo — A Visualization System with Usage Abstraction Levels Daniel Jonsson,¨ Peter Steneteg, Erik Sunden,´ Rickard Englund, Sathish Kottravel, Martin Falk, Member, IEEE, Anders Ynnerman, Ingrid Hotz, and Timo Ropinski Member, IEEE, Abstract—The complexity of today’s visualization applications demands specific visualization systems tailored for the development of these applications. Frequently, such systems utilize levels of abstraction to improve the application development process, for instance by providing a data flow network editor. Unfortunately, these abstractions result in several issues, which need to be circumvented through an abstraction-centered system design. Often, a high level of abstraction hides low level details, which makes it difficult to directly access the underlying computing platform, which would be important to achieve an optimal performance. Therefore, we propose a layer structure developed for modern and sustainable visualization systems allowing developers to interact with all contained abstraction levels. We refer to this interaction capabilities as usage abstraction levels, since we target application developers with various levels of experience. We formulate the requirements for such a system, derive the desired architecture, and present how the concepts have been exemplary realized within the Inviwo visualization system. Furthermore, we address several specific challenges that arise during the realization of such a layered architecture, such as communication between different computing platforms, performance centered encapsulation, as well as layer-independent development by supporting cross layer documentation and debugging capabilities. Index Terms—Visualization systems, data visualization, visual analytics, data analysis, computer graphics, image processing. F 1 INTRODUCTION The field of visualization is maturing, and a shift can be employing different layers of abstraction.
    [Show full text]
  • A Process for Digitizing and Simulating Biologically Realistic Oligocellular Networks Demonstrated for the Neuro-Glio-Vascular Ensemble Edited By: Yu-Guo Yu, Jay S
    fnins-12-00664 September 27, 2018 Time: 15:25 # 1 METHODS published: 25 September 2018 doi: 10.3389/fnins.2018.00664 A Process for Digitizing and Simulating Biologically Realistic Oligocellular Networks Demonstrated for the Neuro-Glio-Vascular Ensemble Edited by: Yu-Guo Yu, Jay S. Coggan1 †, Corrado Calì2 †, Daniel Keller1, Marco Agus3,4, Daniya Boges2, Fudan University, China * * Marwan Abdellah1, Kalpana Kare2, Heikki Lehväslaiho2,5, Stefan Eilemann1, Reviewed by: Renaud Blaise Jolivet6,7, Markus Hadwiger3, Henry Markram1, Felix Schürmann1 and Clare Howarth, Pierre J. Magistretti2 University of Sheffield, United Kingdom 1 Blue Brain Project, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland, 2 Biological and Environmental Ying Wu, Sciences and Engineering Division, King Abdullah University of Science and Technology, Thuwal, Saudi Arabia, 3 Visual Xi’an Jiaotong University, China Computing Center, King Abdullah University of Science and Technology, Thuwal, Saudi Arabia, 4 CRS4, Center of Research *Correspondence: and Advanced Studies in Sardinia, Visual Computing, Pula, Italy, 5 CSC – IT Center for Science, Espoo, Finland, Jay S. Coggan 6 Département de Physique Nucléaire et Corpusculaire, University of Geneva, Geneva, Switzerland, 7 The European jay.coggan@epfl.ch; Organization for Nuclear Research, Geneva, Switzerland [email protected] Corrado Calì [email protected]; One will not understand the brain without an integrated exploration of structure and [email protected] function, these attributes being two sides of the same coin: together they form the †These authors share first authorship currency of biological computation. Accordingly, biologically realistic models require the re-creation of the architecture of the cellular components in which biochemical reactions Specialty section: This article was submitted to are contained.
    [Show full text]
  • Image Processing on Optimal Volume Sampling Lattices
    Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 1314 Image processing on optimal volume sampling lattices Thinking outside the box ELISABETH SCHOLD LINNÉR ACTA UNIVERSITATIS UPSALIENSIS ISSN 1651-6214 ISBN 978-91-554-9406-3 UPPSALA urn:nbn:se:uu:diva-265340 2015 Dissertation presented at Uppsala University to be publicly examined in Pol2447, Informationsteknologiskt centrum (ITC), Lägerhyddsvägen 2, hus 2, Uppsala, Friday, 18 December 2015 at 10:00 for the degree of Doctor of Philosophy. The examination will be conducted in English. Faculty examiner: Professor Alexandre Falcão (Institute of Computing, University of Campinas, Brazil). Abstract Schold Linnér, E. 2015. Image processing on optimal volume sampling lattices. Thinking outside the box. (Bildbehandling på optimala samplingsgitter. Att tänka utanför ramen). Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 1314. 98 pp. Uppsala: Acta Universitatis Upsaliensis. ISBN 978-91-554-9406-3. This thesis summarizes a series of studies of how image quality is affected by the choice of sampling pattern in 3D. Our comparison includes the Cartesian cubic (CC) lattice, the body- centered cubic (BCC) lattice, and the face-centered cubic (FCC) lattice. Our studies of the lattice Brillouin zones of lattices of equal density show that, while the CC lattice is suitable for functions with elongated spectra, the FCC lattice offers the least variation in resolution with respect to direction. The BCC lattice, however, offers the highest global cutoff frequency. The difference in behavior between the BCC and FCC lattices is negligible for a natural spectrum. We also present a study of pre-aliasing errors on anisotropic versions of the CC, BCC, and FCC sampling lattices, revealing that the optimal choice of sampling lattice is highly dependent on lattice orientation and anisotropy.
    [Show full text]
  • Direct Volume Rendering with Nonparametric Models of Uncertainty
    Direct Volume Rendering with Nonparametric Models of Uncertainty Tushar Athawale, Bo Ma, Elham Sakhaee, Chris R. Johnson, Fellow, IEEE, and Alireza Entezari, Senior Member, IEEE Fig. 1. Nonparametric models of uncertainty improve the quality of reconstruction and classification within an uncertainty-aware direct volume rendering framework. (a) Improvements in topology of an isosurface in the teardrop dataset (64 × 64 × 64) with uncertainty due to sampling and quantization. (b) Improvements in classification (i.e., bones in gray and kidneys in red) of the torso dataset with uncertainty due to downsampling. Abstract—We present a nonparametric statistical framework for the quantification, analysis, and propagation of data uncertainty in direct volume rendering (DVR). The state-of-the-art statistical DVR framework allows for preserving the transfer function (TF) of the ground truth function when visualizing uncertain data; however, the existing framework is restricted to parametric models of uncertainty. In this paper, we address the limitations of the existing DVR framework by extending the DVR framework for nonparametric distributions. We exploit the quantile interpolation technique to derive probability distributions representing uncertainty in viewing-ray sample intensities in closed form, which allows for accurate and efficient computation. We evaluate our proposed nonparametric statistical models through qualitative and quantitative comparisons with the mean-field and parametric statistical models, such as uniform and Gaussian, as well as Gaussian mixtures. In addition, we present an extension of the state-of-the-art rendering parametric framework to 2D TFs for improved DVR classifications. We show the applicability of our uncertainty quantification framework to ensemble, downsampled, and bivariate versions of scalar field datasets.
    [Show full text]
  • Word 2016: Working with Tables
    Word 2016: Working with Tables A table is made up of rows and columns. The intersection of a row and column is called a cell. Tables are often used to organize and present information, but they have a variety of uses as well. You can use tables to align numbers and create interesting page layouts. Creating a Table 1) Click the Insert tab on the Ribbon 2) Click on Table 3) Highlight the number of columns and rows you’d like OR 4) Click Insert Table 5) Click the arrows to select the desired number of columns 6) Click the arrows to select the desired number of rows 7) Click OK Navigating in a Table Please see below to learn how to move around within a table. Action Description Tab key To move from one cell in the table to another. When you reach the last cell in a table, pressing the Tab key will create a new row. Shift +Tab keys To move one cell backward in a table. Arrow keys Allow you to move left, right, up and down. 4 - 17 1 Selecting All or Part of a Table There are times you want to select a single cell, an entire row or column, multiple rows or columns, or an entire table. Selecting an Individual Cell To select an individual cell, move the mouse to the left side of the cell until you see it turn into a black arrow that points up and to the right. Click in the cell at that point to select it. Selecting Rows and Columns To select a row in a table, move the cursor to the left of the row until it turns into a white arrow pointing up and to the right, as shown below.
    [Show full text]
  • Table Understanding Through Representation Learning
    TURL: Table Understanding through Representation Learning Xiang Deng∗ Huan Sun∗ Alyssa Lees The Ohio State University The Ohio State University Google Research Columbus, Ohio Columbus, Ohio New York, NY [email protected] [email protected] [email protected] You Wu Cong Yu Google Research Google Research New York, NY New York, NY [email protected] [email protected] ABSTRACT Relational tables on the Web store a vast amount of knowledge. Owing to the wealth of such tables, there has been tremendous progress on a variety of tasks in the area of table understanding. However, existing work generally relies on heavily-engineered task- specific features and model architectures. In this paper, we present TURL, a novel framework that introduces the pre-training/fine- tuning paradigm to relational Web tables. During pre-training, our framework learns deep contextualized representations on relational tables in an unsupervised manner. Its universal model design with pre-trained representations can be applied to a wide range of tasks with minimal task-specific fine-tuning. Specifically, we propose a structure-aware Transformer encoder to model the row-column structure of relational tables, and present a new Masked Entity Recovery (MER) objective for pre-training to capture the semantics and knowledge in large-scale unlabeled data. Figure 1: An example of a relational table from Wikipedia. We systematically evaluate TURL with a benchmark consisting of 6 different tasks for table understanding (e.g., relation extraction, a total of 14.1 billion tables in 2008. More recently, Bhagavatula et al. cell filling). We show that TURL generalizes well to all tasks and [4] extracted 1.6M high-quality relational tables from Wikipedia.
    [Show full text]
  • VTK File Formats
    File Formats for VTK Version 4.2 (Taken from The VTK User’s Guide Contact Kitware www.kitware.com to purchase) VTK File Formats The Visualization Toolkit provides a number of source and writer objects to read and write popular data file formats. The Visualization Toolkit also provides some of its own file formats. The main reason for creating yet another data file format is to offer a consistent data representation scheme for a variety of dataset types, and to provide a simple method to com- municate data between software. Whenever possible, we recommend that you use formats that are more widely used. But if this is not possible, the Visualization Toolkit formats described here can be used instead. Note that these formats may not be supported by many other tools. There are two different styles of file formats available in VTK. The simplest are the legacy, serial formats that are easy to read and write either by hand or programmatically. However, these formats are less flexible than the XML based file formats described later in this section. The XML formats support random access, parallel I/O, and portable data com- pression and are preferred to the serial VTK file formats whenever possible. Simple Legacy Formats The legacy VTK file formats consist of five basic parts. 1. The first part is the file version and identifier. This part contains the single line: # vtk DataFile Version x.x. This line must be exactly as shown with the exception of the version number x.x, which will vary with different releases of VTK.
    [Show full text]
  • Medical and Volume Visualization SIGGRAPH 2015
    Medical and Volume Visualization SIGGRAPH 2015 Nicholas Polys, PhD & Michael Aratow, MD, FACEP Web3D Consortium www.web3d.org Medical WG Chairs Ander Arbelaiz, Luis Kabongo, Aitor Moreno Vicomtech-IK4 Darrell Hurt, Meaghan Coakley, James Terwitt-Drake National Institute of Health (NIH) Daniel Evestedt, Sebastian Ullrich Sensegraphics Update ! Web3D 2015 Annual Conference • Sponsored by ACM SIGGRAPH • in Cooperation with Web3D Consortium and Eurographics • 20th Annual held in Heraklion, Crete June 2015 – See papers @ siggraph.org and acm dl! • Next year in Anaheim co-located with SIGGRAPH Medical and Volume Visualization - X3D highlights - X3DOM (X3D + HTML5 + WebGL) Consortium • Content is King ! – Author and deploy interactive 3D assets and environments with confidence, royalty-free – Required: Portability, Interoperability, Durability • Not-for-profit, member-driven organization • International community of creators, developers, and users building evolving over 20 years of graphics and web technologies • Open Standards ratification (ISO/IEC) Medical and Volume Visualization The Web3D Consortium Medical Working Group is chartered to advance open 3D communication in the healthcare enterprise • BOFs, workshops, and progress since 2008 when TATRC sparked the flame with ISO/IEC Volume Component in X3D PUBLIC WIKI: http://www.web3d.org/wiki/index.php/X3D_Medical Web3D.org Medical Working Group • Reproducible rendering and presentations for stakeholders throughout the healthcare enterprise (and at home): – Structured and interactive virtual
    [Show full text]
  • Visflow - Web-Based Visualization Framework for Tabular Data with a Subset Flow Model
    VisFlow - Web-based Visualization Framework for Tabular Data with a Subset Flow Model Bowen Yu and Claudio´ T. Silva Fellow, IEEE Fig. 1. An overview of VisFlow. The user edits the VisFlow data flow diagram that corresponds to an interactive visualization web application in the VisMode. The model years of the user selected outliers in the scatterplot (b) are used to find all car models designed in those years (1981, 1982), which form a subset S that is visualized in three metaphors: a table for displaying row details (i), a histogram for horsepower distribution (j) and a heatmap for multi-dimensional visualization (k). The selected outliers are highlighted in red in the downflow of (b). The user selection in the parallel coordinates are brushed in blue and unified with S to be shown in (i), (j), (k). A heterogeneous table that contains the MDS coordinates of the cars are loaded in (l) and visualized in the MDS plot (q), with S being visually linked in yellow color among the other cars. Abstract— Data flow systems allow the user to design a flow diagram that specifies the relations between system components which process, filter or visually present the data. Visualization systems may benefit from user-defined data flows as an analysis typically consists of rendering multiple plots on demand and performing different types of interactive queries across coordinated views. In this paper, we propose VisFlow, a web-based visualization framework for tabular data that employs a specific type of data flow model called the subset flow model. VisFlow focuses on interactive queries within the data flow, overcoming the limitation of interactivity from past computational data flow systems.
    [Show full text]