GPU Implementation Applied to Retinal and Cortical Vision Processes Jean-Charles Quinton

Total Page:16

File Type:pdf, Size:1020Kb

GPU Implementation Applied to Retinal and Cortical Vision Processes Jean-Charles Quinton A generic library for structured real-time computations: GPU implementation applied to retinal and cortical vision processes Jean-Charles Quinton To cite this version: Jean-Charles Quinton. A generic library for structured real-time computations: GPU implementation applied to retinal and cortical vision processes. Machine Vision and Applications, Springer Verlag, 2010, 21 (4), pp.529-540. 10.1007/s00138-008-0180-9. hal-01966569 HAL Id: hal-01966569 https://hal.archives-ouvertes.fr/hal-01966569 Submitted on 28 Dec 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Machine Vision and Applications manuscript No. (will be inserted by the editor) A generic library for structured real-time computations GPU implementation applied to retinal and cortical vision processes Jean-Charles Quinton1 Computer Science Research Institute, National Polytechnic Institute, University of Toulouse, 2 rue Charles Camichel BP 7122 - F 31071 Toulouse Cedex 7, France Received: date / Revised version: date Abstract Most graphics cards in standard personal tion complexity really depend on the vision framework computers are now equipped with several pixel pipelines adopted, therefore various hypothesis that may benefit running shader programs. Taking advantage of this tech- from such a library are introduced. nology by transferring parallel computations from the CPU side to the GPU side increases the overall com- putational power even in non graphical applications by 1 Introduction freeing the main processor from an heavy work. A generic library is presented to show how anyone can bene- Whether one tries to implement biological or artificial fit from modern hardware by combining various vision systems, low-level processes are massively paral- techniques with little hardware specific program- lel. Visual perception is considered active in frameworks ming skills. Its shader implementation is applied such as interactivism, enaction or ecological vision. Such to retinal and cortical simulation. The purpose of approaches introduce temporal patterns of local antici- this sample application is not to provide a correct ap- pations in the retinal field resulting from eye saccades, proximation of real center surround ganglion or mid- body movements or environment dynamics. To some ex- dle temporal cells, but to illustrate how easily inter- tend, top-bottom modulations provide a way to reduce twined spatiotemporal filters can be applied on raw in- computations, concentrate on specific features and cope put pictures in real-time. Requirements and interconnec- with environmental/perceptual noise. Yet unanticipated Send offprint requests to: motion, rapid changes in brightness or any striking event 2 Jean-Charles Quinton (a) (b) (c) MT MT MT nervous signal equitemporal 1 2 3 4 1 2 3 4 1 2 3 4 assimilated movement non assimilated movement Fig. 1 Simplified one dimensional representation of anticipations performed by a Middle Temporal cortical cell (MT). (a) Inputs cells (1 and 2) get activated when an object moves in the field of view. The higher the input cell index (from 1 to 5), the lower the propagation time to the MT cell. (b) An assimilated movement will lead to the activation of the MT cell resulting from the synchrony of the signals. (c) Any movement that is either too fast, too slow or inverse will not lead to recognition. relative to current activity attract perception and must brary might be used as is, source code is provided not be processed to be taken into account. only to show how the wrapping of hardware specific func- tions is done, but also to convince the reader that good When high resolution frames are fully filtered, seg- performance can be achieved at low cost and with little mented and analyzed, for example when using computer effort. vision algorithms such as edge/feature point detectors or motion estimators, the high computational load required The library architecture consists of several layers ma- is obvious. Modeling retinal/cortical processes reproduc- nipulating filters. Filters not already implemented can ing center surround ganglion cells or middle temporal be defined by the user in a standard language, then (MT) cells behavior on wide receptive fields also intro- called from a script or a graphical user interface. The duces large-scale computations due to the variability of library then structures, orders and applies the filters on parameters such as speed, direction or receptor field size. the fly depending on temporal and spatial dependencies. This article does not introduce a new technology The lowest level layer can target central processing units nor algorithm, but combines different techniques and in- (CPU) or graphics processing units (GPU) depending on terfaces different programming languages to produce a available hardware. The library has been partly ported portable generic library which can be used and extended to support the Cell Broadband Engine and take advan- by anyone without any knowledge in the optimization tage of its synergistic processing elements. The huge ben- and graphics card programming fields. Though this li- efit from using vector instructions and such parallel ar- A generic library for structured real-time computations 3 chitectures is now affordable as the Cell BE is at the The portable implementation presented here is coded core of the Playstationr3 (installing Linux and the IBM in Java 1.6 using JOGL (Java bindings for OpenGL SDK is however required). But since PCs with powerful API), runs on low cost computers, allowing anyone to graphics cards are widespread today, the shader imple- implement and apply spatial and temporal filters on any mentation will be detailed. input source (computer generated or captured). Any in- termediate output is stored as a texture and can be fur- Recent changes and extensions on graphics cards now ther processed or extracted on request. As long as the allow us to implement parallel algorithms and use the user does not ask for a transfer to the computer main GPU rather than the CPU for real-time applications memory, all computations are performed on the graphics and higher performances. Many companies and laborato- card for speed improvement. Even if the hardware is in ries are investigating graphics hardware capabilities for constant evolution (render-to-texture for instance is general purpose computations but this article concen- now widespread), the reader inclined to know the speci- trates on how to easily make the most of it in a generic ficities and limitations of a GPU compared to a standard way for vision processes which share similarities with the CPU might read the paper of Michael Shantzis on the original aim of graphics card pipelines. Though several subject[23]. An example of application in the field of libraries exist for general purpose computations using retinal and cortical processes is detailed throughout this graphics hardware (GPGPU) such as RapidMind (pre- article. Although its purpose is neither to give an accu- viously known as Lib Sh)[9], Brook[6] or CUDA[2], they rate description of biological processes nor to give a full deal with data streams rather than pictures, integrate account of how to model and optimize such processes, it complex optimizations and include abstraction layers to illustrates the main capabilities of the library. be effective on any application. On the other hand, high 2 Theoretical framework integration level image processing frameworks such as CoreImage[1] or OpenVIDIA[12], neither generally provide access to Fast visual processes can be useful in any framework and intermediate results, handle time dependencies by de- a generic library needs to be compatible with all. fault nor support arbitrary hardware. Of course many The variability in vision theories is illustrated by task specific GPU enabled applications have also been the interactivist framework [5,7], implying a rad- developed across the world [12,17,24], but this paper is ical shift in the requirements for a vision library. an attempt to find a golden mean between generality Considering this approach, concepts and objects emerge and task dependence in the field of vision. from a network of interactions, each continuously an- 4 Jean-Charles Quinton Graphics card memory ... Input textures Pixel shader Optional parameters Output texture Shader source code Fig. 2 Textures combination by a GPU pixel shader. ticipating events resulting from taken actions. What is matching is correct. If the context is unambiguous enough, called events can be the activity of other internal pro- there is no need for further exploration as soon as the cesses or direct perceptions from various modalities. It activity in a highly connected part of the network, cor- is quite similar to Jean Piaget’s sensori-motor theory responding to a concept, starts to rise above the oth- [22] or Gibson’s affordance theory [13,14]. More specifi- ers. Moreover due to regulation and relative comparison, cally when applied to vision, it shares many aspects of such processes are highly resistant to noise and easily O’Regan’s conclusions [20,21]. Local signals coming out adapt to variations in the environment. The resulting of the optical nerve as well as higher-level features can be behavior also allows reducing the evoked potentialities anticipated when eye saccades are performed. Though space, concentrating on specific features which are con- saccades might be considered as hindering the already textually relevant [18]. For instance when walking in a uneven visual perception, several studies focus on the crowd or driving in a dense traffic, human beings do usefulness and intentionality of saccades [27,19].
Recommended publications
  • Intro to Opengl
    Intro to OpenGL CS4620 Lecture 14 Guest Instructor: Nicolas Savva What is OpenGL? ● Open Graphics Library ● A low level API for 2D/3D rendering with the Graphics Hardware (GPU) ● Cross-platform (Windows, OS X, Linux, iOS, Android, ...) ● Developed by SGI in 1992 – 2014: OpenGL 4.5 – 2008: OpenGL 3.0 – 2006: OpenGL 2.1 ● Main alternative: DirectX/3D Cornell CS4620 Fall 2015 How does it fit in? ● Tap massive power of GPU hardware to render images ● Use GPU without caring about the exact details of the hardware Cornell CS4620 Fall 2015 CPU and GPU memory CPU BUS GPU SHADERS B B U U S S B U S F GPU MEMORY B SYSTEM MEMORY Display Cornell CS4620 Fall 2015 What OpenGL does for us ● Controls GPU ● Lets user specify resources...: – Geometry (vertices and primitives) – Textures – Shaders (programmable pieces of rendering pipeline) – Etc. ● ...and use them: – Rasterize and draw geometry Cornell CS4620 Fall 2015 How we will use OpenGL ● OpenGL version – We use 2.x-3.x (plus extensions) – Code avoids older, deprecated parts of OpenGL standard ● LWJGL – Lightweight Java Game Library – Java bindings for OpenGL API ● CS 4620/4621 Framework – Simplifies creating and using OpenGL resources Cornell CS4620 Fall 2015 LWJGL ● OpenGL originally written for C. ● LWJGL contains OpenGL binding for Java www.lwjgl.org/ ● Gives Java interface to C OpenGL commands ● Manages framebuffer (framebuffer: a buffer that holds the image that is displayed on the monitor) Cornell CS4620 Fall 2015 MainGame ● A window which can display GameScreens ● Initializes OpenGL context
    [Show full text]
  • Visualization and Geometric Interpretation of 3D Surfaces Donya Ghafourzadeh
    LiU-ITN-TEK-A-13/011-SE Visualization and Geometric Interpretation of 3D Surfaces Donya Ghafourzadeh 2013-04-30 Department of Science and Technology Institutionen för teknik och naturvetenskap Linköping University Linköpings universitet nedewS ,gnipökrroN 47 106-ES 47 ,gnipökrroN nedewS 106 47 gnipökrroN LiU-ITN-TEK-A-13/011-SE Visualization and Geometric Interpretation of 3D Surfaces Examensarbete utfört i Medieteknik vid Tekniska högskolan vid Linköpings universitet Donya Ghafourzadeh Handledare George Baravdish Examinator Sasan Gooran Norrköping 2013-04-30 Upphovsrätt Detta dokument hålls tillgängligt på Internet – eller dess framtida ersättare – under en längre tid från publiceringsdatum under förutsättning att inga extra- ordinära omständigheter uppstår. Tillgång till dokumentet innebär tillstånd för var och en att läsa, ladda ner, skriva ut enstaka kopior för enskilt bruk och att använda det oförändrat för ickekommersiell forskning och för undervisning. Överföring av upphovsrätten vid en senare tidpunkt kan inte upphäva detta tillstånd. All annan användning av dokumentet kräver upphovsmannens medgivande. För att garantera äktheten, säkerheten och tillgängligheten finns det lösningar av teknisk och administrativ art. Upphovsmannens ideella rätt innefattar rätt att bli nämnd som upphovsman i den omfattning som god sed kräver vid användning av dokumentet på ovan beskrivna sätt samt skydd mot att dokumentet ändras eller presenteras i sådan form eller i sådant sammanhang som är kränkande för upphovsmannens litterära eller konstnärliga anseende eller egenart. För ytterligare information om Linköping University Electronic Press se förlagets hemsida http://www.ep.liu.se/ Copyright The publishers will keep this document online on the Internet - or its possible replacement - for a considerable time from the date of publication barring exceptional circumstances.
    [Show full text]
  • Introduction to Opengl
    433-481 © Pearce 2001 Outline • OpenGL Background and History • Other Graphics Technology •Drawing • Viewing and Transformation • Lighting • JOGL and GLUT • Resources 433-380 Graphics and Computation Introduction to OpenGL Some images in these slides are taken from “The OpenGL Programming Manual”, which is copyright Addison Wesley and the OpenGL Architecture Review Board. http://www.opengl.org/documentation/red_book_1.0/ 2 OpenGL Background and History Other Graphics Technology • OpenGL = Open Graphics Library • Low Level Graphics • Developed at Silicon Graphics (SGI) • OpenGL • Successor to IrisGL • Cross Platform • Scene Graphs, BSPs (Win32, Mac OS X, Unix, Linux) – OpenSceneGraph, Java3D, VRML, • Only does 3D Graphics. No Platform Specifics PLIB (Windowing, Fonts, Input, GUI) • Version 1.4 widely available • DirectX (Direct3D) • Two Libraries – GL (Graphics Library) • Can mix some DirectX with OpenGL (e.g – GLU (Graphics Library Utilities) OpenGL and DirectInput in Quake III) 3 4 Platform Specifics The Drawing Process • Platform Specific OpenGL Interfaces ClearTheScreen(); DrawTheScene(); – Windows (WGL) CompleteDrawing(); – X11 (GLX) SwapBuffers(); – Mac OS X (CGL/AGL/NSOpenGL) – Motif (GLwMwidget) • In animation there are usually two buffers. Drawing usually occurs on the background buffer. When it is complete, it is brought to the – Qt (QGLWidget, QGLContext) front (swapped). This gives a smooth animation without the viewer • Java (JOGL) seeing the actual drawing taking place. Only the final image is viewed. • GLUT (GL Utility Library) • The technique to swap the buffers will depend on which windowing library you are using with OpenGL. 5 6 1 433-481 © Pearce 2001 Clearing the Window Setting the Colour glClearColor(0.0, 0.0, 0.0, 0.0); • Colour is specified in (R,G,B,A) form [Red, Green, Blue, Alpha], with glClear(GL_COLOR_BUFFER_BIT); each value being in the range of 0.0 to 1.0.
    [Show full text]
  • Achieving High and Consistent Rendering Performance of Java AWT/Swing on Multiple Platforms
    SOFTWARE—PRACTICE AND EXPERIENCE Softw. Pract. Exper. 2009; 39:701–736 Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/spe.920 Achieving high and consistent rendering performance of Java AWT/Swing on multiple platforms Yi-Hsien Wang and I-Chen Wu∗,† Department of Computer Science, National Chiao Tung University, Hsinchu, Taiwan SUMMARY Wang et al. (Softw. Pract. Exper. 2007; 37(7):727–745) observed a phenomenon of performance incon- sistency in the graphics of Java Abstract Window Toolkit (AWT)/Swing among different Java runtime environments (JREs) on Windows XP. This phenomenon makes it difficult to predict the performance of Java game applications. Therefore, they proposed a portable AWT/Swing architecture, called CYC Window Toolkit (CWT), to provide programmers with high and consistent rendering performance for Java game development among different JREs. They implemented a DirectX version to demonstrate the feasibility of the architecture. This paper extends the above research to other environments in two aspects. First, we evaluate the rendering performance of the original Java AWT with different combi- nations of JREs, image application programming interfaces, system properties and operating systems (OSs), including Windows XP, Windows Vista, Fedora and Mac OS X. The evaluation results indicate that the performance inconsistency of Java AWT also exists among the four OSs, even if the same hardware configuration is used. Second, we design an OpenGL version of CWT, named CWT-GL, to take advantage of modern 3D graphics cards, and compare the rendering performance of CWT with Java AWT/Swing. The results show that CWT-GL achieves more consistent and higher rendering performance in JREs 1.4 to 1.6 on the four OSs.
    [Show full text]
  • CS4621/5621 Fall 2015 Computer Graphics Practicum Intro to Opengl
    CS4621/5621 Fall 2015 Computer Graphics Practicum Intro to OpenGL/GLSL Professor: Kavita Bala Instructor: Nicolas Savva with slides from Balazs Kovacs, Eston Schweickart, Daniel Schroeder, Jiang Huang and Pramook Khungurn over the years. Announcements ● Course website: http://www.cs.cornell.edu/courses/CS4621/2015fa/ ● Piazza for practicum: https://piazza.com/cornell/fall2015/cs46215621/ ● First assignment GPUray (out soon) ● Graphics hardware diagnostic package Books and resources Today ● OpenGL over the decades ● Graphics Pipeline overview ● LWJGL basics (more of this next time) ● GLSL basics (our focus today) ● GPUray GPUray Overview • PPA1: port a simplified version of ray1 to GPU • Mostly deal with the fragment shader • LWJGL bindings (communicating with the GPU) • Shader compiling and linking • GLSL code GPUray Demo What is OpenGL? ● Open Graphics Library ● A low level API for 2D/3D rendering with the Graphics Hardware (GPU) ● Cross-platform (Windows, OS X, Linux, iOS, Android, ...) ● Developed by SGI in 1992 – 2014: OpenGL 4.5 – 2008: OpenGL 3.0 – 2006: OpenGL 2.1 ● Main alternative: DirectX/3D How does it fit in? ● Tap massive power of GPU hardware to render images ● Use GPU without caring about the exact details of the hardware What OpenGL does for us ● Controls GPU ● Lets user specify resources...: – Geometry (vertices and primitives) – Textures – Shaders (programmable pieces of rendering pipeline) – Etc. ● ...and use them: – Rasterize and draw geometry How we will use OpenGL ● OpenGL version – We use 2.x-3.x (plus extensions)
    [Show full text]
  • Opengl ESES Andand M3GM3G
    DevelopingDeveloping MobileMobile 3D3D ApplicationsApplications withwith OpenGLOpenGL ESES andand M3GM3G Kari Pulli Nokia Research Center & MIT CSAIL Jani Vaarala Nokia Ville Miettinen Hybrid Graphics Tomi Aarnio Nokia Research Center Mark Callow HI Corporation Today’sToday’s programprogram • Start at 1:45 • Break 3:30 – 3:45 • Intro • M3G Intro 10 min, Kari Pulli 5 min, Kari Pulli • OpenGL ES overview • M3G API overview 25 min, Kari Pulli 50 min, Tomi Aarnio • Using OpenGL ES • Using M3G 40 min, Jani Vaarala 45 min, Mark Callow • OpenGL ES • Closing & Q&A performance 5 min, Kari Pulli 30 min, Ville Miettinen • End at 5:30 ChallengesChallenges forfor mobilemobile gfxgfx • Small displays – getting much better • Computation – speed – power / batteries – thermal barrier • Memory MobileMobile graphicsgraphics applicationsapplications 3D Menu 3D Games 3D Animation Message from John ppy birt 3D Messaging Location services Advertising GSMGSM world:world: State-of-the-artState-of-the-art inin 20012001 • What’s the world’s most played electronic game? – The Guardian (May 2001) • Communicator demo 2001 – Remake of a 1994 Amiga demo – <10 year from PC to mobile • Began SW 3D engine at Nokia State-of-the-artState-of-the-art inin 2001:2001: JapanJapan (from(from AprilApril // May)May) J-SH51 J-SH07 by SHARP by SHARP Space Channel 5 GENKI 3D Characters ©SEGA/UGA,2001 ©SEGA/UGA,2002 (C) 2001 GENKI Snowboard Rider ©WOW ENTERTAINMENT INC., 2000-2002all rights reserved. ULALA (c)SEGA/UGA.2001 • High-level API with skinning, flat shading / texturing, orthographic
    [Show full text]
  • Javatm Platform Micro Edition Software Development Kit
    JavaTM Platform Micro Edition Software Development Kit Version 3.0 Sun Microsystems, Inc. www.sun.com April 2009 mesdk-feedback@sun.com Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology embodied in the product that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in other countries. U.S. Government Rights - Commercial software. Government users are subject to the Sun Microsystems, Inc. standard license agreement and applicable provisions of the FAR and its supplements. Use is subject to license terms. This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, Java, JavaFX, Java 2D, J2SE, Java SE, J2ME, Java ME, Javadoc, JavaTest, JAR, JDK, NetBeans, phoneME, and Solaris are trademarks or registered trademarks of Sun Microsystems, Inc. or its subsidiaries in the U.S. and other countries. Products covered by and information contained in this service manual are controlled by U.S. Export Control laws and may be subject to the export or import laws in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities identified on U.S. export exclusion lists, including, but not limited to, the denied persons and specially designated nationals lists is strictly prohibited.
    [Show full text]
  • Interpretive Opengl for Computer Graphics Bo Chen, Harry H
    ARTICLE IN PRESS Computers & Graphics 29 (2005) 331–339 www.elsevier.com/locate/cag Technical section Interpretive OpenGL for computer graphics Bo Chen, Harry H. Chengà Integration Engineering Laboratory, Department of Mechanical and Aeronautical Engineering, University of California, Davis, CA 95616, USA Abstract OpenGL is the industry-leading, cross-platform graphics application programming interface (API), and the only major API with support for virtually all operating systems. Many languages, such as Fortran, Java, Tcl/Tk, and Python, have OpenGL bindings to take advantage ofOpenGL visualization power. In this article, we present Ch OpenGL Toolkit, a truly platform-independent Ch binding to OpenGL for computer graphics. Ch is an embeddable C/ C++ interpreter for cross-platform scripting, shell programming, numerical computing, and embedded scripting. Ch extends C with salient numerical and plotting features. Like some mathematical software packages, such as MATLAB, Ch has built-in support for two and three-dimensional graphical plotting, computational arrays for vector and matrix computation, and linear system analysis with advanced numerical analysis functions based on LAPACK. Ch OpenGL Toolkit allows OpenGL application developers to write applications in a cross-platform environment, and all of the OpenGL application source code can readily run on different platforms without compilation and linking processes. In addition, the syntax ofCh OpenGL Toolkit is identical to C interfaceto OpenGL. Ch OpenGL Toolkit saves OpenGL programmers’ energies for solving problems without struggling with mastering new language syntax. Ch OpenGL Toolkit is embeddable. Embedded Ch OpenGL graphics engine enables graphical application developers or users to dynamically generate and manipulate graphics at run-time.
    [Show full text]
  • 2D Animation of Recursive Backtracking Maze Solution Using Javafx Versus AWT and Swing
    2020 International Conference on Computational Science and Computational Intelligence (CSCI) CSCI-ISSE Full/Regular Research Paper 2D Animation of Recursive Backtracking Maze Solution Using JavaFX Versus AWT and Swing Anil L. Pereira School of Science and Technology Georgia Gwinnett College Lawrenceville, GA, USA apereira@ggc.edu Abstract—This paper describes software developed by the AWT and Swing have been used widely in legacy software author, that constructs a two-dimensional graphical maze and uses [8]. Even though, software developers claim that there is a steep animation to visualize the recursive backtracking maze solution. learning curve for JavaFX [9], applications using AWT and The software is implemented using three Java graphics Swing are being rewritten with JavaFX. This is because of technologies, Java Abstract Window Toolkit, Java Swing and JavaFX’s look and feel and other features mentioned above. JavaFX. The performance of these technologies is evaluated with Also, the performance is claimed to be better, due to its graphics respect to their graphics rendering frame rate and heap memory rendering pipeline for modern graphics processing units (GPUs) utilization. The scalability of their rendering performance is [10]. This pipeline is comprised of: compared with respect to maze size and resolution of the displayed • A hardware accelerated graphics pipeline called Prism maze. A substantial performance gap between the technologies is reported, and the underlying issues that cause it are discussed, • A windowing toolkit for Prism called Glass such as memory management by the Java virtual machine, and • A Java2D software pipeline for unsupported graphics hardware accelerated graphics rendering. hardware • High-level support for making rich graphics simple Keywords—graphics; animation; JavaFX; Swing; AWT with Effects and 2D and 3D transforms I.
    [Show full text]
  • Sun Java Wireless Toolkit for CLDC User's Guide
    User’s Guide Sun JavaTM Wireless Toolkit for CLDC Version 2.5.2 Sun Microsystems, Inc. www.sun.com v252 September 2007 Copyright © 2007 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology embodied in the product that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in other countries. U.S. Government Rights - Commercial software. Government users are subject to the Sun Microsystems, Inc. standard license agreement and applicable provisions of the FAR and its supplements. Use is subject to license terms. This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, Java, Javadoc, Java Community Process, JCP,JDK, JRE, J2ME, and J2SE are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other countries. OpenGL is a registered trademark of Silicon Graphics, Inc. Products covered by and information contained in this service manual are controlled by U.S. Export Control laws and may be subject to the export or import laws in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities identified on U.S. export exclusion lists, including, but not limited to, the denied persons and specially designated nationals lists is strictly prohibited.
    [Show full text]
  • A Portable AWT/Swing Architecture for Java Game Development
    SOFTWARE—PRACTICE AND EXPERIENCE Softw. Pract. Exper. 2007; 37:727–745 Published online 2 November 2006 in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/spe.786 A portable AWT/Swing architecture for Java game development Yi-Hsien Wang, I-Chen Wu∗,† and Jyh-Yaw Jiang Department of Computer Science, National Chiao Tung University, Hsinchu, Taiwan SUMMARY Recently, the performance of Java platforms has been greatly improved to satisfy the requirements for game development. However, the rendering performance of Java 1.1, which is still used by about one-third of current Web browser users, is not sufficient for high-profile games. Therefore, practically, Java game developers, especially those who use applets, have to take this into consideration in most environments. In order to solve the above problems, this paper proposes a portable window toolkit architecture called the CYC Window Toolkit (CWT) with the ability to: (1) reach high rendering performance particularly in Java 1.1 applications and applets when using DirectX to render widgets in CWT; (2) support AWT/Swing compatible widgets, so hence the CWT can be easily applied to existing Java games; (3) define a general architecture that supports multiple graphics libraries such as AWT, DirectX and OpenGL, multiple virtual machines such as Java VM and .NET CLR, and multiple operating systems (OSs) such as Microsoft Windows, Mac OS and UNIX-based OSs; (4) provide programmers with one-to-one mapping APIs to directly manipulate DirectX objects and other game-related properties. The CWT has also been applied to an online Java game system to demonstrate the proposed architecture.
    [Show full text]
  • An Approach to 3D on the Web Using Java Opengl
    НАУЧНИ ТРУДОВЕ НА РУСЕНСКИЯ УНИВЕРСИТЕТ - 2009, том 48, серия 6.1 An Approach to 3D on the Web using Java OpenGL Tzvetomir Vassilev, Stanislav Kostadinov Един подход към 3D в интернет с използване на Java OpenGL: Статията описва един подход за визуализация на тримерни сцени с използване на Java OpenGL и XML. Разгледани са няколко съществуващи технологии и са описани техните предимства и недостатъци. Предложен е формат базиран върху X3D и Open Inventor и е разработено Java приложение за визуализацията му. С негова помощ могат да се създават аплети за визуализация на тримерни обекти. Размерът на приложението е малък и зареждането му става достатъчно бързо. Изисква се на клиетна да е инсталиран единствено Java plugin за съответния браузер. Key words: 3D visualization, OpenGL, XML. INTRODUCTION Web technologies developed very quickly in the recent years and penetrated many different fields in human life. More and more applications require visualization of three- dimensional (3D) objects. Different graphics libraries and packages have been developed, like OpenGL, Direct3D, Open Inventor, etc. However, there is no common standard and format for the visualization and storage of 3D objects on the Web. This paper describes several existing file formats and technologies for the visualization of 3D data on the web, addressing their features and disadvantages. It proposes a new format, based on Open Inventor and XML and describes a web application, based on Java OpenGL (JOGL). The user does not have to install any additional web browser plug-in for the visualization, apart from the widely used Java standard edition, which on many machines is pre-installed.
    [Show full text]