DOCSLIB.ORG

Visión Artificial Integrada Con Dispositivos De Realidad Virtual Inmersiva Aplicada a Videojuegos

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Visión Artificial Integrada Con Dispositivos De Realidad Virtual Inmersiva Aplicada a Videojuegos Universidad Carlos III de Madrid Grado de Ingeniería Informática Proyecto Fin de Carrera Visión artificial integrada con dispositivos de realidad virtual inmersiva aplicada a videojuegos Autor: Pablo Sánchez-Herrero Gómez Tutor: Yago Sáez Achaerandio Junio 2016 Contenido Índice ilustraciones ........................................................................................................................ 4 Índice de código ............................................................................................................................ 6 Resumen ........................................................................................................................................ 7 1. Introducción .............................................................................................................................. 9 2.Estado del arte ......................................................................................................................... 11 Sensores inerciales .................................................................................................................. 11 Wiimote(Wii remote) .............................................................................................................. 12 PlayStation Move y PlayStation camera.................................................................................. 14 Kinect ....................................................................................................................................... 17 Realidad virtual ....................................................................................................................... 22 Oculus Rift ........................................................................................................................... 23 PlayStationVR ...................................................................................................................... 27 HTC Vive .............................................................................................................................. 28 Comparación ....................................................................................................................... 32 3.Planteamiento del problema y alternativas de diseño ............................................................ 33 4.Planificación, marco regulador y entorno socioeconómico ..................................................... 37 Planificación ............................................................................................................................ 37 Marco regulador ...................................................................................................................... 38 Marco regulador de programa de seguimiento .................................................................. 38 Marco regulador de juego ................................................................................................... 39 Entorno socioeconómico y presupuesto ................................................................................. 40 Entorno socioeconómico ..................................................................................................... 40 Presupuesto proyecto ......................................................................................................... 41 5.Análisis y Diseño del problema ................................................................................................ 44 Requisitos ................................................................................................................................ 44 Descripción tabla requisitos ................................................................................................ 44 Requisitos funcionales programa de seguimiento .............................................................. 44 Requisitos funcionales juego ............................................................................................... 48 Requisitos no funcionales ................................................................................................... 57 Diseño arquitectónico ............................................................................................................. 61 Arquitectura física ............................................................................................................... 61 Arquitectura lógica .............................................................................................................. 63 6.Planteamiento de la solución ................................................................................................... 71 Desarrollo de la solución ......................................................................................................... 71 Explicación de la solución ........................................................................................................ 88 2 Explicación programa de seguimiento ................................................................................ 88 Explicación juego ................................................................................................................. 96 7.Conclusiones y posibles ampliaciones ................................................................................... 107 Summary ................................................................................................................................... 115 Introduction .......................................................................................................................... 115 Summary development ......................................................................................................... 116 Conclusion and possible extensions ...................................................................................... 121 Anexo tutorial configuración TFG para Windows Visual Studio 2015 ...................................... 127 Instalación Windows Kinect SDK ........................................................................................... 127 Instalación OpenCV ............................................................................................................... 127 Instalación OpenNI2 .............................................................................................................. 134 Bibliografía ................................................................................................................................ 138 3 Índice ilustraciones Ilustración 1 Funcionamiento de un acelerómetro para el cálculo de la inclinación ................. 11 Ilustración 2 Distintos ejes de rotación, los cuales pueden ser medidos a través del uso de giroscopios .................................................................................................................................. 12 Ilustración 3 Wii Mote con Wii Nunchuk .................................................................................... 12 Ilustración 4 Barra sensora Wii con cinco LED infrarrojos ubicados en ambos laterales. .......... 13 Ilustración 5 Accesorio Wii Motion Plus ..................................................................................... 14 Ilustración 6 PlayStation Move ................................................................................................... 15 Ilustración 7 PlayStation Eye ....................................................................................................... 15 Ilustración 8 PlayStation Camera ................................................................................................ 16 Ilustración 9 Cámara Kinect V1 ................................................................................................... 17 Ilustración 10 Diagrama de la tecnología detrás de la cámara Kinect (Primesense) .................. 18 Ilustración 11 Componentes cámara Kinect V1 extraída de [23] ................................................ 19 Ilustración 12 Ejemplo patrones de puntos infrarrojos extraído de [33] ................................... 20 Ilustración 13 Imagen funcionamiento Modulación por impulsos extraída de [35] ................... 21 Ilustración 14 Imagen funcionamiento Modulación de onda continua extraída de [13.3] ........ 21 Ilustración 15 Imagen de mi escritorio escaneado 3D mediante Kinect fusión SDK 1.8 (Kinect V1) ............................................................................................................................................... 22 Ilustración 16 Imagen de mi escritorio escaneado 3D con Kinect fusión con color SDK 1.8 (Kinect V1) ................................................................................................................................... 22 Ilustración 17 Oculus Rift DK1 ..................................................................................................... 24 Ilustración 18 Oculus Rift DK2 ..................................................................................................... 25 Ilustración 19 Ejemplo del efecto producido sin “low persistence” extraído de *52+ ................ 26 Ilustración 20 Oculus Rift CV1 ..................................................................................................... 27 Ilustración 21 Oculus Touch ........................................................................................................ 27 Ilustración 22 Prototipos “Project Morpheus” ........................................................................... 28 Ilustración 23 PlayStation VR .....................................................................................................
Load more

Recommended publications
  • How the Oculus Rift Works by Bernadette Johnson
    How the Oculus Rift Works by Bernadette Johnson Browse the article How the Oculus Rift Works Introduction to How the Oculus Rift Works Virtual reality (VR) has not only been the stuff of science fiction novels and movies for decades, but it's also been an actual thing -- sort of. The first VR headsets were produced in the 1960s. At the time, the technology took up a lot of room and cost massive amounts of money. In the late 1980s to 1990s, VR became accessible to general public in arcades and other amusement venues via heavy headsets and controllers used to play rather simple games -- such as swinging a pretend sword at virtual foes, with as much accuracy as the era's computing systems could muster. The head tracking was slow, the field of vision was narrow and the graphics were low-resolution by modern standards. The experience often induced headaches and motion sickness, and it wasn't all that immersive. Still, it was a step forward in gaming and was bound to get better, but it didn't catch on at the time and the industry fizzled. The necessary technology just wasn't out yet to make it compelling to the masses. The Oculus Rift in use during E3 in Los Angeles, Calif. in June 2013. © GUS RUELAS/Reuters/Corbis High-end VR headsets with better resolution and response time have been developed since then, but they've remained prohibitively expensive for the home user and still tend to inhabit places like government and corporate research and training facilities.
    [Show full text]
  • Commencement
    150th Commencement college of engineering university of california, berkeley May 21, 2019 live webcast at engineering.berkeley.edu/BEgrad19 twitter & instagram: #BEgrad19 berkeley engineering Dean’s Note On behalf of the College of Engineering, I’d like to congratulate all of our graduating students for reaching an important milestone. Your talent and skills, hard work and perseverance have made this moment possible. I am confident that you will be celebrating more achievements in the years to come! As you embark on the next stage of your studies or on your professional career, I hope you will share the knowledge and values that you gained during your time here. Today, the most successful leaders are those who inspire and bring out the best in others to achieve beyond expectations. Teams and organizations should value and include individuals with different experiences, perspectives and thinking, in order to achieve better outcomes. I am optimistic that if each of you commits to advancing equity and inclusion wherever you go, collectively we will transform the field of engineering and shape a better future for our globally interconnected society. I also hope that you will stay connected to the larger Berkeley Engineering community, which includes more than 67,000 alumni living in 114 countries around the globe. Online networking groups, including the @cal Alumni Network, will link you to fellow alums — and can lead to new opportunities and relationships in your life journey. Congratulations again, and best wishes to all of our graduates! —Tsu-JaeKingLiu,DeanandRoyW.CarlsonProfessorofEngineering live webcast at engineering.berkeley.edu/BEgrad19 twitter & instagram: #BEgrad19 commencement 2019 1 Pledge of Ethical Conduct for Engineers We, the graduating engineering Class of 2019, in recognition of the importance of our technologies in affecting the quality of life throughout the world, and in accepting a per- sonal obligation to our profession, its members and the communities we serve, pledge to commit ourselves to the highest ethical and professional conduct.
    [Show full text]
  • Here at the College, We’Re Also Developing a Playbook of What It Will Take to Get There
    College of Engineering University of California, Berkeley Fall 2017 Transforming engineering education Campus hotspot Volume 12 The new essentials V&A Café debuts at Etcheverry INVENTING THE FUTURE Dean’sWord Future bound: Partners wanted As we use this issue of Berkeley Engineer to benchmark what’s in store for the future here at the college, we’re also developing a playbook of what it will take to get there. Given our talented students and dedicated faculty, I’m confident in our plans. But I’m thinking a lot about what connects vision to reality. One great advantage that we have in contributing our vision of the future is that we’re operating in an environment that continually strives for open collaboration and shares a mission of innovation at the service of society. We have a long history of Thank you for forming partnerships — within the college and broader community, as well as with government and industry — that create high-impact technologies and advance mean- ingful solutions to the most challenging of problems. your critical role By tradition, engineering and professional schools have been broadly connected to the outside world. But as we go forward, we also need to partner with parts of in all we continue the university that traditionally have not relied on close relationships with industry or outside organizations. For example, in augmented reality/virtual reality (AR/VR), to build together. we’re currently developing a wonderful partnership with the faculty in Theater, Dance and Performance Studies; Art Practice; and the Center for New Media. They see that the future of dance, performance, music, sports — and indeed the future of how we teach, the future of education — is going to be transformed by AR/VR devices.
    [Show full text]
  • Commencement
    150th Commencement college of engineering university of california, berkeley May 21, 2019 live webcast at engineering.berkeley.edu/BEgrad19 twitter & instagram: #BEgrad19 berkeley engineering Dean’s Note On behalf of the College of Engineering, I’d like to congratulate all of our graduating students for reaching an important milestone. Your talent and skills, hard work and perseverance have made this moment possible. I am confident that you will be celebrating more achievements in the years to come! As you embark on the next stage of your studies or on your professional career, I hope you will share the knowledge and values that you gained during your time here. Today, the most successful leaders are those who inspire and bring out the best in others to achieve beyond expectations. Teams and organizations should value and include individuals with different experiences, perspectives and thinking, in order to achieve better outcomes. I am optimistic that if each of you commits to advancing equity and inclusion wherever you go, collectively we will transform the field of engineering and shape a better future for our globally interconnected society. I also hope that you will stay connected to the larger Berkeley Engineering community, which includes more than 67,000 alumni living in 114 countries around the globe. Online networking groups, including the @cal Alumni Network, will link you to fellow alums — and can lead to new opportunities and relationships in your life journey. Congratulations again, and best wishes to all of our graduates! —Tsu-JaeKingLiu,DeanandRoyW.CarlsonProfessorofEngineering live webcast at engineering.berkeley.edu/BEgrad19 twitter & instagram: #BEgrad19 commencement 2019 1 Pledge of Ethical Conduct for Engineers We, the graduating engineering Class of 2019, in recognition of the importance of our technologies in affecting the quality of life throughout the world, and in accepting a per- sonal obligation to our profession, its members and the communities we serve, pledge to commit ourselves to the highest ethical and professional conduct.
    [Show full text]
  • In the United States District Court for the Northern District of Texas Dallas Division
    Case 3:14-cv-01849-P Document 26 Filed 06/25/14 Page 1 of 32 PageID 114 IN THE UNITED STATES DISTRICT COURT FOR THE NORTHERN DISTRICT OF TEXAS DALLAS DIVISION ) ZENIMAX MEDIA INC. and ID SOFTWARE LLC, ) ) CIVIL ACTION Plaintiffs, ) NO. 3:14-01849-P ) v. ) ) OCULUS VR, INC. and PALMER LUCKEY, ) ) Defendants. JURY TRIAL DEMANDED ) ANSWER AND AFFIRMATIVE DEFENSES “I warned [Luckey] ahead of time that it was a foregone conclusion that some of the media would report the Rift as my work, despite my ve[r]y explicit description otherwise.” -- id Software Technical Director and ZeniMax employee John Carmack on Meant To Be Seen (mtbs3d.com), referring to the Rift developed by Palmer Luckey (June 7, 2012) * * * Defendants Oculus VR, Inc. and Palmer Luckey (collectively, “Defendants”), by their attorneys, submit their Answer and Affirmative Defenses in response to Plaintiffs ZeniMax Media Inc. and id Software LLC’s (collectively, “ZeniMax”) Complaint. ZeniMax’s Complaint falsely claims ownership in Oculus VR technology in a transparent attempt to take advantage of the Oculus VR sale to Facebook. By deliberately misstating some facts and omitting others, ZeniMax makes the incredible assertion that it, a videogame software publishing company for personal computers and consoles like the Sony PlayStation, invented and developed a virtual reality hardware and software system. The truth is quite different. There is not a line of ZeniMax code or any of its technology in any Oculus VR product. Indeed, ZeniMax had never identified any ‘stolen’ code or technology in any Oculus VR product, Case 3:14-cv-01849-P Document 26 Filed 06/25/14 Page 2 of 32 PageID 115 although ZeniMax had the full source code for the Oculus VR software for over a year and a half (having received it directly from Oculus VR well before it was even released publicly), and could have analyzed it online anytime (at developer.oculusvr.com).
    [Show full text]
  • 1 in the United States District Court for The
    Case 3:14-cv-01849-K Document 1 Filed 05/21/14 Page 1 of 46 PageID 1 IN THE UNITED STATES DISTRICT COURT FOR THE NORTHERN DISTRICT OF TEXAS DALLAS DIVISION ZENIMAX MEDIA INC. and § ID SOFTWARE LLC, § § Plaintiffs, § § CIVIL CASE NO. _____________ v. § § OCULUS VR, INC. and § JURY TRIAL DEMANDED PALMER LUCKEY, § § Defendants. § COMPLAINT Plaintiffs ZeniMax Media Inc. and id Software LLC (collectively, “ZeniMax”) bring this Complaint against Oculus VR, Inc. and Palmer Luckey (collectively, “Defendants”), and in support thereof allege as follows, upon personal knowledge as to themselves and upon information and belief as to all others: NATURE OF THE ACTION 1. Under a binding Non-Disclosure Agreement, ZeniMax provided Defendants with access to intellectual property developed by ZeniMax after years of research and investment. This valuable intellectual property included copyrighted computer code, trade secret information, and technical know-how. The Non-Disclosure Agreement expressly provides that ZeniMax’s intellectual property is confidential, owned exclusively by ZeniMax, and cannot be disclosed to or used by any third parties without ZeniMax’s prior written approval. Defendants have wrongfully taken that ZeniMax intellectual property and commercially exploited it for their own gain. Defendants now stand to realize billions of dollars in value from ZeniMax’s intellectual 1 Case 3:14-cv-01849-K Document 1 Filed 05/21/14 Page 2 of 46 PageID 2 property. Defendants never obtained a license for the use of ZeniMax’s property, nor any right to sell or transfer it to third parties. By this action, ZeniMax seeks damages that will fairly and fully compensate it for Defendants’ infringement and misappropriation of its intellectual property.
    [Show full text]
  • Significance of Easter Page 3
    Significance of Easter Page 3 VOL. XIX, NUMBERUMBER 10 • MARCH 30, 2018 WWW.PLEASANTONWEEKLY.COM Club sale offers plants produced by members — plus free advice Page 12 5 NEWS Board debates school facility upgrades budget 10 OPINION Hart students’ thoughts on gun legislation 14 TRI VALLEY LIFE Pilot shares love of flying “Kindness in words creates confidence. Kindness in thinking creates profoundness. Kindness in giving creates love.” — Lao Tzu Thank You Pleasanton Weekly and Tri-Valley Residents for creating so much love in our community. Due to your generous support of the Pleasanton Weekly Holiday Fund last year, tens of thousands in the Tri-Valley will benefit greatly from your gifts. With sincere thanks! ċ7KH%HQHðFLDULHVRIWKH+ROLGD\)XQGċ Supporting Stanford Health Care - ValleyCare R.E.A.C.H. Resources Education Activities Community and Housing For Special Adults of the Tri-Valley. Page 2 • March 30, 2018 • Pleasanton Weekly AROUND PLEASANTON BY JEB BING PLEASANTON AT THE CLUB Clergy talk about significance of Easter Champagne hristians are commemo- that sacred spot, especially during Easter Sunday Brunch rating the death of Jesus Easter. CChrist today and will cel- Easter services at Trinity Luther- Sunday, April 1, 2018 ebrate His resurrection Sunday an Church: 9 a.m. with Easter with festive services at churches brunch at 10:30 a.m. throughout the Tri-Valley on Easter Cornerstone Fellowship, 348 ~ BREAKFAST STATION ~ Day. Here’s how some of our local N. Canyons Pkwy., Livermore, clergy views Easter. campus Pastor Steve Ingold: | Hickory Smoked Bacon | Breakfast Sausage Links | Catholic Community of Pleas- “If we believe that Jesus came to | Breakfast Potatoes w/Peppers and Onions | Scrambled Eggs | Eggs Benedict | anton, the Rev.
    [Show full text]
  • In the United States District Court for the Northern District of Texas Dallas Division
    Case 3:14-cv-01849-P Document 26 Filed 06/25/14 Page 1 of 32 PageID 114 IN THE UNITED STATES DISTRICT COURT FOR THE NORTHERN DISTRICT OF TEXAS DALLAS DIVISION ) ZENIMAX MEDIA INC. and ID SOFTWARE LLC, ) ) CIVIL ACTION Plaintiffs, ) NO. 3:14-01849-P ) v. ) ) OCULUS VR, INC. and PALMER LUCKEY, ) ) Defendants. JURY TRIAL DEMANDED ) ANSWER AND AFFIRMATIVE DEFENSES “I warned [Luckey] ahead of time that it was a foregone conclusion that some of the media would report the Rift as my work, despite my ve[r]y explicit description otherwise.” -- id Software Technical Director and ZeniMax employee John Carmack on Meant To Be Seen (mtbs3d.com), referring to the Rift developed by Palmer Luckey (June 7, 2012) * * * Defendants Oculus VR, Inc. and Palmer Luckey (collectively, “Defendants”), by their attorneys, submit their Answer and Affirmative Defenses in response to Plaintiffs ZeniMax Media Inc. and id Software LLC’s (collectively, “ZeniMax”) Complaint. ZeniMax’s Complaint falsely claims ownership in Oculus VR technology in a transparent attempt to take advantage of the Oculus VR sale to Facebook. By deliberately misstating some facts and omitting others, ZeniMax makes the incredible assertion that it, a videogame software publishing company for personal computers and consoles like the Sony PlayStation, invented and developed a virtual reality hardware and software system. The truth is quite different. There is not a line of ZeniMax code or any of its technology in any Oculus VR product. Indeed, ZeniMax had never identified any ‘stolen’ code or technology in any Oculus VR product, Case 3:14-cv-01849-P Document 26 Filed 06/25/14 Page 2 of 32 PageID 115 although ZeniMax had the full source code for the Oculus VR software for over a year and a half (having received it directly from Oculus VR well before it was even released publicly), and could have analyzed it online anytime (at developer.oculusvr.com).
    [Show full text]
  • Historia Przyszłości. Oculus, Facebook I Rewolucja Wirtualnej Rzeczywistości
    Tytuł oryginału: The History of the Future: Oculus, Facebook, and the Revolution That Swept Virtual Reality Tłumaczenie: Krzysztof Krzyżanowski ISBN: 978-83-283-6689-3 Copyright © 2019 by Blake J. Harris. All rights reserved. Published by arrangement with Dey Street Books, an imprint of HarperCollins Publishers. All rights reserved. Polish edition copyright © 2020 by Helion SA All rights reserved. No part of this book may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording or by any information storage retrieval system, without permission from the Publisher. Wszelkie prawa zastrzeżone. Nieautoryzowane rozpowszechnianie całości lub fragmentu niniejszej publikacji w jakiejkolwiek postaci jest zabronione. Wykonywanie kopii metodą kserograficzną, fotograficzną, a także kopiowanie książki na nośniku filmowym, magnetycznym lub innym powoduje naruszenie praw autorskich niniejszej publikacji. Wszystkie znaki występujące w tekście są zastrzeżonymi znakami firmowymi bądź towarowymi ich właścicieli. Autor oraz Helion SA dołożyli wszelkich starań, by zawarte w tej książce informacje były kompletne i rzetelne. Nie biorą jednak żadnej odpowiedzialności ani za ich wykorzystanie, ani za związane z tym ewentualne naruszenie praw patentowych lub autorskich. Autor oraz Helion SA nie ponoszą również żadnej odpowiedzialności za ewentualne szkody wynikłe z wykorzystania informacji zawartych w książce. Materiały graficzne na okładce zostały wykorzystane za zgodą Shutterstock Images LLC. Helion SA ul. Kościuszki 1c, 44-100 Gliwice tel. 32 231 22 19, 32 230 98 63 e-mail: [email protected] WWW: http://helion.pl (księgarnia internetowa, katalog książek) Drogi Czytelniku! Jeżeli chcesz ocenić tę książkę, zajrzyj pod adres http://helion.pl/user/opinie/hisprz Możesz tam wpisać swoje uwagi, spostrzeżenia, recenzję.
    [Show full text]