WXR Library (Webized X Reality)
Total Page:16
File Type:pdf, Size:1020Kb
ISO/IEC JTC 1/SC 24/WG 9 – Seoul, Korea 24 January 2019 Webizing MAR contents WXR Library (Webized X Reality) Byounghyun Yoo Webizing Research Laboratory (WRL) Korea Institute of Science and Technology XR What Are All These Realities? VR, MR, AR and XR 101, December 15, 2017, https://www.achao.design/inspire/what-are-all-these-realities-vr-mr-ar-xr-101 Milgram-Weiser continuum Newman, J., Bornik, A., Pustka, D., Echtler, F., Huber, M., Schmalstieg, D., & Klinker, G. (2007, March). Tracking for distributed mixed reality environments. In WorkshoP on Trends and Issues in Tracking for Virtual Environments at the IEEE Virtual Reality Conference (VR’07). Motivation • Experience XR in your browser • No matter what kind of device you have 3 Scene 33 33 Bert Freudenberg Adobe Artem Bolgar Ricardo Cabello Michael Bond Google, Inc. Adobe Josh Carpenter Sohan Jyoti Ghosh Huawei Guido Grassel Invited expert Qing An Facebook Madlaina Kalunder Justin Rogers Invited expert Google, Inc. Trevor F. Smith David Dorwin Google, Inc. Iker Jamardo Huawei Alibaba Group Google, Inc. Xiaosong Wei Juntao Peng Facebook Brandon Jones Huawei Alibaba Group Jacob Rossi Invited expert Zhiqiang Yu Byounghyun Yoo Huawei Kyle Roche Amazon Alexis Menard Intel Corporation Nell Waliczek Facebook Google, Inc. Stephen Konig Invited expert Google, Inc. Sangchul Ahn John Pallett Amazon Letsee, Inc. https://www.w3.org/2000/09/dbwg/details?group=109735&order=org&public=1 Google, Inc. Max Rebuschatis XR Device 8 XR Content o VR o X3D 4.0 o X3DOM o XML3D o Mozilla A-Frame and WebVR o W3C Declarative 3D for the Web Architecture Community Group o W3C WebVR Community Group o AR o Chromium WebAR Prototype o Argon – Georgia Tech o AWE.io o AR.js – jeromeetienne o MAR / XR 9 Advantage of Webizing MAR Contents ) 33) )33 3 Scene 33,)))() 10 33 33 WebXR Example I AR 11 WebXR Example II AR – 3D Interaction 12 WebXR Example III VR –VR Interaction WXR Workspace 13 WebXR Example IV AR –VR Interaction 14 CONTENTS 1. WXR Library Development Status 2. How to Authoring Contents & Example 3. Issues & Plans WXR Library Development Status WXR Library Development Status 16 WXR Library Development Status Concept Virtual Reality Augmented Reality Desktop 3D A Chamber 17 WXR Library Development Status Concept Virtual Reality WebVR Augmented Reality Desktop 3D WXR Library WebGL WebGL + Vuforia 18 1. Load WXR Library 2. Define Transformation 3. Define Scene19 Tree 20 Group Repository • wxr.js • wxr-three.js WXR-Core • polymer-elements • wxr-www • wxr-element • wxr-example WXR-Browser • wxr-android-browser WXR • wxr-ios-browser PROJECT WXR-Server • wxr-space-server • wxr-webizing-device-manager • wxr-dummy-device-adaptor WXR-Device • wxr-hand-leapmotion-adaptor • wxr-hand-steamvrcontroller- adaptor • wxr-tracker-optitrack-adaptor • socket.io-client-cpp 21 : :-: Google polymer- Polymer fork elements wxr- Project hard copy three.js & embed • Jquery • Platform wxr- External fork • Polymer-elements element Projects • Polymer • Threejs • Tweenjs wxr- • Webvr-polyfill example hard copy & embed wxr-www wxr.js Packaging followings as wxr.html 22 WXR Library Development Status Class Hierarchy of wxr-element wxr-world wxr-camera wxr-space wxr-light-ambient wxr-light-directional wxr-light wxr-light-point wxr-light-spot wxr-axes wxr-boundary wxr-box wxr-circle wxr-geometry wxr-collada wxr-cylinder wxr-obj wxr-plane wxr-ring wxr-sphere wxr-teapot wxr-element wxr-trigger wxr-target wxr-html wxr-hmd-mixedreality wxr-peripheral-hmd wxr-hmd-oculus wxr-hmd-vive polymer.Element wxr-peripheral-ar wxr-ar-vuforia wxr-hand-leapmotion wxr-hand-oculustouch wxr-device-hand wxr-hand-steamvrcontroller wxr-hand-vivecontroller wxr-peripheral wxr-hand-motioncontroller wxr-tracker-vivetracker wxr-peripheral-tracker wxr-tracker-tobiieyex wxr-tracker-realsense wxr-peripheral-iot wxr-iot-foobot wxr-appbar wxr-debug wxr-ui wxr-editor wxr-layerui wxr-slider wxr-ar wxr-description wxr-animation wxr-requirement wxr-user wxr-view 23 -: wxr-android- browser WXR-Core wxr-www wxr-ios- browser 24 -: :-- loadTargets unloadTargets Method Call onHtmlChange changeModeAR Handler changeModeVR changeMode3D ARTrackerEngine WKScriptMessage Native onCameraChanged onTargetDetected WXRLibrary onProjectionMatrix onTargetMoved Method Call onCameraReady onTargetMissed Handler Listener VuforiaEvent WXRARTracker onTargetLoaded onTargetUnloaded 25 -::: :::-- WXR Library loadTargets unloadTargets ARTracker Method Call onHtmlChange changeModeAR Engine changeModeVR changeMode3D Handler WXR NativeEvent getCurrentBeacons addEventListener Location removeEventListener Manager Native onProjectionMatrix onTargetDetected WXRAR Tracker onCameraReady onTargetMoved Listener Method Call JSEvent Handler onTargetLoaded onTargetMissed WXR onBeaconResult Sensor 26 --- ------- wxr-space- server 27 Data Access filesystem wxr-space-server (Expressjs) Web Contents HTTP Module Workspace Check session database Information Passport.js Client User Information Check session interaction-server- Event Logging socket 28 --- ------ wxr-dummy- device-adaptor ValveSoftware wxr-hand- openvr leapmotion- wxr-webizing- adaptor device- socket.io- manager wxr-hand- client-cpp steamvrcontroll er-adaptor Optitrack wxr-tracker- Optitrack SDK optitrack- adaptor socket.io- client-cpp 29 ,: : WXRDeviceInit WXRUpdateDeviceProfiles manager - WXREvent: WXRDeviceOn WXREvent: XXX Event device Adaptor - - WXREvent: XXX Event WXRLibrary XXX disconnect ConfigManager WXREvent: WXRDeivceOff WXRWebizingDevice webizing - WXRUpdateDeviceProfiles wxr 30 : XXX-Adaptor wxr-webizing-device-manager WXRUpdateDeviceProfiles WXRUpdateDeviceProfiles WXRWebizingDevice ConfigManager 31 WXRLibrary (): )) 32 )(:: : 33 : 34 : 35 How to Authoring Contents & Example How to Authoring Contents & Authoring Examples 36 333& 3 37 & & 38 & 39 & Use these location at Digital Ocean to add target or object. Transform the target or object in style tag. (optional) Additionally add functions or tags to implement the contents. 40 & & 41 Issues & Plans Issues & Plans 42 Issues & Plans o Issues o Unstable connection between Firefox and SteamVR o Low recognition rate of AR Marker o Hard to synchronize scene with massive users o Plans o To stable connection between Firefox and SteamVR o Custom tag hierarchy architecture remodeling o Extension for more variety of Human Interaction Device o Extension to using decentralized Web o Upgrade third party libraries’ version 43 Decentralized WebXR • Decentralized Web • 0:.00.::: • .::.:. • 0:3 44 DWXR 45 DWXR – AR Interaction 46 DWXR –VR Interaction 47 Thank You Webizing Research Laboratory (WRL) http://www.wrl.onl Byounghyun Yoo [email protected].