Web3DWeb3D ConsortiumConsortium andand ExtensibleExtensible 3D3D GraphicsGraphics (X3D)(X3D) CommunicatingCommunicating RealReal--TimeTime 3D3D Don Brutzman Naval Postgraduate School Board Member, Web3D Consortium [email protected] Welcome!Welcome! • Thank you for coming! • Objectives for today … • To give you an overview of the technology, standards and opportunities driving the real-time communication of 3D data • (slides provided by) Neil Trevett – President, Web3D Consortium • An industry and standards overview – focusing on X3D™ LotsLots ofof GreatGreat ActivitiesActivities ThisThis YearYear • X3D is now approved as an ISO International Standard! • X3D gaining strong standards activity and product momentum • Specification, Shaders, Binary Format, Conformance Tests and Products! • Strong vertically focused Working Groups • CAD Working Group – has draft of CAD Distillation Format • Medical Working Group – gaining real traction • New Consortium Web-site • Up to date news, resources and forums PLUS member site • Sponsored Web3D 2004 Symposium • In Monterey WebsiteWebsite http://www.web3D.orghttp://www.web3D.org All Working Group and Board business posted Up to the minute resources – including member accessible intranet TheThe Future?Future? “The“The bestbest wayway toto predictpredict thethe futurefuture isis toto inventinvent it.”it.” AlanAlan Kay Kay What is the commercial context for our Web3D efforts? What is the VITAL ROLE that Web3D can play in that industry? How should we organize and work to best fulfill that role? TheThe RichRich MediaMedia DreamDream • The ability to merge traditional 2D media interactively with 3D media -> “Rich Media” • To be able to deliver it – securely - anytime, anywhere • To build this kind of dream takes technology innovation and industry cooperation • What are the pieces of the puzzle? MakingMaking 3D3D aa PartPart ofof RichRich MediaMedia DELIVER Rich Media Including 3D graphics CREATE Rich Media Including 3D graphics COMMUNICATE Rich Media Including 3D graphics Standards are needed to make this vision come true… X3DX3D EnablesEnables RealReal--timetime 3D3D CommunicationCommunication Between applications “X3D is an open standard to enable the communication of real-time 3D across networks and XML-based web services” Between systems X3DX3D –– ThirdThird GenGen Web3DWeb3D StandardStandard • Extensible – profiles are adaptable in size and functionality • Tightly integrated with XML - .wrl and .xml encodings Adds sensors and some lights – enough for most Web3D applications today, Adds scripting and VR capabilities, Adopted by MPEG-4 upgrade path for VRML97 content Immersive Interactive Small download, Supports geometry, texturing, and basic Interchange lighting and animation Extension framework to Extension implement and distribute future Framework components and profiles X3DX3D isis nownow anan ISOISO StandardStandard • X3D abstract specification approved as ISO International Standard • In August 2004 • ISO/IEC 19775-1 and ISO/IEC 19775-2 • Updated on annual cycle – Amendment One being created now • Shaders, CAD Distillation Format, 3D textures, LOD and navigation • Compressed Binary Encoding • Main uses in broadcast… • Multi-user games • Short duration games • Reality shows • Education • Interactive movies • Console interfaces Web3DWeb3D ConsortiumConsortium –– TheThe MacroMacro ViewView Communicating via the Web Communicating via Broadcast X3D defining how 3D graphics is X3D is the 3D component of the MPEG-4 integrated into the 2D via XML standard – tightly integrated 3D and video W3C MPEG Building the foundation Experts in video of the Worldwide Web creation and delivery Web3D has cooperative agreements with other key standards bodies to promote 3D solutions to the wider industry ISO Creating International Standards Communicating into the Future A stable and long-lived standards foundation for companies to build their future upon CommunicableCommunicable 3D3D –– DeathDeath byby 1,0001,000 AppsApps • Web3D not found a killer application • But many, diverse uses across different market segments No single market segment has enough demand for 3D communications to create commercial critical mass Communicating 3D in CAD Markets Communicating Proprietary Web3D solutions typically 3D in GIS fail as they address only one segment– Communicating Markets and don’t find enough customers 3D in VizSim Markets Communicating Need TRANS-SEGMENT STANDARDS to 3D in AEC amortize the cost of developing 3D Markets communication solutions across ALL Communicating 3D segments in Broadcast Markets Collectively all the segments together form a commercial critical mass Communicating 3D in Medical Standard games are not the killer app – although a Markets $30Bn industry – most games are 3D apps that communicate – they don’t communicate 3D X3DX3D –– aa CrossCross--CuttingCutting StandardStandard Vertical Working Groups use X3D to vertical market SOLUTIONS CAD MedicalGIS VizSim Broadcast Markets that need to communicate 3D An extensible, adaptable foundation standard The X3D Working Group defines a foundation TECHNOLOGY CrossCross SegmentSegment SynergySynergy • Vertical focus is key to enabling market segments • But a cross-segment ecosystem will begin to form to the benefit of all Detailed segment solutions can cross- fertilize other segments due to the use of a common foundation technology – X3D Communicating 3D in CAD Markets Communicating 3D in GIS Communicating Markets 3D in VizSim Markets Communicating 3D in AEC Markets Communicating 3D in Broadcast Markets Communicating E.g. CAD, H-anim, GIS, AEC 3D in Medical solutions are interoperable for Markets advanced 3D applications TheThe UniverseUniverse ofof 3D3D StandardsStandards Khronos Group Enabling advanced 3D graphics to CREATION be accelerated on embedded devices – including cell phones DELIVERY OpenGL ARB Evolving the capabilities of graphics hardware to enable real- time, interactive cinematic realism Web3D Consortium COMMUNICATION Enabling the communication of real- time 3D content across applications, networks and the web OpenGLOpenGL ShadingShading LanguageLanguage • 3D Graphics programmable hardware enables cinematic realism • OpenGL Shading Language – cross platform C-like language • Can create almost unlimited “shader programs” • A single VPU contains hundreds of floating point processors • It’s like a free supercomputer with every graphics board • Blurring the boundaries between CG and interactive content • “Real-time Toy Story” within the next 3-5 years Fixed function hardware Programmable hardware to accelerate complex shading algorithms IN REAL TIME OpenGLOpenGL ESES –– EmbeddedEmbedded GraphicsGraphics • Khronos has created a small-footprint subset of OpenGL • Created with the blessing and cooperation of the OpenGL ARB • Full functionality for 3D games • On a wide variety of platforms – including handhelds Feedback and Ratification ARB Embedded Workstation Focus Focus Eliminate Redundancy Small footprint e.g. 50KB software engines Eliminate Workstation Functionality EvolvingEvolving DeliveryDelivery SystemsSystems • Cell phones - evolving into ubiquitous, personal, 3D media-capable computing devices before our eyes Enhanced 3D running in advanced fixed-function hardware - OpenGL ES 1.1 3D running in software – OpenGL ES 1.0 Advanced, 3D shaders running in programmable hardware – OpenGL ES 2.0 2004 2005 2006 OpenGLOpenGL ESES –– CentralCentral toto MobileMobile 3D3D COMMUNICATING JSR 239 3D Content Defining official Java Bindings to C/C++ OpenGL ES Java Applications Applications Usable directly by applications Games Middleware Engines Libraries Usable by higher Browsers abstraction libraries Hardware Software “Close to the metal” OpenGL ES OpenGL ES API provides Engines Engines portability AND flexibility J2ME Brings advanced 2D/3D graphics to a wide range of platforms TheThe MicroMicro UniverseUniverse ofof 3D3D StandardsStandards ARB Khronos “Creation” “Delivery” Shaders ARB Defines how to program shaders using GLSL Web3D Works out how to send shaders across a network Khronos Figures out how your cell phone will play them Web3D “Communication” ExtensibleExtensible ModelingModeling && SimulationSimulation FrameworkFramework (XMSF)(XMSF) • Web services for all manner of M&S • A composable set of standards, profiles, and recommended practices for web-based M&S • Foundational precepts: Internet network technologies, Extensible Markup Language (XML)-based languages, and service-oriented architectures for simple messaging • Enable a new generation of distributed M&S applications to emerge, develop, interoperate with tactical systems • Many easily repeatable exemplars using Web Services http://www.MovesInstitute.org/xmsf ConclusionsConclusions • Rich Media integration of 3D is a emerging commercial opportunity • For both hardware and software communities • “Communicating 3D” is Web3D’s vital role in this vision • X3D - and its application to vertical market segments - is critical • X3D is now an ISO standard • A stable and royalty-free platform for all • Close interactions with World Wide Web Consortium (W3C) • Websim Partnership is important to our go-forward strategies • Industry participation is vital • Web3D Membership is open to all – and beneficial to its members • Web Services lets our technologies work together as never before • Further partnered collaboration welcome! www.web3d.org.