Mpeg-4Mpeg-4
Total Page:16
File Type:pdf, Size:1020Kb
3D3D GraphicsGraphics inin MPEG-4MPEG-4 Tutorial@CGI, Crete June, 2004 M.M. Preda,Preda, F.F. Moran,Moran, P.P. GioiaGioia,, G.G. LafruitLafruit TutorialTutorial organizationorganization Time Topic Speaker 20 min Introduction Dr. Marius Preda, INT Dr. Francisco Moran, UPM 70 min Shapes Dr. Patrick Gioia, FTRD 15 min Break 60 min Textures Dr. Gauthier Lafruit, IMEC 50 min Animation Dr. Marius Preda, INT 25 min Questions StandardizationStandardization bodiesbodies ISO Organization Technical SC24 Management Board Computer graphics and image processing WG1 GKS, PHIGS, CGM, VRML, X3D Coding of still pictures JPEG JTC1 SC29 WG11 Over 244 technical Coding of audio, picture, Coding of moving pictures committees multimedia and hypermedia and audio MPEG Take a deep breath: ISO/IEC JTC1/SC29/WG11 = MPEG TheThe MPEGMPEG familyfamily MPEG Standards MPEG MPEG-21 ISO/IEC 21000 ‘02 MPEG-7 ISO/IEC 15938 ‘01 Multimedia terminal MPEG-4 specification ISO/IEC 14496 ‘99 Content description MPEG-2 Multimedia database Interactive TV ISO/IEC 13818 ‘94 searches MPEG-1 Web applications ISO/IEC 11172 ‘92 DVDs 2D/3D applications Digital Broadcasts CD-Rom movies (cable/sat) Movie trailers… MPEGMPEG--44 conceptsconcepts MPEG-4 Data Natural - still image, audio, 2D/3D video Synthetic - audio, 2D/3D objects & scenes Compression Compression Compression MPEG-4 Goal Core technology for efficient data compression and transmission MPEG-4 Terminal Composition of natural and synthetic objects in interactive hybrid scenes at the user side MPEGMPEG--44 conceptsconcepts MPEG-4 System Architecture:: data flow Interactive Scene Description Scene Scene Description Stream layer Object Object Descriptor Stream descriptor layer MPEG-4 Visual Stream stream Visual Stream Media data layer Visual Stream Audio Stream MPEGMPEG--44 conceptsconcepts Scene concept – BIFS, based on VRML 2.0 Scene Graph representation - child-parent relationship - scene registration (transforms) - interaction with the content (sensors) Graphic objects representation - 2D primitives - text - 3D primitives Generic Compression - binary encoding - quantization, predictive encoding - streaming support MPEGMPEG--44 featuresfeatures MPEG-4 hierarchical scene Layer2D { children [ ] } MPEGMPEG--44 featuresfeatures MPEG-4 hierarchical scene Layer2D { children [ Shape { appearance Appearance { material Material2D { emissiveColor 1 0 0 } } geometry Rectangle { size 1 0.75 } } ] } MPEGMPEG--44 featuresfeatures MPEG-4 hierarchical scene Layer2D { children [ Shape { appearance Appearance { material Material2D { emissiveColor 1 0 0 } } geometry Rectangle { size 1 0.75 } } Transform2D { translation –0.5 0.25 children [ Shape { appearance Appearance { material Material2D { emissiveColor 0 1 0 } } geometry Circle { radius 0.375 } } ] } ] } MPEGMPEG--44 3D3D chronologychronology Year Version 3D Tool VRML features: -geometry: polygonal meshes -animation: linear interpolation 1998 MPEG- 4 Version 1 3D Mesh Compression (3DMC) Face Animation 1999 MPEG- 4 Version 2 Body Animation Geometry: subdivision surfaces, NURBS, wavelet compression, solid modeling, mesh grid Animation: 2003 MPEG- 4 Part 16 (AFX) interpolator compression, non-linear interpolation, bone-based animation Textures: light field mapping, depth image-based representation, procedural textures MPEGMPEG--44 featuresfeatures 3D place in the MPEG-4 architecture 3D nodes in DMIF Decode Audio DB Audio Audio CB the scene Compositor Render graph Decode Video DB Video Video CB OD DMUX OD DB Decode Decode Decoded specific AFX DB AFX AFX Decode Decoded compression BIFS DB BIFS BIFS BIFS tree for 3D graphics IPMP-Ds IPMP DB IPMP-ES Possible IPMP - AFX stream IPMP System(s) Control Points MPEGMPEG--44 organizationorganization Several Parts 1Systems 2Visual 3Audio 4 Conformance 5 Reference SW 6 DMIF (Delivery Multimedia Integration Framework) … 10 Advanced Video Coding … 16 AFX (Animation Framework eXtension) ….