International Organisation for Standardisation s3
Total Page:16
File Type:pdf, Size:1020Kb
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11 N6701 Palma de Mallorca – October 2004
Source Leonardo Chiariglione, Convenor Title Report of the 70th meeting Status
Report of the 70th meeting 1 Opening The 70th WG11 meeting was held at Palma de Mallorca on 2004/10/17-21 at the kind invitation of AENOR, the Spanish National Body. 2 Roll call of participants Annex 1 gives the attendance list. 3 Approval of agenda Annex 2 gives the agenda approved. 4 Allocation of contributions Annex 3 gives the list of input contributions 5 Communications from Convenor
6 Report of previous meeting This was approved. 7 Processing of NB Position Papers National Body papers were considered and answers provided where appropriate. 8 Work plan
8.1 Media coding
8.1.1 MPEG-4 Audio The following document was approved 6795 Draft 3rd Edition of 14496-3
8.1.2 New levels in MPEG-4 Simple profile The following documents were approved 6708 Disposition of Comments on ISO/IEC 14496-2:2004 PDAM2 6709 Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in Simple Profile
1 8.1.3 New levels in MPEG-4 Simple profile conformance The following documents were approved 6741 DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple Profile Conformance 6742 ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile Conformance
8.1.4 Implementation of IDCT The following documents were approved 6707 Request for Sub-division of ISO/IEC 11172-6 6735 Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine Transform 8.2 Composition coding
8.2.1 Lightweight Scene Representation The following documents were approved 6852 DoC on ISO/IEC 14496-20/CD 6853 Text of ISO/IEC 14496-20/FCD 8.3 Description coding
8.3.1 MPEG-7 Profiles The following documents were approved 6826 DoC of FCD of ISO/IEC 15938-9 6827 Text of FDIS of ISO/IEC 15938-9 8.4 Systems support
8.4.1 Carriage of ISAN and V-ISAN metadata The following documents were approved 6846 DoC on ISO/IEC 13818-1:2000/FPDAM4 6847 Text of ISO/IEC 13818-1:2000/FDAM4 8.5 IPMP
8.5.1 MPEG-21 IPMP Components The following document was approved 6772 ISO/IEC CD 21000-4 MPEG-21 IPMP Components 8.6 Digital Item
8.6.1 Digital Item Binarisation The following documents were approved 6860 DoC on ISO/IEC 21000-16/CD 6861 Text of ISO/IEC 21000-16/FCD
8.6.2 Event Reporting The following document was approved 6783 ISO/IEC CD 21000-15 MPEG-21 Event Reporting
2 8.7 Multimedia architecture
8.7.1 MPEG-J extension for rendering The following document was approved 6751 Text of ISO/IEC 14496-21 CD
8.7.2 Digital Item Processing The following documents were approved 6781 DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item Processing 6780 ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing
8.7.3 MPEG Multimedia Middleware The following documents were approved 6835 MPEG Multimedia Middleware Requirements v2.0 6836 Call for Proposals for MPEG Multimedia Middleware 8.8 Reference implementation
8.8.1 MPEG-2 Reference software The following documents were approved 6737 ISO/IEC 13818-5 MPEG-2 Reference Software 2nd edition 9 Liaison matters
10 Organisation of this meeting
10.1 Tasks for subgroups Tasks were assigned to achieve the goals of the work plan. 10.2 Joint meetings The following joint meetings were held Groups What Where Day Time Req, Sys M3W, Laser, Font, MP4 FF Sys Mon 16:00-18:15 Req, MDS MP7 Profiles, JPSearch Req Tue 09:00-10:30 Req, MDS MP21 promotion Req Tue 10:45-11:30 Req, Vid, Aud, MDS, Sys MPEG-A, Streaming DI, MCF Req Tue 11:30-13:00 Req, Vid IDCT, SVC, Omnidir video Req Tue 14:00-15:30 Req, Tst MP21 PAT Amd Req Tue 15:30-16:30 Req, Aud Profiles, ScAC Aud Tue 16:30-17:30 Aud, Sys Time stamps Aud Tue 17:30-18:30 Req + Communicating MPEG Req Tue 17:30-18:00 Sys, MDS Applic. spec. binary encod Sys Wed 14:00-14:30 Req, MDS MP21 promotion Req Wed 15:30-16:30 MDS, Int MP21 Ref SW and Reqs MDS Wed 16:00-17:00 Req, MDS MP21 MDS Wed 11:30-12:30 Req, Sys, Vid, Aud, MDS MPEG-A Req Thu 09:00-10:15 Req, Sys Laser Sys Thu 10:15-10:30 Req, Sys M3W Req Thu 10:30-11:00 Req, MDS IPMP Scope Req Thu 12:00-13:00 Req, Vid 3DAV, SVC Vid Thu 14:00-15:00
3 Req, MDS MPEG-21 MAF MDS Thu 16:00-16:30
10.3 Administrative matters
10.3.1 Schedule of future MPEG meetings The following meeting schedule was approved
Meeting City Country Yr. Mo. Days 70th Palma de Mallorca ES 04 10 18-22 71st Hong Kong CN 05 01 17-21 72nd Busan KR 05 04 18-22 73rd Poznań PL 05 07 25-29 74th ? FR 05 10 17-21 75th ? ? 06 01 23-27
10.3.2 Promotional activities An ad hoc group with this mandate was re-established. 11 Planning of future activities The following ad hoc groups were established 6790 14496-3:2001/AMD 2:2004/DCOR 1 (SSC) 6749 AFX CE description 6750 AFX VM 16.0 6730 AHG on 3DAV Coding 6752 AHG on AFX documents, CEs, and software 6817 AHG on Audio Standards Maintenance 6734 AHG on Communicating MPEG to the business Community 6728 AHG on Core Experiments in Scalable Video Coding 6727 AHG on Description Tools for MPEG-7 New Visual Extensions 6842 AHG on Digital Item Serialization 6822 AHG On Exploration of Scalable Audio and Speech Coding 6840 AHG on Font Format Representation 6732 AHG on further Exploration in Wavelet Video Coding 6837 AHG on JPEG Liaison 6838 AHG on MAF Development 6725 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6726 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software 6865 AHG on MPEG File Formats 6788 AHG on MPEG URI Fragment IDs 6787 AHG on MPEG-21 DIA 6785 AHG on MPEG-21 DIP& DID 2nd Edition
4 6786 AHG on MPEG-21 Event Reporting 6841 AHG on MPEG-21 Vision Update 6820 AHG on MPEG-4 Lossless Audio Coding 6755 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. 6818 AHG on MPEG-7 Audio 6753 AHG on MPEG-J extensions for rendering 6733 AHG on Organization of a Workshop on Future Directions in Video Compression 6839 AHG on Persistent Association 6729 AHG on Scalable Video Model and SVM Software 6864 AHG on Scene Representation 6819 AHG on Spatial Audio Coding 6821 AHG on Symbolic Music Representation 6731 AHG on Video Coding Tools Repository 6724 AHG on Video IDCT Specification 6863 AHG on XML Structure Binarization and Streaming
12 Resolutions of this meeting These were approved (N6799) 13 A.O.B There was no other business 14 Closing The meeting closed at 2004/10/22T20:15.
5 Annex 1 Attendance list
DavidAxelMyriamGiven Scott Name TaubmanBeckerAmielhFamily Name TheCISRA UniverityCompany Of Nsw / Organization AustraliaCountry ChristianKlausIanShaneGerrard TimmererLeopoldBurnettLaufDrury UniversityUow/EnikosTitr University KlagenfurtOf Wollongong Of Wollongong/Enikos AustriaAustralia SaarRobbieFrederikAlexandruAdrian DeSalomieMunteanu ZutterSutterKeukelaere GhentEtro Department, University Vrije Universiteit Brussel Belgium PeteerMaximiliamBorisJanRik ScholkensBaraisRoggeBormansVan De Walle VrijeMetanousKapeldreefGhent Universiteit University 75 Brussel-Ibbt Belgium WenAlex GaoLuccisano InstituteScientific Of Atlanta Computing Canada Technology ChinaCanada VaananenJaniChun-JenYi-ShingWen-Hsiao MauriLainemaTsaiTungPeng NokiaNCTU/ITRINational TaiwanChiao-Tung University University FinlandChina AbdellatifClaudeJean-ClaudeCyrilFx BenjellounSeyratDufourdConcolatoNuttall Touimi FranceExpwayEnst/StreamezzoENSTCISAC Telecom France IsabelleRoyanAvaroFredericAlexandre AmonouJeromeOlivierLorasCotarmanach France-TélécomFrance-TelecomFrance Telecom France DavidJean-BernardPierrickStephanePatrick ViretteRaultPhilippePateuxGioia France-Télécom France MichelBeatrice BarlaudPesquet-Popescu IGET-ENST 3s.Laboratory France GregoireJeromeFrancoiseMariusChristine CarpentierBarthelemyPreteuxPredaGuillemot IRCAMINTINRIA France OlawaletitusJeromeMarcStephaneVincent AbeVieronGuezValenteBottreau Vuche ChurchThomsonSCPPPhilipsIrisa-Inria Digital Choir Systems Labs GambiaFrance ChristophPeterBernhardAndreasMartin FehnListFeitenSchneiderDietz FhG/HHIDeutscheCoding Technologies Telekom, T-Systems Gmbh Germany MatthiasRalfThomasAljoschaHeiko GruhneGeigerWiegandSmolicSchwarz Fraunhofer IDMTHHI Germany StefanJuergenBernhardHaraldOliver KraegelohHerreGrillFuchsBaum Fraunhofer IIS Germany UlrichThomasDetlefHerbertRalph BenzlerWediMarpeThomaSperschneider RobertPanasonicFraunhofer Bosch InstituteIIS Gmbh, HHI Fv/Slh Germany PeterAndreasGeroMathiasJens-Rainer AmonHutterBaseWienOhm SiemensRwth Aachen AG University Germany CarstenHelgeTobiasTilmanGabriel HerpelDrummOelbaumLiebchenPanis ThomsonTecnnischeTechnischeTechnicalSiemens Ag University UniversitaetUniversitat Of Munchen Berlin Germany JoernKlausIngoAndreasJens OstermannDiepoldWolfGraffunderSpille UniversitätTUM-LDVT-SystemsThomson Hannover Germany ZviValentinEdwardVasileiosTillman LifshitzMuresanCookeMezarisWeyde OptibaseCentreInformaticsUniversity For Ltd. Of DigitalAnd Osnabrük Telematics Video Processing IsraelIrelandGreeceGermany MarcoVittorioMaurizioFilippoAharon TagliasacchiBaronciniCampanaiChiariglioneGill PolitecnicoFUBExitechCEDEOZoran Microelectronics Srl Di Milano ItalyIsrael AndreaPaoloPierfrancescoRiccardoGiovanni ValottiNesiBelliniLeonardiCordara UniversityTelecom Italia Of FlorenceBrescia Lab Italy YoshinoriYukikoTomokazuKimihikoMasatsugu SugiharaOguraMurakamiKazuiKitamura JapanIpsj/ItscjHitachiFujitsuFor More ElectronicsLaboratoires Convenient & Ltd.Information Av Life Japan HirofumiTokumichiKohtaroTakeshiTakafumi NishikawaMurakamiAsaiNorimatsuUeno MitsubishiMatsushita Electric Electric Corporation Japan HiromiMasayukiToshiakiCraigYoshihisa KinoshitaTanimotoFujiiSchultzYamada NaraNagoyaMultimediaMitsubishi Institute University Electric Architectures Of Science CorporationGraduate And School Technology Of Engineering Japan MasanoriTakahiroAkioToshiyukiKazumasa SanoKimotoYamadaNomuraYamazawa NHKNECNara Institute Of Science And Technology Japan ThiowSeishiTakehiroMasakiNoboru Keng TanTakamuraMoriyaKitaharaHarada NTT Docomo, Inc. Japan NaoyaTakanoriTakashiHideakiYukihiro TanakaSenohNishiKimataBando PanasonicOkiNTT-AtNTT/ Electric Cyber Industry Space Lab. Co, Ltd1-1 Hikarino -Oka Japan SatoshiTakeshiItaruTakuyoTeruhiko ItoChujohKanekoKogureSuzuki ToshibaTokyoTheSony University Corp. Polytechnic Corporation Of Tokio University Japan SangthoonJaejoonHiroshiHidekiSatoru OhKimWatanabeTakeharaSakazume DCFDaeguWasedaVictor Company University University Of Japan. Ltd KoreaJapan YeSeyoonYongiuChung-HyunJeho Sun JoungJeongChoAhnNam ETRI Korea Tae-JoonWeonJaeDaeheeKyeheon Gong Geun ParkOhKim ETRI Korea EueeWonYoungiooJeongilSoo-Jon YoungS JangYooSongSeoPark HanyangETRI University Korea Ik-HwanSeungliMunchurlHendrySun Young ChoYangKimHendryLee InhaInformationHanyang University University And Communications Korea HyongKiYong-SooJongDong-Seok Seob Tae Joong KimChoiJeong KangwonKAISTInha University National University Korea JungByeongKeunHyukminManbae HoSoo Ho ChoiParkKwonKim KTKETIKBSKangwon National University Korea DougyoungKyungmoKwangoGwang-HoonSeoung Jun SuhParkKoOh KyungheeKyungKwangwoon Hee University Unniversity University Korea SuengSueng-WookHee-SukByeongWon Ha Hyun Moon KimParkPangJeon LgLGKyunghee ElectronicsElectronics University Inc.Inc. Korea Korea JongYoung-KwonCheonDoeJi-Ho Hyun Jin Seog ChaeLimKimYoonPark NetntvNet&TvMovainLG Electronics Inc. InterjungboInc. 1582-6 Inc. Hanseo Co.Lct Bldg. 8f. Korea JooheeMahnjinJeongSang-KyunSangwook Hwan KimHanAhn SamsungSamsumg AitA.I.T. Korea Woo-JinHyunEunmiHi-YoungHye-Yun Mun HanKimOh Samsung ElectronicsAit Korea Yung-LyulMinhHaeKimBae KeunKwang Tuan LeeLeKimJong Ryul SejongSamsung University Electronics Korea SeokWoongNammeeKyungheeHan-Gil Hoon Il KimChoiMoonJi TheSungkyunkwanSITSeoul Korea National Digital University University Contents Forum Korea WilhelmusDirkLeonJanWerner Jeroen Ha BrulsBreebaartVanOomen DeDer Kerkhof Meer Philips Research Netherlands MarekGisleNeilAndrewJean H.A. Alexander DomanskiBjontegaardMckencieTokmakoffGelissen PoznanTandbergFbnTelematicaPhilips Netherlans Research University Instituut Of Technology PolandNorwayNetherlansNetherlands RongshanSusantoZhengguoAntonioFernando YuRahardjaLiNavarroPereira InstituteInstitueTelecomunicationsInstituto ForForSuperior InfocommInfocomm Tecnico Institute Research Research SingaporePortugal KokShengmeiChakSiXiao Wei Seng Joo ChongShenLeeMaLin PanasonicInstitute OfFor SingaporeComputing Infocomm Laboratoiries TechnologyResearch Singapore SuaJiunnMenZhongyangVincent HongHuang Bin NeoLimLeeHuangDiong Panasonic Singapore Laboratoiries Singapore PauloDavidMarcThomasChong Soon VillegasAparicioGauvinKummer-HardtLim TelefonicaSdaeAioPanasonic I+DSingapore Laboratoiries SpainSingapore KristopherEvaJaimeJoseFrancisco M KjörlingRodriguezDelgadoMartinezMoran CodingUniversitatUniversidadUniv. Politecnica Technologies Pompeu Autonoma De FabraMadrid Ab De (Madrid Upf) SwedenSpain MarcoChristofTouradjPerHeiko MattavelliFallerEbrahimiFröjdhPurnhagen EPFLEricssonCoding Technologies Ab SwitzerlandSweden FrancescoDiegoJean-ClaudeThomasGiorgio ZilianiSantaMichelouDiZoia Giacomo Cruz VisiowaveMiralab,UniversityEPFL Of Geneva Switzerland PaulKiaMartinMikeFrederic JessopNgRussNilssonVexo IfpiIcsrim-UniversityBTVrlab-Epfl Of Leeds UKSwitzerland CatherineRayRobertLeszekMiroslaw Steven James GrantTaylorO'callaghanCieplinskiBober NineNDSMitsubishi Tiles Electric Ite-Vil-LabIte-Vil UK PingNielsChrisCharithGary James WuRumpBarlasAbhayaratneCalder TandbergRightscomQueenOxford SemiconductorMary Television University Limited Ltd Of London UK TibetBarryVladimirScottSimon MimarHaskellLevantovskyFosheeWatt AtherosAppleAgfaAdobeUniversal Monotype Computer Communications Music Corp. International USAUK ThomasFengShengKatherineSchuyler Che DemartiniWangZhongCornogQuackenbush ContentGuard,ConesantBroadcomAvidAudio Technology Research Systems Inc. Labs. Inc USA AlanWalterFrankXinBradford Jeffrey C Robert SeefeldtGishBossenWangGandee DolbyDoCoMoContentGuard, Laboratories USA Labs.Inc. USA MarcoPankajMajidThomasMark Stuart M L HurtadoTopiwalaRabbaniMcmahonVinton IBMFastEastmanDolby Vdo Laboratories KodakLLC USA AndrewTeRobMunsiPeter Ming Alaul G. TescherChiuKoenenHaqueSchirling MicrosoftITRI,IntertrustIntelIbm ResearchCorporation Inc USA MikaelMichaelGaryFlorianJames J D Y. Bourges-SevenierKsarSullivanPestoniJohnston MindegoMicrosoft/UsMicrosoft Inc.Corp. Nb USA ChrisAjaySamHuifangAnthony RussellLuthraNarasimhanSunVetro MPAAMotorolaMitsubishi Inc. Electric Research L USA MartaJustinCharlesWoMarina KarczewiczRidgeFenimoreChangBosi NokiaNISTMPEG Inc. LA,LLC USA BruceYuriyVijiHsin-HaoGerald Anthony BlockReznikRaveendranChenPowell RecordingRealnetworksQualcommOES/ITRINTT DoCoMo, Industry Inc. Inc. Assc. Of America USA ViswanathanMohammedShijunShawminJohn William, Zubair SwaminathanVisharamSunLeiWoods SunSonySharpRensselaer Microsystems Electronics Labs PolytechnicOf America Inc Institute USA PengHaopingGregoryJillFelix M William YinYuCookBoyceFernandes ThomsonTexas Instruments Inc USA RobertNerminJonathanTruongMihaela DQ TurneyOsmanovicBoleyNguyenVan Der Schaar XilinxUniversityUcdsdUC Davis Of Miami USA
6 Annex 2 Agenda
Agenda item 1. Opening 2. Roll call of participants 3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. Work plan 1. 8.1 Media coding 1.1. AVC Fidelity Range Extensions Conformance 1.2. Scalable Video Coding 1.3. Audio Lossless Coding 1.4. Audio Scalable Lossless Coding 1.5. 1-bit Audio Lossless Coding 1.6. Spatial Audio Coding 1.7. AFX Extensions 1.8. Streaming Text Format 1.9. Video Coding Tool Repository 1.10 3D AV Coding . 1.11 Scalable Audio and Speech Coding 1.12 Font Format Representation 8.2 Composition coding 2.1. XMT extensions 2.2. Lightweight Scene Representation 2.3. Symbolic Music Representation 8.3 Description coding 3.1. Video Descriptor Extensions 3.2. Audio Descriptor Extensions 3.3. MPEG-7 Profiles 8.4 Systems support 4.1. Carriage of ISAN and V-ISAN metadata 4.2. Timestamps and Audio Codec Behavior 8.5 IPMP 5.1. MPEG-21 IPMP Framework 8.6 Digital Item 6.1. Digital Item Declaration 6.2. Digital Item Binarisation 6.3. DIA Conversions and Permission 6.4. Event Reporting 6.5. MPEG-21 Conformance
7 8.7 Transport and File Format 7.1. MPEG-21 File Format 8.8 Multimedia architecture 8.1. MPEG-J extension for scene control 8.2. MPEG-J extension for rendering 8.2. Digital Item Processing 8.3. MPEG Multimedia Middleware 8.9 Reference implementation 9.1. AVC Fidelity Range Extensions Reference Software 9.2. MPEG-4 Visual Reference Hardware Description 9.3. MPEG-4 AVC Reference Hardware Description 9.4. MPEG-21 Reference Software 8.1 Application formats 0 10.1 Music player Application Format . 10.2 Photo album Application Format . 8.1 Maintenance 1 11.1 Systems coding standards 11.2 Video coding standards 11.1 Audio coding standards 11.2 Visual description coding standards 11.3 Audio description coding standards MDS standards 9. Liaison matters 10 Organisation of this meeting . 10. Tasks for subgroups 1 10. Joint meetings 2 11 Administrative matters . 11. Schedule of future MPEG meetings 1 11. Promotional activities 2 12 Planning of future activities . 13 Resolutions of this meeting . 14 A.O.B . 15 Closing .
8 9 Annex 3 Input document list
Number Authors Title 11149 Wo Chang Document Register for SC29/WG11 Meeting Palma, ES 11150 Mike Ksar AHG on Font Format Representation Vladimir Levantovsky 11151 Chris Barlas AHG on MPEG-21 Integration and Outreach Chris Russell 11152 Wo Chang AHG on MAF Olivier Avaro 11153 Robert Turney AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2 Marco Mattavelli 11154 Claude Seyrat AHG on XML Structure Binarization and Streaming Andreas Hutter Itaru Kaneko 11155 Jean-Claude Dufourd AHG on Scene Representation Alexandre Cotarmanac.h Young-Kwon Lim 11156 T. Chiang AHG on Maintenance of MPEG-4 Visual related Documents, Reference Yi-Shin Tung Software and Conformance Chung-Neng Wang 11157 L. Cieplinski AHG on Maintenance of MPEG-7 Visual related Documents and Reference A. Yamada Software Sang-Kyun Kim Stephan Herrmann 11158 Miroslaw Bober AHG on Description Tools for New Visual Extensions Sang-Kyun Kim 11159 Mihaela van der Schaar AHG on Core Experiments in Scalable Video Coding Justin Ridge 11160 Heiko Schwarz AHG on Scalable Video Model and SVC Software Jizheng Xu Mathias Wien David Taubman 11161 Aljoscha Smolic AHG on 3DAV Coding Hideaki Kimata 11162 Euee S. Jang Kohtaro Asai AHG on Video Coding Tools Repository none 11163 Jean Gelissen AHG on MPEG Multimedia Middleware Olivier Avaro Martin Russ 11164 Myriam Amielh AHG on MPEG 21 Media Locators Gerrard Drury YongJu Cho 11165 Simon Watt AHG on MPEG-21 IPMP 11166 Christian Timmerer AHG on MPEG-21 DIA Thomas DeMartini 11167 Gerrard Drury AHG on MPEG-21 DIP
10 Frederik De Keukaleare Munchurl Kim 11168 FX Nuttall AHG on MPEG-21 Event Reporting Andrew Tokmakoff 11169 Marius Preda AHG on AFX documents, CEs, and software Mahnjin Han Patrick Gioia 11170 Mikael Bourges-Sevenier AHG on MPEG-J extensions for rendering Vishy Swaminathan Itaru Kaneko 11171 Ralph Sperschneider AHG on Audio Standard Maintenance 11172 Matthias Gruhne AHG on MPEG-7 Audio 11173 S. Quackenbush AHG on Spatial Audio Coding 11174 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding 11175 Paolo Nesi AHG on Symbolic Music Representation Giorgio Zoia 11176 Jim Johnston AHG on Exploration of Scalable Audio and Speech Coding 11177 Jean-Claude Dufourd Initial Reference Software for LASeR and SAF 11178 Zhongyang Huang IPMP_Scheme Description for MPEG-21 IPMP Ming Ji Shengmei Shen Taka Senoh Takafumi Ueno 11179 Shane Lauf Examination of technology in IPMP WD 1.0 11180 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6237] 11181 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240] 11182 Niels Rump for the AhG Editor's input on possible 2nd Edition on PAT 11183 Mike Ksar Proposed Text - Open Font Format Specifications (OFFS) - Single Document - based on OpenType(R) v1.4 11184 on behalf of the MPEG-21 Notes from the Mountain View MPEG-21 IPMP AdHoc Meeting IPMP AdHoc group. 11185 ITTF via SC 29 Table of Replies on ISO/IEC 14496-11/FPAM 4 [SC 29 N 6249] Secretariat 11186 ITTF via SC 29 Table of Replies on ISO/IEC FDIS 21000-7 [SC 29 N 6251] Secretariat 11187 Zhengguo LI Customer Oriented Scalable Video Coding Xiaokang Yang Kengpang Lim Xiao Lin Susanto Rahardja Feng Pan 11188 Akio Yamada Contribution to MPEG-7 Visual Conformance 11189 Shane Lauf Mobile MPEG-21 Peer Implementation Ian Burnett 11190 Joerg Heuer MPEG-7 BiM for Unidirectional Networks Andreas Hutter 11191 ITTF via SC 29 Table of Replies on ISO/IEC 14496-4:200X/FDAM 7 [SC 29 N 6263]
11 Secretariat 11192 Jean H.A. Gelissen MPEG Multimedia Middleware Requirements v.2.0 11193 Niels Rump for the editors Editors' Input towards CD of 21000-15 11194 Thomas Di Giacomo CE Report for Physically-Based Animation of Cloth with Nadia Magnenat- PhysicsShapeProperties node Thalmann Marius Preda Francoise Preteux 11195 Jong-Tae Kim Objective Impairment Test Method for Video PAT Evaluation Weon-Geun Oh Won-young Yoo Hae-Kwang Kim Heung-Kyu Lee Young-Ho Suh 11196 Thomas Di Giacomo Proposal of a PhysicsBoneProperties node Nadia Magnenat- Thalmann Marius Preda Francoise Preteux 11197 Helge Drumm CE - Shadow: Final Results on Reference Software Implementation Thomas Di Giacomo 11198 Jean-Claude Dufourd CE Study of LASeR and SAF CD 11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding RM0 Selection Tests (v2) 11200 Schuyler Quackenbush 69th MPEG Audio Subgroup Report 11201 Ik-Hwan Cho Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Weon-Geun Oh Video Watermarking Hae-Kwang Kim Dong-Seok Jeong 11202 Jon Boley Spatial Audio Coding Listening Test Report- University of Miami 11203 Son Tran Implementation issues in MPEG-4 Reference Software Marius Preda Francoise Preteux 11204 Son Tran MPEG-J for real case applications: design of a minimal and universal Marius Preda primitive class Francoise Preteux 11205 Marius Preda Enriching stream control in BBA Francoise Preteux 11206 Marius Preda XMT encoding issues for BBA Octavian Folea Françoise Preteux 11207 Marius Preda http://mpeg.nist.gov/reg/_update.php?docnum=11207 Son Tran Francoise Preteux 11208 IEC TC 100 via SC 29 IEC CDV 62261-1 [SC 29 N 6286] Secretariat 11209 IEC TC 100 via SC 29 IEC CDV 62261-2 [SC 29 N 6287] Secretariat 11210 Jerome Royan Results on the CE for multiresolution footprint-based representation Patrick Gioia
12 11211 Thomas DeMartini Data Types and Methods for Implementing MPEG-21 REL Interpretation Vincent Tieu Reference Software Xin Wang 11212 Shane Lauf Proposed extensible DIDL schema Gerrard Drury Ian Burnett 11213 Shane Lauf Proposed IPMP DIDL schema Ian Burnett 11214 Truong Nguyen New spatial transform in SVC Min Li 11215 Mark Vinton Testing Environment and Procedures for Spatial Coding Performed at Dolby Laboratories 11216 Akio Yamada Proposed Corrigendum item on ISO/IEC 15938-3:2002/Amd.1 11217 Eunmi Oh Fine Grain Scalability in MPEG-4 BSAC multi-channel audio coding Miyoung Kim 11218 Hyuk-Min Kwon Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & Man-Bae Kim AA. Jeho Nam Rin-Chul Kim Hae-Kwang Kim Seungji Yang Truong Cong Thang Yong Man Ro 11219 Wo Chang Draft for MPEG-7 Part 9 FDIS 11220 FX Nuttall MPEG 21 as a secure interoperable DRM ? 11221 Eva Rodriguez IPMP Information Schema Huang Zhongyang 11222 Jerome Royan New proposal for multi-resolution footprint-based representation Patrick Gioia 11223 Joohee Kim Responses to CE4 in SVC Hyeyeon Kim Doohyun Kim 11224 Gary Sullivan IDCT Specification: A Problem and Opportunity 11225 A. G. Tescher for USNB USNB Contribution: Replacement of IDCT Standard 11226 A. G. Tescher for USNB USNB Contribution: Issues for audio lossless coding 11227 A. G. Tescher for USNB USNB Contribution: Fine-grain scalable audio codec 11228 A. G. Tescher for USNB USNB Contribution: Preliminary comments on 14496-3:2001/PDAM 4&5 11229 A. G. Tescher for USNB USNB Contribution: JPSearch and MPEG-7 11230 Shun-ichi Sekiguchi Proposed corrections to visual part of MPEG-4 conformance text Yoshihisa Yamada Kohtaro Asai 11231 Hideaki Kimata Anchor bitstreams for preliminary Call for Evidence on multi-view video Masaki Kitahara coding 11232 Hideaki Kimata Framework on free-viewpoint video with shared memory video coding Masaki Kitahara 11233 Ray Taylor Core experiment report for Fast Random Access into MPEG7 BiM streams 11234 Seishi Takamura Proposal of SNR Scalability Method with up to Lossless Enhancement
13 Bandoh Yukihiro Yoshiyuki Yashima 11235 Yukihiro Bandoh Proposal of inter-band bit re-allocation for SVC Seishi Takamura Yoshiyuki Yashima 11236 Fabio Verdicchio Resilience in Scalable Video Coding using Embedded Multiple Description Adrian Munteanu Scalar Quantization Augustin Gavrilescu Jan Cornelis Peter Schelkens 11237 Hongkai Xiong CE Verification Report of HHI on CE2.3: Adaptive Block Transforms Chen Wang Li Song Feng Wu 11238 Eddie Cooke Multiple Image View Synthesis for Virtual Viewpoint Rendering 11239 José M. Martínez A Simple Profile for MPEG-21 DIA Usage Environment description tools Víctor Valdés Luis Herranz Jesús Bescós 11240 Aljoscha Smolic Predictive Compression of Dynamic 3D Meshes Karsten Mueller Philipp Merkle Matthias Kautzner Thomas Wiegand 11241 Peng Yin Complexity Scalable Video Codec Jill Boyce Purvin Pandit Alexis Michael Tourapis 11242 Marco Boltz SVC CE7 - Non-linear adaptation results from Bosch and verification of HHI results 11243 Marco Boltz SVC CE1 - Bosch verification of HHI results for medium grain and combined scalability 11244 Heiko Schwarz Technical description of the HHI proposal for SVC CE1 Tobias Hinz Heiner Kirchhoffer Detlev Marpe Thomas Wiegand 11245 Heiko Schwarz Technical description of the HHI proposal for SVC CE2 Tobias Hinz Detlev Marpe Thomas Wiegand 11246 Heiko Schwarz Technical description of the HHI proposal for SVC CE3 Jikun Shen Detlev Marpe Thomas Wiegand 11247 Heiko Schwarz Technical description of the HHI proposal for SVC CE4 Heiner Kirchhoffer Detlev Marpe Thomas Wiegand 11248 Heiko Schwarz Technical description of the HHI proposal for SVC CE7 Karsten Sühring
14 Detlev Marpe Thomas Wiegand 11249 Chris Barlas MPEG-21 - Comatose or Just Sleeping? Niels Rump 11250 David Crombie Accessible Information Processing in MPEG Roger lenoir Neil McKenzie 11251 Johnston CFI proposed to AGH on Scalable coding 11252 Thomas DeMartini Preliminary Comments on ISO/IEC 21000-2 2nd Edition FCD (Digital Item Marco Hurtado Declaration) Martha Nalebuff Pete Schirling Anthony Vetro Xin Wang 11253 Thomas DeMartini Preliminary Comments on ISO/IEC 21000-7 PDAM1 (Digital Item Marco Hurtado Adaptation) Martha Nalebuff Pete Schirling Anthony Vetro Xin Wang 11254 Thomas DeMartini Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software) Marco Hurtado Martha Nalebuff Pete Schirling Anthony Vetro Xin Wang 11255 Thomas DeMartini Preliminary comments on Text of ISO/IEC 21000-9 FCD (MPEG-21 File Marco Hurtado Format) Martha Nalebuff Pete Schirling David Singer Anthony Vetro Mohammed Zubair Vishram Xin Wang 11256 Thomas DeMartini Preliminary Comments on ISO/IEC 21000-16 CD (Binary Format) Marco Hurtado Martha Nalebuff Pete Schirling Anthony Vetro Xin Wang 11257 Heiner Kirchhoffer Verification of the Samsung AIT proposal for SVC CE4 Heiko Schwarz 11258 Julien Reichel SVC CE7: Verification of HHI results Francesco Ziliani Diego Santa Cruz 11259 Masayuki Tanimoto FTV (Free Viewpoint Television): Achievements and Challenge Toshiaki Fujii 11260 Yongju Cho Proposed URI scheme for mp4 file format Youngkwon Lim Moonsup Song Hyoung-Joong Kim
15 Jaegon Kim Jin-Woo Hong 11261 Shane Lauf IPMP DIDL Reference Software Contribution Ian Burnett 11262 Christian Timmerer Report of CE on Conversion Parameters Klaus Leopold Dietmar Jannach Hermann Hellwagner Mariam Kimiaei 11263 Inseon Jang Spatial Audio Coding RM0 Selection Test Report - ETRI Jeongil Seo Kyeongok Kang 11264 Jeongil Seo A New Cue Parameter for Spatial Audio Coding Han-gil Moon Seungkwon Beack Inseon Jang Kyeongok Kang Jinwoo Hong 11265 Kyung Mo Park LASER adaptive to time varying resources Kwang Oh Koh 11266 Yung-Lyul Lee Multi-view video coding using 2D direct mode Woo-chul Sung 11267 Paul Jessop Comments on 'Software Copyright Licencing (sic) Disclaimer for MPEG Standards' 11268 Peter Schirling A new way to look at IDCT Joan L. Mitchell Arianne T. Hinds Nenad Rijavec 11269 Masayuki Morimoto Report on the Evaluation Tests for Spatial Audio Coding Systems Hayato 11270 Teemu Saarinen Software implementation of a light-weight REL based DRM system for video Artur Lugmayr streaming to mobile devices 11271 J. J. Chae IPMPTransfer Description for MPEG-21 IPMP Jeho Nam Jae-Gon Kim 11272 Itaru Kaneko Comment on MPEG-J extension for rendering Mark Callow 11273 Hiroshi Yasuda Activity Report of DCCSDP&DCCSDC in Japan Takuyo Kogure 11274 Itaru Kaneko Application Specific Binary Coding (ASBC) of MPEG-21 descriptors Nobuyuki Kinoshita Spencer Cheng 11275 Woo-Jin Han SVC CE1 - Samsung verification of Univ. of Brescia (System I and II) 11276 SuSan Im The reference conformance test model(based on Mpeg-21 dii&didl) SangHoon Oh SeokHoon Kim Spencer Cheng 11277 Woo-Jin Han Technical description of Samsung proposal for SVC CE1 Bae-Keun Lee 11278 Yoon Sung-Yeol Kim Multi-view Video Coding using Layered Depth Image
16 Daehee Kim Sukhee Cho Kugjin Yun Chunghyun Ahn Sooin Lee 11279 Yoon Sung-Yeol Kim Coding of Layered Depth Image using Coherency between Point Samples Daehee Kim Sukhee Cho Kugjin Yun Chunghyun Ahn Sooin Lee 11280 Soo-Jun Park CE Report for Situation/View-based Photo Clustering Experiment (VCE-1, Myung Gil Jang Cross Check) 11281 Soo-Jun Park GT set proposed for situation/view based photo clustering experiment (VCE-1, Myung Gil Jang Cross Check) 11282 Soo-Jun Park Photo EXIF modification report on Ground Truth set of Situation/View based Myung Gil Jang photo clustering CE (VCE-1, Cross Check) 11283 Soo-Jun Park GT set proposed for category based photo classification experiment (VCE-2, Myung Gil Jang Cross Check) 11284 Soo-Jun Park Dataset of VCE-1 and VCE-2 Myung Gil Jang 11285 Won Ha Kim Verfication of SAMSUNG SVC software for CE1 Seyoon Jung 11286 Soo-Jun Park Proposal for a new CE: Query-by-ROI (region of interest) Min-Sung Ryu Chee Sun Won 11287 Jihun Cha A Proposal to Improve Compression Efficiency of LASeR Binary YeSun Joung Representation Won-sik Cheong Kyuheon Kim Young-kwon Lim 11288 Ian Burnett Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF) 11289 Ian Burnett Requirements for Streaming Digital Items 11290 Myriam Amielh Classification of MPEG MIME types on behalf of the AhG for MPEG-21 Medialocators 11291 Myriam Amielh A Framework for MPEG URI fragment Identifiers Ernest Wan 11292 Sukhee Cho Multi-view video coding using image stitching Daehee Kim Kugjin Yun Chunghyun Ahn Soo In Lee Yongtae Kim Kawnghoon Sohn 11293 Soo-Jun Park CE Report for Image Categorisation into Classes (VCE-2, Cross Check) Myung Gil Jang 11294 Diego Santa-Cruz Verification of results for SVC on CE3: Low Delay 11295 Yoshihisa Yamada Coding performance of Intra-only coding in AVC High Profile Kazuo Sugimoto Kohtaro Asai Tokumichi Murakami 11296 Kyunghee Ji Proposed Changes to MPEG-21 Event Reporting WD v.2.0 Youngjoo Song
17 Nammee Moon Jaegon Kim 11297 Sang-Kyun Kim CE Report for Situation/View-based Photo Clustering Experiment (VCE-1) Seungji Yang Yong Man Ro Ji-Yeun Kim 11298 Sang-Kyun Kim GT set proposed for situation/view based photo clustering experiment (VCE-1) Seungji Yang Yong Man Ro Ji-Yeun Kim 11299 Sang-Kyun Kim Photo EXIF modification report on Ground Truth set of Situation/View based Seungji Yang photo clustering CE (VCE-1) Yong Man Ro Ji-Yeun Kim 11300 Sang-Kyun Kim A proposal of GT set determination where "Time" and "Visual" information Seungji Yang conflict for Situation/View based photo clustering (VCE-1) Yong Man Ro Ji-Yeun Kim 11301 Sang-Kyun Kim CE Report for Category-based Photo Clustering Experiment (VCE-2) Seungji Yang Yong Man Ro Ji-Yeun Kim 11302 Sang-Kyun Kim GT set proposed for category based photo classification experiment (VCE-2) Seungji Yang Yong Man Ro Ji-Yeun Kim 11303 Sang-Kyun Kim CE Report for Face-based Photo Clustering Experiment (VCE-3) Seungji Yang Yong Man Ro Ji-Yeun Kim 11304 Sang-Kyun Kim Photo contribution status for face-based photo clustering experiment (VCE-3) Seungji Yang Yong Man Ro Ji-Yeun Kim 11305 Sang-Kyun Kim Software cross-check result of Dominant Color Temperature experiment Sang Hyun Kim (VCE-4) 11306 Joohee Kim Motion-compensated temporal filtering under delay constraints Hyeyeon Kim 11307 Paolo Nesi Proposed SMR Evaluation Model and Procedure Giorgio Zoia Pierfrancesco Bellini James Ingram Kia Ng Maurizio Campanai Jerome Barthelemy Gregoire Carpentier 11308 Akio Yamada MPEG-7 Visual XM Document version 21.1 Sang-Kyun Kim 11309 Akio Yamada WD 2.1 of MPEG-7 New Visual Extensions Sang-Kyun Kim 11310 Kristofer Kjörling Additions to the profiles under consideration document.
18 11311 LEE Men Huang MCTF-based Scalable Video Coding in Low Delay Mode SHEN Sheng Mei Yoshimasa HONDA 11312 Kristofer Kjörling Company support for the proposed High Efficiency AAC v2 Profile Werner Oomen Takeshi Norimatsu Toshiyuki Nomura Jean-Bernard Rault 11313 Gregoire Carpentier Proposal for a Core Experiment on WeightedScalesDS Jerome Barthelemy 11314 Noboru Harada Proposal of CE for improved floating-point compression using ACFC Takehiro Moriya (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding) 11315 Senator Jeong Proposed Common Event Descriptor and DataType Yeon-Jeong Jeong Weon-Geun Oh Ki-Song Yoon 11316 Kyuheon Kim KNB comments on MPEG-4 BSAC multi-channel 11317 Sang-Wook Kim Report on verification of test bitstream submissions to Spatial Audio Coding RM0 test 11318 Maria Trocan Cross-Verification of RWTH Results on SVC CE-4 Gregoire Pau Beatrice Pesquet-Popescu 11319 Kohtaro Asai Intra coding tools for AVC High Profile Yoshihisa Yamada 11320 Ruiqin Xiong MSRA scheme for SVC CE1 Xiangyang Ji Jizheng Xu Feng Wu 11321 Xiong Jizheng Xu Cross-Verification of DANAE+Thomson results on SVC CE1 11322 Euee S. Jang Hanyang/Humax Contribution to VCTR Sunyoung Lee JongWoo Won Sungwon Park YongHo Cho YoungRyul Lee 11323 Naoya Tanaka Report on the Listening Tests for the Spatial Audio RM0 Selection Takeshi Norimatsu 11324 Karol Wnukowicz Report on Dominant Color Temperature Descriptor CE (VCE-4) Wladyslaw Skarbek 11325 Robbie De Sutter Using MPEG-21 Part 16 in Applications Christian Timmerer Hermann Hellwagner Rik Van de Walle 11326 Karol Wnukowicz Extension of Dominant Color Temperature Descriptor by Spatial Coherency Wladyslaw Skarbek field 11327 Yi-Shin Tung MPEG-4 Visual: List of Problems Reported, v.13.1 Chung-Neng Wang Tihao Chiang Jens-Rainer Ohm 11328 Vincent Bottreau SVC CE5 - Spatial Transform using Three Lifting Steps filters
19 Christine Guillemot Rashid Ansari Edouard François 11329 Francesco Ziliani Coordinator's report on SVC's CE3: Low Delay 11330 Philippe LUCAS (Orange) Mobile requirements for lightweight scene representation A. COTARMANAC'H (France Télécom) 11331 Jens-Rainer Ohm Draft Guidelines for the SVC CE Process and Elevation Procedure 11332 Cédric Thiénot Results of the Core Experiment on Laser Binarization Grégoire Pau Claude Seyrat 11333 Vittorio Baroncini Suggested Test Method for SVC CE Visual Tests Thiow Keng Tan Tobias Oelbaum 11334 Xiangyang Ji An Architecture of Incorporating MPEG-4 AVC into 3D Subband Video Jizheng Xu Coding Ruiqin Xiong Debin Zhao Feng Wu 11335 Claude Seyrat study of ISO/IEC 21000-16 CD 11336 Frederik De Keukelaere Contribution to DID conformance Rik Van de Walle 11337 Claude Seyrat Requirements for Laser Binarization 11338 Frederik De Keukelaere An object oriented approach for the DIBO APIs Thomas DeMartini Jeroen Bekaert Rik Van de Walle 11339 Saar De Zutter Proposal for DIP bootstrapping Frederik De Keukelaere Rik Van de Walle 11340 A. Hoelzer Report on Spatial Audio Coding Subjective Tests at FhG Test Site C. Spenger D. Weninger J. Herre 11341 Alexandre Cotarmanac'h MPEG General Audio Codecs Pierrick Philippe 11342 Stephan Herrmann Improving the efficiency of a search and retrieval system using MPEG-7 Vasileios Mezaris Visual descriptors Haralambos Doulaverakis Ioannis Kompatsiaris Michael G. Strintzis 11343 Gregoire Pau Response to the SVC CE-3 on coding efficiency with low-delay constraints Beatrice Pesquet-Popescu 11344 Vasileios Mezaris On the potential use of machine learning for image categorization (VCE-2) Symeon Papadopoulos Ioannis Kompatsiaris Michael G. Strintzis 11345 Gregoire Pau MPEG-21 binarisation status with MPEG-7 BiM reference software Claude Seyrat 11346 Tilman Liebchen Proposed Text of Study on ISO/IEC 14496-3:2001/PDAM4 (Audio Lossless
20 Coding) 11347 Tilman Liebchen Report on MPEG-4 ALS Core Experiment 8 (Multi-channel extension for Patrick Runge ALS) 11348 Hendry An improved IPMP tool schema for Resource Protection Jeongyeon Lim Qonita M. Shahab Kyung-Ae Cha Munchurl Kim Keunsoo Park 11349 Hendry An improvement to the MPEG-21 IPMP Info Schema Munchurl Kim Keunsoo Park 11350 Kazumasa Yamazawa Proposal for MPEG-A of omni-directional video Hideaki Kimata Hitoshi Habe 11351 Watt UKNB Comments on ISO/IEC FCD 21000-2 : Digital Item Declaration 11352 Mathias Wien SVC CE4: RWTH Verification of HHI contribution 11353 Holger Crysandt Verification Report of Core Experiment on Audio Rhythm Patterns 11354 Giorgio Zoia MPEG-4 and SMR: report on available functionality for graphics Pierfrancesco Bellini Paolo Nesi Jerome Barthelemy 11355 BNB Preliminary BNB comments on ISO/IEC 21000-2 2nd edition FCD 11356 Jean-Claude Dufourd Report of work on the CE for LASeR Harmonization with SVG 11357 Jean-Claude Dufourd Report of work on the CE on LASeR Binary Representation 11358 Andrew Kinane Updated Status on Hardware Acceleration Module for SA-DCT Valentin Muresan Noel O'Connor 11359 Leszek Cieplinski Cross-verification of RPI results on SVC CE-4 11360 Jean-Charles Gicquel Subjective evaluation of CE1 results Stéphane Pateux Isabelle Amonou Sylvain Kervadec 11361 Jean-Claude Dufourd LASeR/SAF reference software: codec aligned with study 11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance 11363 V. Bottreau Technical description of the DANAE+Thomson proposal for SVC CE1 E. Francois S. Pateux G. Pau B. Timmerman M. Wien 11364 V.Bottreau SVC CE1: DANAE+Thomson verification of MSRA contribution E. Francois S. Pateux G. Pau B. Timmerman 11365 Benoit Timmerman Response to SVC CE5 - Optimization of tradeoff between motion information Peter Amon and texture Andreas Hutter
21 11366 Valentin Muresan Updated Status on Hardware Acceleration Module for Motion Estimation Noel O'Connor 11367 Benoit Timmerman SVC CE5 - Verification of IRISA results Peter Amon 11368 Nicola Adami SVC CE1: STool - a native spatially scalable approach to SVC Michele Brescianini Riccardo Leonardi Alberto Signoroni 11369 Vincent Bottreau SVC CE5 - Verification of Siemens results 11370 Pierrick Philippe France Telecom's contribution to the CFI on Scalable Audio and Speech Jean Bernard Rault Coding 11371 Christian Timmerer Comments on ISO/IEC 21000-7 COR/1 WD v.1 Joerg Heuer Gabriel Panis Hermann Hellwagner Andreas Hutter 11372 Edouard Francois Discussion on evaluation criteria for experts viewing tests in SVC CE1 Vincent Bottreau Jean Charles Gicquel Mathias Wien Jerome Vieron 11373 Juergen Herre On Evaluation Criteria for Spatial Audio Coding 11374 Cyril Concolato Implementation of LASeR (and of SVG) in the open-source GPAC project 11375 Cyril Concolato Analysis of the study of CD of LASeR 11376 Andreas Hutter Results of the Core Experiment on Laser Binarization Joerg Heuer Bernhard Reiterer 11377 Rongshan Yu Proposed WD changes for Lazy Coding for MPEG-4 Audio Scalable Lossless (SLS) Coding 11378 Nicola Adami Fully embedded entropy coding with arbitrary multiple adaptation capabilities Michele Brescianini Riccardo Leonardi Alberto Signoroni 11379 Rongshan Yu Proposed changes for ISO/IEC 14496-3/PDAM5 (Scalable Lossless Coding) 11380 Kristofer Kjörling Working draft proposal for PS conformance Heiko Purnhagen Andreas Schneider Werner Oomen 11381 Heiko Purnhagen Spatial Audio Coding Listening Test Site Report - CT/Philips Kristofer Kjörling Werner Oomen 11382 Dong-Yan Huang Proposal for Lossless Audio Coding Haibin Huang Rongshan Yu Xiao Lin Susanto Rahardja 11383 Ralf Geiger Proposal for Reduced Complexity of SLS 11384 J. Herre Additional Information on Fraunhofer/Agere Spatial Audio Coding A. Hoelzer Submission C. Spenger
22 11385 Konstantin Hanke Response to SVC CE4 - Spatial Lowpass Transition Filtering 11386 Konstantin Hanke SVC CE3 - Verification of ENST results 11387 Robert O'Callaghan Update of Results in Situation/View-Based Clustering (VCE-1) Miroslaw Bober 11388 Robert O'Callaghan Proposal on Ground Truth for Situation/View-Based Clustering (VCE-1) Miroslaw Bober 11389 werner oomen Working draft proposal for SSC conformance Frans de Bont Erik Schuijers 11390 Robert O'Callaghan Preliminary Results on Image Categorization (VCE-2) Miroslaw Bober 11391 Markus Beermann Quality-adaptive reconstruction-filtering: first results Mathias Wien 11392 Heiko Purnhagen Proposed corrigenda to AMD2, (parametric) Werner Oomen 11393 Kristofer Kjörling Analysis of spatial evaluation results Werner Oomen Jeroen Breebaart 11394 Herbert Thoma Test Bitstreams for Shape Coding 11395 S. R. Quackenbush Cross-check on ALS Core Experiment 11396 Andrea Kofler-Vogt CE report on systems extension (Siemens Index) Joerg Heuer Harald Kosch Andreas Hutter 11397 Heiko Schwarz Coordinators report on SVC CE5: Spatial Scalability 11398 Heiko Schwarz Further improvements of the HHI proposal for SVC CE1 Tobias Hinz Detlev Marpe Thomas Wiegand 11399 Heiko Schwarz Further results for the HHI proposal on combined scalability Detlev Marpe Thomas Wiegand 11400 Andreas Schneider Proposed Addition to MPEG-2 AAC Corrigendum 11401 Yongjun Wu Directional Intra-prediction for CE4 John W. Woods 11402 Yuriy A. Reznik Revision of MPEG-4 ALS Core Experiment 7 Tilman Liebchen 11403 Heiko Purnhagen Additional Information on CT/Philips Spatial Audio Coding System Kristofer Kjörling Werner Oomen 11404 Yuriy A. Reznik Cross-Check of SLS CE4 (Lazy Bitplane Coding) 11405 Gabriel Panis Report of CE on Bit-Stream Adaptation in Constrained and Streaming Christian Timmerer Environments Joerg Heuer Debargha Mukherjee Michael Ransburg Ingo Wolf Andreas Hutter Hermann Hellwagner
23 11406 Yuriy A. Reznik Status of Performance and Complexity of Lossless Audio Coding Architectures 11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher Predictor Orders) 11408 Daniel Larkin Updated Status of Shape Coding Binary Motion Estimation Hardware Valentin Muresan Acceleration Module 11409 Octavian Folea BBA implementation into AFX encoder: Donation to ISO Marius Preda Francoise Preteux 11410 Yuriy A. Reznik On Mostly-Lossless-Region Scalability 11411 Ihab Amer An IP Block for MPEG-4 Part 10 Context-Based Adaptive Variable Length Wael Badawy Coding (CAVLC) Graham Jullien 11412 Ihab Amer A Hardware Block for 2x2 Hadamard Transform and Quantization with Wael Badawy Application to MPEG–4 Part 10 Graham Jullien 11413 Ihab Amer A SystemC model for 2x2 Hadamard Transform and Quantization with Wael Badawy Application to MPEG–4 Part 10 Graham Jullien 11414 Ihab Amer A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG-4 Wael Badawy Part 10 Graham Jullien 11415 Ihab Amer A SystemC model for 4x4 Hadamard Transform and Quantization with Wael Badawy application to MPEG-4 Part 10 Graham Jullien 11416 Ihab Amer A Hardware Block for the MPEG-4 Part 10 4x4 Transformation and Wael Badawy Quantization Graham Jullien 11417 Ihab Amer A SystemC Model for the MPEG-4 Part 10 4x4 DCT-like Transformation and Wael Badawy Quantization Graham Jullien 11418 Blaszak Marek Domanski SVC CE6 results at Poznan University of Technology Rafal Lange 11419 Wo Chang MAF Photo Repository and Player 11420 Wo Chang MPEG-7 for WG1 (JPEG) JPSearch Project 11421 Jean-Claude Dufourd LASeR web site and logo Olivier Avaro 11422 Mohammed Zubair Supporting the storage of MPEG-21: Part 13 Scalable Video by an extension Visharam of the ISO Base Media File Format Ali Tabatabai Dave Singer 11423 Mikael Bourges-Sevenier Architecture updates and considerations for MPEG-4 Part 21 11424 Justin Ridge SVC CE6 co-ordinator report 11425 Mohammed Zubair Extending the AVC File Format (14496-15) to support FRExt Visharam Ali Tabatabai Dave Singer 11426 Justin Ridge Verification of SVC CE2 contribution for HHI Yiliang Bao Yilong Liu
24 11427 Justin Ridge FGS subband enhancements for scalable video coding Yiliang Bao Marta Karczewicz Xianglin Wang 11428 Justin Ridge FGS block enhancements for scalable video coding Yiliang Bao Marta Karczewicz Xianglin Wang 11429 Charles Fenimore Comparison of statistical methods for assessment of subjective video quality Stefan Leigh Alan Heckert 11430 Myriam Amielh Preliminary comments of DID v.2 FCD Gerrard Drury Shane Lauf Ian Burnett 11431 T. Mohamed Multiple IP-Core Hardware-Accelerated Software System Framework for W. Badawy MPEG4-Part9 11432 Wo Chang AHG on MPEG-7 Interoperability and Profiling 11433 IEC TC 100 via SC 29 IEC TC 100 NP [SC 29 N 6299] Secretariat 11434 Anthony Vetro Comments on Draft Call or Evidence on Multi-View Video Coding Hanspeter Pfister Wojciech Matusik Jun Xin 11435 Wojciech Matusik Calibration and Rectification Procedures for Multi-Camera Systems Hanspeter Pfister Tim Weyrich Anthony Vetro 11436 Jun Xin Preliminary studies on view interpolation for multi-view video coding Anthony Vetro Hanspeter Pfister Wojciech Matusik 11437 Marco Tagliasacchi Cross-verification of UNSW proposal for SVC CE1 11438 Davide Maestroni Cross-verification of UNSW proposal for SVC CE1 Marco Tagliasacchi Stefano Tubaro 11439 AUNB AUNB Contribution: Participation in core experiments 11440 Satoshi Ito Usage scenarios for composition of motion picture and study of constraint Toru Kambayashi description model for digital rights 11441 David Taubman SVC Core Experiment 1, Description of UNSW Contribution Reji Mathew Davide Maestroni Stefano Tubaro 11442 Miljan Vuletic Virtualisation Layer for Portable Hardware Accelerators Seamlessly Integrated Laura Pozzi into Software Applications Paolo Ienne 11443 Won-Young Yoo Watermarking attack technologies Weon-Geun Oh Young-Ho Suh 11444 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6308]
25 11445 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6309] 11446 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-2:2004/PDAM 2 11447 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/PDAM 10 11448 SC 29 Secretariat Summary of Voting on ISO/IEC CD 14496-20 11449 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3 11450 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-7:200X/DCOR 1 11451 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1 11452 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-16/PDAM 1 11453 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-16:2004/DCOR 1 11454 SC 29 Secretariat Summary of Voting on ISO/IEC 21000-6:2004/DCOR 1 11455 SC 29 Secretariat Summary of Voting on ISO/IEC 21000-7/PDAM 1 11456 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-16
26 Annex 4 Output document list
No. Source Title 6698 Convener List of Documents from the Palma, ES Meeting 6699 Convener Resolutions of the Palma, ES 6700 Convener List of AHGs Established at the 70th Meeting in Palma, ES 6701 Convener Report of the 70th Meeting in Palma, ES 6702 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents 6703 Convener Press Release of the 70th Meeting in Palma, ES 6704 Convener Meeting Notice of the 71st Meeting in Hong Kong, China 6705 HoD Guide for WG 11 Meeting Hosts 6706 HoD MPEG 101 6707 Video Request for Sub-division of ISO/IEC 11172-6 6708 Video Disposition of Comments on ISO/IEC 14496-2:2004 PDAM2 6709 Video Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in Simple Profile 6710 Video MPEG-4 Visual: List of Problems Reported version 14.0 6711 Video Text of ISO/IEC 14496-10:2004/DCOR1 6712 Video Text of ISO/IEC 15938-3/Amd.1 DCOR1 6713 Video WD 3.0 of MPEG-7 New Visual Extensions 6714 Video MPEG-7 Visual XM Document version 22.0 6715 Video Description of Core Experiments for MPEG-7 New Visual Extensions 6716 Video Scalable Video Model Version 3.0 6717 Video SVM 3.0 Software 6718 Video Guidelines for the SVC CE Process and Elevation Procedure 6719 Video Description of Core Experiments in MPEG-21 Scalable Video Coding 6720 Video Call for Evidence on Multi-View Video Coding 6721 Video Requirements on Test Material for Multi-view Video Coding Experiments 6722 Video Study of Video Coding Tools Repository V2.0 6723 Video VCTR Textual Description V1.0 6724 Convenor AHG on Video IDCT Specification 6725 Convenor AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6726 Convenor AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software 6727 Convenor AHG on Description Tools for MPEG-7 New Visual Extensions 6728 Convenor AHG on Core Experiments in Scalable Video Coding 6729 Convenor AHG on Scalable Video Model and SVM Software
27 6730 Convenor AHG on 3DAV Coding 6731 Convenor AHG on Video Coding Tools Repository 6732 Convenor AHG on further Exploration in Wavelet Video Coding 6733 Convenor AHG on Organization of a Workshop on Future Directions in Video Compression 6734 Convenor AHG on Communicating MPEG to the business Community 6735 Video Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine Transform 6736 Testing Report of the Subjective Quality Evaluation for SVC CE1 6737 Integration ISO/IEC 13818-5 MPEG-2 Reference Software 2nd edition 6738 Integration Text of ISO/IEC 14496-4:200x/DCOR1 Visual Bitstreams 6739 Integration Text of ISO/IEC 14496-4:200x/Amd1/DCOR1 FGS and Studio Bitstreams 6740 Integration Study of ISO/IEC 14496-4:200x/FPDAM9 AVC FRext Conformance 6741 Integration DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple Profile Conformance 6742 Integration ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile Conformance 6743 Integration Study of ISO/IEC 14496-4:200x/PDAM8 AVC FRext Reference Software 6744 Integration Draft DoC on ISO/IEC 21000-8 FCD MPEG-21 Reference Software 6745 Integration Study of ISO/IEC 21000-8 FCD MPEG-21 Reference Software 6746 Integration Methodology under consideration for MPEG-21 conformance 6747 SNHC Study text of DoC on ISO/IEC 14496-16/PDAM1 6748 SNHC Study text on ISO/IEC 14496-16/PDAM1 6749 SNHC AFX CE description 6750 SNHC AFX VM 16.0 6751 SNHC Text of ISO/IEC 14496-21 CD 6752 Convenor AHG on AFX documents, CEs, and software 6753 Convenor AHG on MPEG-J extensions for rendering 6754 ISG Status of HDL submissions and commitments for MPEG-4 Part-9 6755 ISG AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. 6756 ISG Updated status and Documentation on Hardware Acceleration Module for SA- DCT for MPEG-4 Part 2 6757 ISG Updated Status and documentation of the 4xPE Hardware Acceleration Module for Motion Estimation 6758 ISG Updated status and documentation of the 2-D IDCT Hardware Accelerator Module for MPEG-4 Part 2 6759 ISG Updated Status and documentation of the Shape Coding Binary Motion Estimation Hardware Acceleration Module 6760 ISG Updated status of Inverse Quantizer Hardware Accelerator Implementation for
28 MPEG-4 Part 2 6761 Liaison Liaison Statement to DCSDC 6762 Liaison Liaison Statement to the TV-Anytime Forum on MPEG-7 MDS 6763 Liaison Liaison Statement to OMA on LASeR 6764 Liaison Liaison Statement to 3GPP 6765 Liaison Liaison Statement to W3C 6766 Liaison Liaison Statement to WG 1 on JPSearch 6767 Liaison Statement of benefits from establishing a Category A liaison with ATSC 6768 Liaison Responses to National Body Comments 6769 Liaison List of Organisations with which MPEG entertains liaisons 6770 MDS Study of ISO/IEC FCD 21000-2 DID 2nd edition 6771 MDS Study of Preliminary Comments on ISO/IEC FCD 21000-2 DID 2nd edition 6772 MDS ISO/IEC CD 21000-4 MPEG-21 IPMP Components 6773 MDS TuC for 21000-4 MPEG-21 IPMP Components 6774 MDS Workplan for MPEG-21 REL/RDD Reference Software v.8 6775 MDS Study of preliminary comments on MPEG-21 DIA ISO/IEC 21000-7 PDAM-1 6776 MDS Study of text of MPEG-21 DIA ISO/IEC 21000-7 PDAM-1 6777 MDS Workplan for Core Experiment on DIA Conversions 6778 MDS Workplan for Core Experiment on Bit-Stream Adaptation in Constrained and Streaming Environments 6779 MDS MPEG-21 DIA Software Implementation Plan v.9 6780 MDS ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing 6781 MDS DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item Processing 6782 MDS MPEG-21 DIP Software Implementation Plan v.4 6783 MDS ISO/IEC CD 21000-15 MPEG-21 Event Reporting 6784 MDS WD 1.0 of ISO/IEC CD 21000-17 Fragment ID for MPEG Media Types 6785 Convenor AHG on MPEG-21 DIP& DID 2nd Edition 6786 Convenor AHG on MPEG-21 Event Reporting 6787 Convenor AHG on MPEG-21 DIA 6788 Convenor AHG on MPEG URI Fragment IDs 6789 Audio Study on 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction” 6790 Audio 14496-3:2001/AMD 2:2004/DCOR 1 (SSC) 6791 Audio Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions. 6792 Audio Study on 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) 6793 Audio Study on 14496-3:2001/PDAM 6, Lossless coding of 1-bit oversampled signals 6794 Audio Status of Performance and Complexity of MPEG Lossless Audio Coding
29 Architectures 6795 Audio Draft 3rd Edition of 14496-3 6796 Audio Workplan for Audio Lossless Coding (ALS) 6797 Audio Workplan for Scalable Lossless Coding (SLS) 6798 Audio Proposed Clarification of Audio Codec Timestamp Behavior 6799 Audio Working Draft of High Quality Parametric Audio Conformance 6800 Convenor Terms of Reference 6801 Convenor MPEG Standards 6802 Convenor Table of unpublished standards at FDIS level 6803 Convenor Work plan and time line 6804 Convenor Work item assignment 6805 Audio Working Draft of Parametric Stereo Conformance 6806 Audio Working Draft of additional test sequences for BSAC Conformance 6807 Audio Working Draft 0.1 AudioBIFS v3 Conformance 6808 Audio Workplan for Audio contribution to MPEG-4 Conformance 6809 Audio Status of MPEG-4 Audio Conformance 6810 Audio Working Draft of 15938-4:2002/PDAM 2, High-Level Description Extensions 6811 Audio Workplan for Weighted Scale DS 6812 Audio SMR Evaluation Model and Procedure 6813 Audio Report on Spatial Audio Coding RM0 Selection Tests 6814 Audio Workplan for MPEG-4 Spatial Audio Coding 6815 Audio Workplan on CfI on Scalable Speech and Audio Coding 6816 Audio MPEG General Audio Codecs History and Tools 6817 Convenor AHG on Audio Standards Maintenance 6818 Convenor AHG on MPEG-7 Audio 6819 Convenor AHG on Spatial Audio Coding 6820 Convenor AHG on MPEG-4 Lossless Audio Coding 6821 Convenor AHG on Symbolic Music Representation 6822 Convenor AHG On Exploration of Scalable Audio and Speech Coding 6823 MDS Request for Subdivision of ISO/IEC 21000: Part 17 Fragment Identification for MPEG Media Types 6824 Requirements MPEG-4/2 Profiles under Consideration 6825 Requirements LASER Requirements Document 6826 Requirements DoC of FCD of ISO/IEC 15938-9 6827 Requirements Text of FDIS of ISO/IEC 15938-9 6828 Requirements MPEG-7 Overview
30 6829 Requirements Second Draft of PDTR for potential second edition of ISO/IEC 21000-11 6830 Requirements Requirements for Scalable Video Coding 6831 Requirements MPEG-21 Profiles under Consideration 6832 Requirements Multimedia Application Format Overview & Requirements v.2 6833 Requirements Description of Scenario for Digital Item MAF 6834 Requirements Requirements for Multi-view Video Coding 6835 Requirements MPEG Multimedia Middleware Requirements v2.0 6836 Requirements Call for Proposals for MPEG Multimedia Middleware 6837 Convenor AHG on JPEG Liaison 6838 Convenor AHG on MAF Development 6839 Convenor AHG on Persistent Association 6840 Convenor AHG on Font Format Representation 6841 Convenor AHG on MPEG-21 Vision Update 6842 Convenor AHG on Digital Item Serialization 6843 Liaison Liaison Statement to OMA on Base Media File Format 6844 Systems DoC on ISO/IEC 13818-1:2000/DCOR3 6845 Systems Text of ISO/IEC 13818-1:2000/COR3 6846 Systems DoC on ISO/IEC 13818-1:2000/FPDAM4 6847 Systems Text of ISO/IEC 13818-1:2000/FDAM4 6848 Systems Text of ISO/IEC 14496-1:2004/FPDAM1 6849 Systems ISO/IEC 14496-14:2003/DCOR1 6850 Systems WD 1.0 of ISO/IEC 14496-15 Support for FREXT 6851 Convenor Proposed New Text of Software Copyright Disclaimer 6852 Systems DoC on ISO/IEC 14496-20/CD 6853 Systems Text of ISO/IEC 14496-20/FCD 6854 Systems Core Experiment on LASeR Binary Representation 6855 Systems Core Experiment on LASeR Harmonization with SVG 6856 Systems WD2.0 of ISO/IEC 14496-20 Reference Software 6857 Systems WD 1.0 ISO/IEC 15938-1/Amd.2 6858 Systems Core Experiments for Systems Extensions 6859 Systems MPEG-7 Systems reference software workplan 6860 Systems DoC on ISO/IEC 21000-16/CD 6861 Systems Text of ISO/IEC 21000-16/FCD 6862 Systems Core Experiments on MPEG-21 Binary Format 6863 Convenor AHG on XML Structure Binarization and Streaming 6864 Convenor AHG on Scene Representation
31 6865 Convenor AHG on MPEG File Formats 6866 Liaison Liaison Statement to IEC TC 100 on NP: Multimedia home server systems 6867 Integration WD4.0 of ISO/IEC 21000-14 MPEG-21 Conformance 6868 Liaison Template Cover Letter for M3W Liaison
32 Annex 5 Report of Requirements meeting
S Rob o Koen u en r c e :
NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below. Monday 9:00- opening plenary meeting 13:30 13:30-14:30 Lunch (ends one hour after plenary ends) Open 14:30-16:00 Joint with Systems on M3W Discobolo 16:00-16:30 11163 AHG on MPEG Multimedia Middleware - Jean Gelissen, Olivier Avaro , Martin Russ (Systems) 11192 MPEG Multimedia Middleware Requirements v.2.0 - Jean H.A. Gelissen Joint with Systems on LASeR 16:30-17:00 11330 Mobile requirements for lightweight scene representation - Philippe Lucas, et.al. Discobolo 11337 Requirements for Laser Binarization - Claude Seyrat Joint with Systems on Font Representation 17:00-17:30 11183 Proposed Text - OFFS - Single Document - based on OpenType(R) v1.4 - Mike Ksar Discobolo 11150 AHG on Font Format Representation - Mike Ksar, Vladimir Levantovsky Joint with Systems on Accessible Information Processing in MPEG 17:30-18:00 11250 Accessible Information Processing in MPEG - David Crombie, Roger Lenoir, Neil Discobolo McKenzie Joint with Systems on MP4 18:00-18:15 Discobolo 11260 Proposed URI scheme for mp4 file format - Yongju Cho, e.al. Tuesday MPEG-7 “Plenary” 11219 Draft for MPEG-7 Part 9 FDIS - Wo Chang 11229 USNB Contribution: JPSearch and MPEG-7 - A. G. Tescher for USNB 09:00-10:30 Neptuno 11420 MPEG-7 for WG1 (JPEG) JPSearch Project - Wo Chang 11432 AHG on MPEG-7 Interoperability and Profiling - Wo Chang 11181 Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240] - SC 29 Secretariat Joint meeting with MDS et.al. on MPEG-21 Purpose 10:45-11:30 11249 MPEG-21 - Comatose or Just Sleeping? – Chris Barlas , Niels Rump Neptuno 11151 AHG on MPEG-21 Integration and Outreach - Chris Barlas, Chris Russell Joint with Systems, Video, Audio and MDS on MPEG-A 11:30-13:00 11288 Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF) - Ian Neptuno Burnett, et.al. 13:00-14:00 Lunch Joint with Video on IDCT Standardization 11268 A new way to look at IDCT - Peter Schirling , et.al. 14:00-14:30 Neptuno 11224 IDCT Specification: A Problem and Opportunity - Gary Sullivan 11225 USNB Contribution: Replacement of IDCT Standard - A. G. Tescher for USNB Joint with Video on omni-directional video 14:30-15:00 Neptuno 11350 Proposal for MPEG-A of omni-directional video - Kazumasa Yamazawa, et.al. Joint with Video on Scalable Video Coding 15:00-15:30 Neptuno AHG report
33 Joint with Test on Persistent Association Technologies 11182 Editor's input on possible 2nd Edition on PAT - Niels Rump for the AhG 11195 Objective Impairment Test Method for Video PAT Evaluation - Jong-Tae Kim, et.al. 15:45-16:30 11201 Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Video Neptuno Watermarking - Ik-Hwan Cho, Weon-Geun Oh, Hae-Kwang Kim, Dong-Seok Jeong 11443 Watermarking attack technologies - Won-Young Yoo , Weon-Geun Oh , Young-Ho Suh Joint with Audio 11310 Additions to the profiles under consideration document. - Kristofer Kjörling 11312 Company support for the proposed High Efficiency AAC v2 Profile - Kristofer Kjörling, et.al. Urano 16:30-17:30 11251 CFI proposed to AGH on Scalable coding – Johnston (Audio) 11370 FT's contribution to the CFI on Scalable Audio and Speech Coding - Pierrick Philippe, et.al. 11227 USNB Contribution: Fine-grain scalable audio codec - A. G. Tescher for USNB 17:30-18:00 Communicating MPEG to the Business Community Neptuno Wednesday 09:00- Plenary meeting 11:00 Joint with MDS on MPEG-21 issues 11:30-12:30 11220 MPEG 21 as a secure interoperable DRM ? - FX Nuttall Jupiter 11276 The reference conformance test model(based on Mpeg-21 dii&didl) - SuSan Im, e.al. 12:30-13:00 Open 13:00-14:00 Lunch Open 14:00-15:30 MPEG-21 – next steps 15:30-16:30 11249 MPEG-21 - Comatose or Just Sleeping? – Chris Barlas , Niels Rump Neptuno 11289 Requirements for Streaming Digital Items - Ian Burnett 16:30-17:30 Joint with Systems - Review of M3W Requirements and Preliminary CFP Discobolo 17:30-18:00 JPSearch Neptuno Thursday Joint with Systems, Video, Audio and MDS on MPEG-A 11419 MAF Photo Repository and Player - Wo Chang 09:00-10:15 Neptuno 11239 Simple Profile for MPEG-21 DIA Usage Environment description tools - José Martínez, et.al. 10:15-10:30 Joint with Systems on LASeR Requirements Discobolo 10:30-11:00 Joint with Systems - Review of M3W Requirements and Preliminary CFP Neptuno 11:00-12:00 12:00-13:00 MPEG-21 IPMP Scope discussion Neptuno 13:00-14:00 Lunch 14:00-15:00 Joint with Video on 3DAV and SVC Video 15:00-16:00 Open 16:00-16:30 Joint with MDS on MPEG-21 MAF MDS 16:30-17:30 JPSearch Liaison Neptuno 17:30-18:00 MPEG-21 Vision Update Neptuno Friday Concluding MPEG-7 MPEG-7 p.9 FDIS (Wo) 08:00-08:30 Disposition of Comments on MPEG-7 (Masa/Rob - done) Neptuno Liaison to JPEG on JPSearch (Wo) AHG on JPSearch liaison Concluding MPEG-A Multimedia Application Format Overview & Requirements v.2 (Rob) AHG on MAF development (Rob/Klaus) 08:30-09:00 Neptuno A.1 J on 4 (Photo) A.2 DI MAF Description of Scenario for DI MAF (Klaus) Concluding MPEG-4 MPEG-2/4 Profiles under Consideration (Kristofer - done) 09:00-09:10 Neptuno AHG on Font Format Representation (Vlad) LASeR Rqs Document (Olivier)
34 M3W 09:10-09:30 M3W Requirements (Jean) Neptuno M3W Preliminary Call for Proposals (Jean) Concluding MPEG-21 Applications and Requirements for Scalable Video Coding (Ulrich) AHG on Serialization of MPEG-21 DI’s (Ian) 09:30-10:00 MPEG-21 Profiles under Consideration Neptuno Draft 2 of new PAT TR edition (Niels) PAT outreach AHG (Niels) AHG on MPEG-21 Vision Update (Bruce) Explorations 10:00-10:01 Requirements on Multiview Video Coding, v.2 (already approved) Neptuno Call for Evidence for Multiview Video Coding (already approved) 12:30-14:00 Lunch 14:00-20:37 Plenary meeting
1 MPEG-1, -2 and -4 IDCT Specification 11268 A new way to look at IDCT - Peter Schirling , et.al. 11224 IDCT Specification: A Problem and Opportunity - Gary Sullivan 11225 USNB Contribution: Replacement of IDCT Standard - A. G. Tescher for USNB
The problem raised by IEEE removing the IDCT standard will be resolved by the Video Group. The desirability of specifying an integer transform as an alternative to the traditional IDCT was discussed. An AHG was started to study the issue, which was seen as separate from re-instating the IDCT in some way. 2 MPEG-4
2.1 Part 3: New Audio Profile? 11310 Additions to the profiles under consideration document. - Kristofer Kjörling 11312 Company support for the proposed High Efficiency AAC v2 Profile - Kristofer Kjörling, et.al.
A request was put forward in a joint meeting with Audio for the definition of a new MPEG-4 Audio profile that combines AAC, SBR and Parametric Stereo tools. At this meeting, enough support was gathered for the Requirements Group to give the go-ahead. There was no consensus on the name of this new Profile. The proposed name, HE AAC v.2, has advantages and disadvantages: It could confuse market place It could also give the right message, indicating yet a further improvement.
Still, Profiles as a principle never get re-defined, which would mean that the name is not suitable.
A new Profiles under Consideration Document was issued, N6824 2.2 Part 18 (?): OpenType as MPEG-4 part? 11183 Proposed Text - OFFS - Single Document - based on OpenType(R) v1.4 - Mike Ksar 11150 AHG on Font Format Representation - Mike Ksar, Vladimir Levantovsky
Pending the submission to MPEG of the OpenType specification free of encumbrances, the work in MPEG cannot continue. MPEG was informed that individuals will continue editing work in anticipation of such a submission. MPEG was informed that a decision from relevant IP holders could be expected by the first week of December
An AHG continued to operate, it has number N6840
35 2.3 Part 14 - MP4 File Format 11260 Proposed URI scheme for mp4 file format - Yongju Cho, e.al. Add suggestion to add a URI addressing scheme for identifying individual Elementary Streams to ISO file format was added to the “Technologies under Consideration” document. The Requirements Group supported the idea; the question is where to carry it the work, i.e., in what amendment. This decision is left to the Systems Group. 2.4 Part 20 - LASeR 11330 Mobile requirements for lightweight scene representation - Philippe Lucas, et.al. The Requirements and Systems Groups agreed that maximizing overlap between SVG and LASeR was a goal. The question was how far to take this, and how compatibility should be defined exactly. A break-out group edited the exact language which was added to the new version of the LASeR Requirements Document.
11337 Requirements for Laser Binarization - Claude Seyrat Requirements for harmonization with BiM were added to the Requirements Document as well. They were phrased as “may”s, indicating that this would be a nice-to-have, but no absolute must.
A new LASeR Requirements document was issued as N6825. 3 MPEG-7
3.1 General A new version of the MPEG-7 Overview was approved, with an editing period. If the respective group chair are good enough to contribute their parts, it may actually get released.
This document is N6828 3.2 Part 9 – Profiles and Levels 11219 Draft for MPEG-7 Part 9 FDIS - Wo Chang 11432 AHG on MPEG-7 Interoperability and Profiling - Wo Chang 11181 Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240] - SC 29 Secretariat FDIS was approved with very minor changes to what was developed in the AHG. The Requirements Group thanked Wo Chang as editor, en the Japanese National Body for its insightful and thorough comments, as well as its contributions to resolving those comments.
The FDIS and document on FCD were issued as N6827 and N6826 respectively. 3.3 JPsearch Liaison 11229 USNB Contribution: JPSearch and MPEG-7 - A. G. Tescher for USNB 11420 MPEG-7 for WG1 (JPEG) JPSearch Project - Wo Chang A liaison was written to the JPEG WG indicating how MPEG-7 technology can support the JPSearch requirements, and expressing MPEG’s availability to support JPEG in its work on JPSearch if MPEG-7 technology will be considered.
The liaison has number N6766. The AHG that completed the editing and may assist in the evaluation work if required is N6837 4 MPEG-21
4.1 General; Requirements 11289 Requirements for Streaming Digital Items - Ian Burnett
36 The meeting agreed with the notion that providing support for streaming (or, more in general, transport and storage) of DI’s is a good idea. To better understand the scope of such work, an AHG was created.
The AHG number is N6842
11239 Simple Profile for MPEG-21 DIA Usage Environment description tools - José Martínez, et.al The contribution suggests to make simple Profile for DIA, which includes all UED tools. The meeting agreed that this could be a potential profile, and a version of the mPEG-21 Profiles under Consideration document was created.
The MPEG-21 PuC document has number N6831 4.2 Part 4: MPEG-21 IPMP 11220 MPEG 21 as a secure interoperable DRM ? - FX Nuttall Following this presentation, a discussion ensued on the goal of the DRM standardization work in MPEG-21. It appeared that there still is no real consensus on the IPMP work in MPEG-21. Different views exist over what mPEG-21 should do – standardize as much of an IPMP system as possible, or enable the communication between different DRMs? It was also noted that the uptake of the tools that do exist is relatively limited. This discussion was combined with two other discussions: the one on MPEG-21 Outreach (see below on concrete actions) and the one on and MPEG-21 MAF (also see below for conclusions). 4.3 Part 11: Persistent Association Technologies 11182 Editor's input on possible 2nd Edition on PAT - Niels Rump for the AhG The AHG work has resulted in two names of people interested in the work. That is a too small number compared to the interest in Audio, and the meeting concluded that more support would be needed to successfully complete a second version of the PAT that includes Video. The meeting decided to give it one more AHG study period to gather more interest. AN AHG was set up to contact experts, among other things at a relevant international conference the week after the MPEG meeting, in Seoul. (LNCS International Workshop on Digital Watermarking conference.)
The remaining contributions on this issue were evaluated assuming the work would indeed take place.
11195 Objective Impairment Test Method for Video PAT Evaluation - Jong-Tae Kim, et.al. Extending objective measures is good idea. The meeting concluded that they would need to be tested and verified before MPEG can reference them in its technical report. It was unclear if such verification has actually taken place.
11201 Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Video Watermarking - Ik- Hwan Cho, Weon-Geun Oh, Hae-Kwang Kim, Dong-Seok Jeong
Again the proposal looked interesting, and again the meeting noted that there needs to be scientific proof that the metrics have some predictive value. There is an ANSI standard that may be a good candidate.
11443 Watermarking attack technologies - Won-Young Yoo , Weon-Geun Oh , Young-Ho Suh The same conclusion holds as for the previous two contributions. Potentially relevant work, the value of which needs to be scientifically documented.
The AHG has number N6839
37 The second draft of PDTR for potential second edition of ISO/IEC 21000-11 is N6829 4.4 Part 13: SVC After discussing the results of the AHG, the meeting agreed that the Applications/Requirements document needs more focus, and a better understanding about required configurations, that can later be mapped onto profiles.
The requirements themselves are good, with the low delay requirement having been clarified at the meeting.
Application examples should guide the prioritization. Because application examples did not yet map onto requirements, the document was restructured as follows: 1. requirements 2. application families 3. application examples
The idea is that examples map onto families, and that these families are used to derive requirements. The SVC Requirements Document was revised thoroughly. All old examples that are not yet rewritten into the new template have been collected into an annex. Examples that have not been rewritten by the next meeting will be dropped.
The new Requirements Document has number N6830 4.5 Part 14 – Conformance 11276 The reference conformance test model(based on Mpeg-21 dii&didl) - SuSan Im, e.al. This presentation, while registered for Requirements, was referred to the Integration and MDS groups. 4.6 MPEG-21 Outreach 11249 MPEG-21 – Comatose or Just Sleeping? – Chris Barlas , Niels Rump 11151 AHG on MPEG-21 Integration and Outreach – Chris Barlas, Chris Russell
Lively discussions ensued after the presentation of m11249. The contribution distinguishes: technical reports – “scaffolding” parts that deal with content by reference parts that touch resources directly … and questions whether the parts that deal with content directly should be there at all. MPEG- 21’s Unique Selling Point, according to the authors of this contribution, is dealing with content by reference.
The following remarks were made on what could be problems and solutions facing MPEG-21 adoption: “MPEG-21 deals with value chains … but has no integration method for value chains. “Many people, inside and outside of MPEG, consider MPEG-21 too complex for end-point (consumer) delivery. It is targeted at no market in specific – so there is no specific interest. “In addition, and unlike the situation for other MPEG standards, there are no identified subsets (Profiles) that manage complexity in MPEG-21. “Being hybrid not the real problem. What we miss is solving “my little problem”. Don’t do anything top-down anymore, but start doing things bottom-up. “Is the Unique Selling Point in addressing content by reference? Or in the DI paradigm?
38 “Need to concentrate on own constituency – end-point delivery. “Framework is very generic for everything – but not suitable for any particular problem. MPEG-21 seems to rely on other standardization bodies to take MPEG-21 and constrain it – but industry has no time for such an additional cycle. Companies are not interested “MPEG-21 has too much fat – we confused vision with application. Need to go bottom-up, and see what tools we can provide to solve problems. o “Hard to imagine we would throw out the vision – it embodies what industry needs at this point o “don’t want to throw that out, but rather not to focus on redefining it now “Vision of MPEG-21 as a conduit to deploy parts (2), 4 and 7 is still there. Need to get down to detail. o “MPEG-21 should be “glue-y” product. MPEG-21. The Sticky Standard. “Keep adding parts, and passing the message is becoming increasingly hard! “There are people out there that have taken MPEG-21 bits and built a solution around the parts. We can learn from them. Most of these seem to be in the library space. o Some people would prefer looking at the end-delivery space.
In conclusion of the discussion, there was a feeling that MPEG needs to go back to the original vision and see how that was relevant in today’s market, 4 to 5 years after starting MPEG-21. An AHG was started to do that.
The number of the AHG is N6841 5 MAF (MPEG-A)
5.1 General; Requirements 11419 MAF Photo Repository and Player - Wo Chang The meeting discussed the Jon4 MAF, and its value proposition. Jon4 must at least encompass all EXIF metadata, because that is what is already in common use today, and Jon4 shall not offer less. If need be, MPEG-7 shall be extended to include more EXIF metadata (v 2.2) than what is proposed now.
The meeting discussed the criteria for starting an MAF at some length. These criteria were capture in the MAF Overview and Requirements document, in the form of requirements for creating an MAF. The criteria (requirements) are aimed at making sure that everything is done to allow an MAF to become successful in the marketplace. The criteria are similar to those for establishing a profile (in MPEG-4, -7 or -21). One time added was the requirement that at least one white paper on the MAF should be available at the end the standardization process.
The new Multimedia Application Format Overview & Requirements v.2 is N6832 5.2 MPEG-21 MAF Session 11288 Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF) - Ian Burnett Contribution contains proposal for MMPEG-21 Content Format. It would do something similar to the DCF in OMA. A discussion ensued on how complete the format should be. E.g., should it define encryption? Should binarization should be handled – or should it be handled separately? Some participatnts asked that this format unify existing approaches to, e.g., encryption (e.g., look at and use what ISMA has specified). It was agreed that the goal would be to focus at horizontal application domains, not just mobile. There was some opposition to doing this at all, allegedly
39 because of the confusion it might cause with, e.g., pure mp3 or mp4 formats, but this opposition was not shared and not sustained.
Three phases were identified for the development; it was left to future decision if these would all be published. 1) Format with no DRM at all 2) Only REL (binariized and profiled), but no further IPMP elements 3) Adding IPMP elements form MPEG-21 IPMP when that is ready
A break-out group studied a scenario that would form the basis of this format.
The scenario is described in N6833 The AHG to further study the scenario is N6838 5.3 Omni-directional Video 11350 Proposal for MPEG-A of omni-directional video - Kazumasa Yamazawa, et.al.
This contribution proposes an MAF for omni-directional video. The meeting looked at the proposed technologies and understood that almost all of them could be found in MPEG-4, with perhaps a few elements from MPEG-7.
Besides the issue of what would actually be the technologies in this MAF, the question came up of whether this would constitute an MAF in the way MAFs were intended. Will its use be wide enough?
After further discussion among the chairs meeting and in the requirements group, a set of general criteria were agreed (see above) and these were presented in a joint Video/Requirements meeting. Contributions are invited for a next meeting to allow the Requirements Group to judge if such requirements could be met for an omni-directional video MAF. 6 Explorations & Others
6.1 General 11250 Accessible Information Processing in MPEG - David Crombie, Roger Lenoir, Neil McKenzie Unfortunately, no one appeared to be present to introduce the contribution. 6.2 Scalable Audio Coding 11251 CFI proposed to AGH on Scalable coding – Johnston 11370 FT's contribution to the CFI on Scalable Audio and Speech Coding - Pierrick Philippe, et.al. 11227 USNB Contribution: Fine-grain scalable audio codec - A. G. Tescher for USNB
The Requirements and Audio Groups met jointly to discuss the proposed RFI. While the text of the RFI was largely OK, after this joint meeting, the audio group was left with the task to better define when a new technology would meet the requirements for a new standardization project to start. The Requirements Group later understood that the Audio Group decided not to issue an RFI at this point in time. The reader is referred to the report of the Audio Group for further discussion on this matter. 6.3 3DAV A Call for Evidence was approved and issued for Multiview Video Coding. The accompanying requirements (N6501), extracted from the general 3DA requirements, were approved as well.
The Requirements are found in N6834 The Call for Evidence is N6720
40 6.4 M3W 11163 AHG on MPEG Multimedia Middleware - Jean Gelissen, Olivier Avaro , Martin Russ 11192 MPEG Multimedia Middleware Requirements v.2.0 - Jean H.A. Gelissen
A new version of the requirements document was approved (6835). A Call for Proposals was discussed and released in preliminary version. The final version will be issued in January 2005. Responses to the Call are due in March 2005
The Requirements Document is N6835 The CfP is N6836
41 Annex 6 Report of Systems meeting
S Systems Chair and Break-out group o Chairs u r c e :
Title: Systems Meeting Report Status: Draft Editor: Olivier Avaro (Streamezzo)
Contributors: Claude Seyrat (Expway), Jean-Claude Dufourd (Streamezzo),
Overview The main outputs of the meeting from the Systems Sub-group perspective are:
No. Title TBP Available X 13818-1:2000/DCOR.3 Correction for Field Picture 6844 DoC on ISO/IEC 13818-1:2000/DCOR3 No 04/10/22 6845 Text of ISO/IEC 13818-1:2000/COR3 No 04/10/22 X 13818-1:2000/Amd.4 Metadata Application Format CP 6846 DoC on ISO/IEC 13818-1:2000/FPDAM4 No 04/10/22 6847 Text of ISO/IEC 13818-1:2000/FDAM4 No 04/10/22 X 14496-1 :2003/Amd.1 Text Profile Descriptor 6848 Study Text of ISO/IEC 14496-1:2004/PDAM1 No 04/10/22 X 14496-14 MP4 File Format 6849 ISO/IEC 14496-14:2003/DCOR1 No 04/10/22 X 14496-15 AVC File Format 6850 WD 1.0 of ISO/IEC 14496-15 Support for FREXT No 04/10/29 X 14496-20 LASeR 6852 DoC on ISO/IEC 14496-20/CD No 04/10/22 6853 Text of ISO/IEC 14496-20/FCD Yes 04/11/05 6854 Core Experiment on LASeR Binary Representation No 04/10/22 6855 Core Experiment on LASeR Harmonization with SVG No 04/10/22 6856 WD2.0 of ISO/IEC 14496-20 Reference Software No 04/11/25 X 15938-1 Systems 6857 WD 1.0 ISO/IEC 15938-1/Amd.2 No 04/10/22 6858 Core Experiments for Systems Extensions No 04/10/22 6859 MPEG-7 Systems reference software workplan No 04/10/22 X 21000-16 MPEG-21 Binary Format 6860 DoC on ISO/IEC 21000-16/CD No 04/10/22 6861 Text of ISO/IEC 21000-16/FCD No 04/10/29 6862 Core Experiments on MPEG-21 Binary Format No 04/10/22
42 General issues
General The meeting report from Redmond has been approved.
Discussion on the documentation of BiM across MPEG standards: - Option 1 : Separate MPEG Standard - Option 2 : Part of Generic Technology Standard with IDCT - Option 3 : Part of MPEG-21 - Current : Part of MPEG-7 Systems Décision will be made in January.
List of standards under development
Pr Pt Edit. Project Description CfP WD CD FCD FDIS 4 1 2004 Amd.1 Text Profile Descriptors 04/07 04/10 05/04 4 11 2003 Amd.4 XMT and MPEG-J 03/10 03/12 04/07 05/01 Extensions 4 14 2004 Cor.1 Correction on File-type Box 04/10 05/01 4 15 2004 Amd.1 Support for FREXT 04/10 05/01 05/07 06/01 4 17 2003 1st Ed. Streaming Text Format 03/03 03/07 03/12 05/01 4 20 2004 1st Ed. Lightweight Application 04/03 04/07 04/10 05/04 Scene 7 1 2004 Amd.2 BiM Extension 04/10 05/01 05/07 06/01 21 9 200x 1st Ed. File Format 03/12 04/03 04/07 05/01 21 16 200x 1st Ed. Binary Format 04/03 04/07 04/10 05/04
Standing Documents
Pr Pt Documents No. Meeting 4 13 MPEG IPMP Extensions Overview N6338 04/03 München 21 xx MPEG Multimedia Middleware Context and N6335 04/03 Objectives München
Demonstrations The following demonstrations were made: - M11207 INT: MPEG-4 3D Player. - Fraunhofer: AVC / He-AAC Streaming. - France Telecom R&D: Scalable representation of 3D content.
FAQ The FAQ were updated as needed.
43 AOB None.
44 MPEG-2 Systems (13818-1)
13818-1:2000 Amd.4 Topics 1. ISAN and VISAN Signaling. Contributions All NB comments were addressed and the final text of this amendment was produced.
Technical Work Finalized.
13818-1:2000 Cor. 3 Topics 1. Correction on Field Picture Contributions M11449: Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3. All comments were addressed and the final text of this amendment was produced.
Technical Work Finalized.
MPEG-2 Exploratory Activities Topics None.
MPEG-4 Systems (14496-1)
14496-1:2003 Amd.1 M11451: Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1. All comments were addressed and text of ISO/IEC 14496-1:200X/FPDAM 1 was produced.
Technical Work in Progress.
MPEG-4 Scene Description (14496-11)
14496-11:2003 Amd.4 Topics 1. XMT Extensions; 2. MPEG-J Extensions.
45 Contributions None.
Technical Work in Progress.
MPEG-4 AVC File Format (14496-15)
14496-15:2004 Amd.1 Topics 1. Support for FREXT Contributions
M11425: Proposed amendment to Part 15 to support FREXT (Decoder specific info. extensions and support for additional NAL Units). Accepted. Production of WD.
Technical Work in Progress.
Streaming Text (14496-17)
Topics 1. Coded Representation of Text Stream. Contributions None. This specification is currently at FCD stage. The editors of the document have requested additional time to implement the editorial guidelines decided in the July Redmong meeting. Text will be promoted to FDIS at the January Honk-Kong meeting. Technical Work in Progress.
Font Compression and Streaming (14496-18)
Exploratory Activities
Topics 1. OpenType Standardization Contributions M11183: Proposed Text - Open Font Format Specifications (OFFS) - Single Document - based on OpenType(R) v1.4.
Technical work will not be progressed before owners of the copyright of the specification have given their agreement to go forward. AHG will continue with appropriate mandate (Cf. Requirements report).
Technical Work in Progress.
46 47 LASeR (14496-20)
Topics 1. Lightweight Application Scene Representation Contributions
Discussion on Requirements
M1130: Mobile requirements for lightweight scene representation. Agreement to add as a requirement that a profile of LASeR shall be compatible with SVGT1.2.
M11337: Requirements for Laser Binarization. Requirement 1a (Flexibility) is already here. Requirement 1b (Genericity) has bee taken into account. Requirement 2 (support MPEG-7 and MPEG-21) is only a nice to have and not a must have. Documented as such. Requirements 3 (extension with XML namespace) is supported through private data. Requirements 4 (Low footprint implementation) is already supported.
The LASER requirement document was updated accordingly. A discussion started on compatibility with SVG that did not reach conclusion. Current understanding is documented in the LASER Requirement document. These issues will be further studied in the CE on SVG Harmonization as well as on the LASER AHG reflector.
Input Contributions
M11448: All comments have been successfully addressed. See DoC.
M11198: CE Study of LASeR and SAF CD Used as a starting point as recommended by the AHG. May need to add a drawing to explain LASeR position with respect to SVG. Decisions on study text: Decision to start with the study with the AHG recommended changes to create the FCD. All open issues recorded in the CE on Harmonization workplan
M11330: Mobile requirements for lightweight scene representation Request document rendering model as SVG: accept (done). Remove switch from g and use restricted version of page/pageSet for that: to be investigated in the CE. Use restricted clip attribute instead of g extension: to be investigated in the CE. Xml events: already satisfied with study 4.7. LASeR should be able to encode ECMAScript in : to be investigated in the CE. Freeze should be renamed back to fill: to be investigated in the CE.
M11332b: Results of the Core Experiment on Laser Binarization Contribution was presented and discussed in the AHG meeting. It was again discussed as part of the elaboration of the workplan of the CE on Binarization.
M11356: Report of work on the CE for LASeR Harmonization with SVG Contribution was presented and discussed in the AHG meeting. It was again discussed as part of the elaboration of the workplan of the CE on Harmonization.
M11357: Report of work on the CE on LASeR Binary Representation Contribution was presented and discussed in the pre-meeting. It was again discussed as part of the elaboration of the workplan of the CE on Binarization.
48 M11356, M11357: Report of work on the CE for LASeR Harmonization with SVG and Report of work on the CE on LASeR Binary Representation.
M11376: Results of the Core Experiment on Laser Binarization The following results were presented to the group: on compression, one does not loose or gain much by using BiM. Clarification needed on what exactly is compared in terms of code size, first indication is that code size is similar: the numbers are for the J2SE codec including the XML serialization for both. Contribution was again discussed as part of the elaboration of the workplan of the CE on Binarization (see below).
Decisions on CE on Binarization: 1. Discussions on how would we document the specification when using BiM for LASeR - Normative text: the syntax is specified in SDL (normative) so as to allow extensions. - Informative annex: state that the normative syntax is compatible with BiM and can be either implemented with a hard-wired decoder or with a BiM decoder. 2. Further steps on the CE on binarisation - improvement of the schemas for better binarisation - find configuration for BiM to optimize extensibility - generate SDL - generate Java for reference software and cross-check it - target end of CE by January meeting - decision about BiM usage will be made at the end of the CE 3. Established assertions: - BiM compression is equivalent to ad-hoc compression - Code size is strongly presumed to be similar, but this needs to be cross-checked
M11287: A Proposal to Improve Compression Efficiency of LASeR Binary Representation Contribution was presented and discussed in the AHG meeting. Type codec of ETRI and Net&TV to be cross-checked in the framework of the on-going CE on Binarization. - test set needs updating; - results for the updated test set will be provided to validate the algorithm; - the spec will be cross-checked by an independent implementation in the reference software; - decision to be made in January.
M11265: LASER adaptive to time varying resources Contribution was presented and discussed in the AHG meeting. This will be discussed as part of the continuing CE on Harmonization together with the switch issues.
M11177: Initial Reference Software for LASeR and SAF The document was delivered on time and used by four independent parties. There is already a partial update of it in M11361. There are different APIs in the J2SE part of the RS and the J2ME part. This has led to confusion and may do so again. Consequently, there is a need to put some information in the readme of the reference software. This explains the difficulty in interpreting the CE results. J2ME binary specific decoder is estimated around 16Kb (jar).
M11361: LASeR/SAF reference software: codec aligned with study Contribution contains the codec aligned with input study document. This work was presented as part of the result of the work on the 2 CEs.
M11374: Implementation of LASeR (and of SVG) in the open-source GPAC project
49 This document aims at informing the group of the existence of the software. ENST encourages interested parties to use the software and participate in its further development. The whole code is available on gpac.sourceforge.net (not mentioned in the documentation, and no public release yet, but present in the CVS base). The group acknowledges with enthusiasm the existence of a GPL Ansi C implementation of LASeR and SAF, which provides a testing framework for ideas on integration of LASeR and SAF in the existing MPEG-4 Systems framework.
M11375: Analysis of the study of CD of LASeR Most comments are accepted. Trigger structure: to be investigated in the CE.
M11421: Proposed LASeR logos and web site organization The logos and project for a web site are presented and discussed. A few suggestions are made, such as change “membership” to “interest group” and move the ahg reference to the links section, and add a list of implementations/products. A final logo is agreed (see Figure 1).
Figure 1: LASER LOGO
Discussions
Normativness of LASER-ML: LASeR XML is an intermediate step in the process of encoding SVG (or other languages) to binary. It is as well the reference format to specify conformance of LASeR. LASeR XML is also a possible authoring format. There is so far no real argument to make it normative. Decisions that LASeR XML remains informative.
Support of SVG Fonts: LASER supports SVG Fonts by converting them to Truetype and sending them as a separate stream. Additional compression is part 18.
Technical Work in Progress.
50 MPEG-7 Systems (15938-1)
General
M11233 - Core experiment report for Fast Random Access into MPEG7 BiM streams The contribution presents the result of the CE on indexing. The contribution presents results regarding length position codes (fixed and variable length). Both cases show advantages for different scenarios. However is it worth the complexity to have to encoding mode for the same feature. The contribution describes also that the B-tree approach is inferior to the B-Chop approach in all the agreed test cases. The group decided to adopt the technology as described in the 70th meeting CE document. A CE on indexing is set up to finalize the technical work.
M11396 - CE report on systems extension (Siemens Index) The contribution presents a proposal of differential coding of position codes which provides good compression ratio. The solution is partially adopted as presented in the WD Amd.2. Other items are evaluated in the CE.
M11190 - MPEG-7 BiM for Unidirectional Networks The contribution presents a solution to better cope with situation where fragmentation is fixed. A CE is established to demonstrate the results with an integrated software and to evaluate the similarities/differences with TV-Anytime. The contribution presents also a new command "locate" to add a new fragment based on ID (à la bifs). The mechanism rely on attribute carried in the payload. A more suited mechanism to place an ID would be preferable in order not to bind position in the context tree to content. Contributions on this subject are welcome at the next meeting.
M11345 - MPEG-21 binarisation status with MPEG-7 BiM reference software This contribution presents the current status of the BiM reference software. Noted.
Technical Work in Progress.
51 MPEG-21 File Format (21000-9)
21000-9 Topics 1. MPEG-21 File Format Contributions M11422: Supporting the storage of MPEG-21: Part 13 Scalable Video by an extension of the ISO Base Media File Format. First study on how SVC scalability should be supported at the systems level. Analysis for the File Format Case. Discussion on the storage of the stream as a single stream or as separate elementary streams. Discussion of access units. Decision to start an activity on the transport of SVC. Will be further investigated in AHG (Revive the MP4 AHG).
M11255: Preliminary comments on Text of ISO/IEC 21000-9 FCD. Propose to remove editorial comments concerning the technology under consideration, and the registration of MIME types. Accepted. For the time being, the addressing mechanism in the technology under consideration will be further studied under the activity on fragment identifiers in MDS. Decision to be implemented at the next January MPEG meeting.
Technical Work in Progress.
52 MPEG-21 Binary Format (21000-16)
21000-16 Topics 1. Binarization of MPEG-21 Data Contributions M11456 - Summary of Voting on ISO/IEC CD 21000-16 All comments from NB have been addressed. See DoC.
M11335 - study of ISO/IEC 21000-16 CD The document presents a proposal for a study of ISO/IEC 21000-16 CD taking into account the comments that have been presented prior to the meeting. The document is adopted as a starting point for the FCD.
M11256 - Preliminary Comments on ISO/IEC 21000-16 CD (Binary Format) This contribution presents issues regarding MPEG-21 binarization CD. These comments have been taken into account in the study of MPEG-21 binarization (m11335).
M11325 - Using MPEG-21 Part 16 in Applications An informative contribution which presents a parser developed to deal transparently with BiM and XML. The demonstration showing the encoding and decoding of BiM or XML events, size and time comparison. Shows that BiM reference software which was intended to generate conformant bitstreams is slow. The reset command requires the decoder to keep the initial description in memory and might be subject to profiling. Proponents will contribute in the future to improve BiM reference software.
M11274 - Application Specific Binary Coding (ASBC) of MPEG-21 descriptors. Proposal to defined application specific MPEG-21 encoding using BiM. To be studied in CE.
Technical Work in Progress.
53 Other Activities
Multimedia Middleware Topics 1. Use cases; 2. Middleware Architecture; 3. Multimedia APIs.
Contributions M11192: MPEG Multimedia Middleware Requirements v.2.0. Requirements have been updated. Preliminary Call in October, Final Call in January, Submissions in April 2005.
Technical Work in Progress.
Other Activities
URI Scheme in MPEG M11290, M11260, M11291: Classification of MPEG MIME types. Proposed URI scheme for mp4 file format. Authoritative Fragment Identifiers for MPEG. All proposals discussed. Assessment that it would make sense to harmonize them. This will be done within an AHG hosted by MDS. Production of a working draft. Discussion on what MPEG standard will host this specification. Decision to start within MPEG-21 for the time being and create a new part (Part 17).
MPEG Application Format M11419: See Requirements report.
MPEG-J Extensions M11204: MPEG-J for real case applications: design of a minimal and universal primitive class. Issue noted and assessed to be valid. Assessment that it is too early to produce an amendment. More understanding on the technology and relation with existing technology would be needed.
Transport and Delivery of MPEG-21 DID M11289, M11271: Requirements for Streaming Digital Items. IPMPTransfer Description for MPEG-21 IPMP. The issue was discussed jointly with requirements and MDS. An AHG will be created to study further the issue.
54 Latest References and Publication Status
Pr Pt Standard No. Issue Status Doc. with Purpose 2 1 ISO/IEC 13818-1/Amd.7 Published 2000/12 2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd 00/12 Published 2000/12 Edition) 2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/03 2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07 Published 2003/12 Trondheim 2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/03 2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5771 03/07 AMD ITTF to be published Trondheim 2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF Prepare for FDAM 2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07 FDAM ITTF FDAM by 04/11/02 Redmond 2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) N6845 04/10 Palma COR ITTF to be published 2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/12 4 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/12 4 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/11 4 1 ISO/IEC 14496-1/Cor.1 Published 2001/11 4 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/11 4 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/10 4 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 COR ITTF 4 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 COR ITTF 4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07 COR ITTF Redmond 4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 AMD ITTF 4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) Published 2004-05 4 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/12 4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10 Published 2004-08 Brisbanne
55 4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published 4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10 IS ITTF to be published Shanghai 4 6 ISO/IEC 14496-6:2000 Published 2000/12 4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-05 4 11 ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) N6203 03/12 Hawaii COR SC29 4 11 ISO/IEC 14496-11 (MPEG-4 Scene N5279 02/10 FDIS SC29 Final Text Editing Description) Shanghai 4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji FDAM Editor Integration in 1st Ed. 4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM Editor Integration in 1st Ed. 4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related N6594 04/07 COR Editor Integration in 1st Ed. correction Redmond 4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 04/07 FDAM Editor Integration in 1st Ed. Redmond 4 12 ISO/IEC 14496-12 (ISO Base Media File N5295 02/10 Published 2004-02 Format) Shanghai 4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 FDAM ITTF FDAM 04/11/30 Redmond 4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 IS ITTF to be published Shanghai 4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Published 2003-11 Shanghai 4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Published 2004-04 Trondheim 4 18 ISO/IEC 14496-18 (Font Compression and N6215 03/12 Hawaii Published 2004-07 Streaming) 4 19 ISO/IEC 14496-19 (Synthesized Texture N6217 03/12 Hawaii Published 2004-07 Stream) 7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/07 7 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/28 7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR Editor 7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N 01/07 Sydney Published 2002/02 4 2
56 8 8
57 Resolutions of Systems
Cf. WG11 resolution.
List of reviewed contribution
N° Title Authors 11177 Initial Reference Software for LASeR and SAF Jean-Claude Dufourd 11183 Proposed Text - Open Font Format Specifications (OFFS) - Mike Ksar Single Document - based on OpenType(R) v1.4 11190 MPEG-7 BiM for Unidirectional Networks Joerg Heuer et al. 11192 MPEG Multimedia Middleware Requirements v.2.0 Jean H.A. Gelissen 11192 MPEG Multimedia Middleware Requirements v.2.0 Jean H.A. Gelissen 11198 CE Study of LASeR and SAF CD Jean-Claude Dufourd 11204 MPEG-J for real case applications: design of a minimal and Son Tran et al. universal primitive class 11207 MPEG-4 Player3D @ work: demonstration of a weather Marius Preda et al. forecast application 11233 Core experiment report for Fast Random Access into MPEG7 Ray Taylor BiM streams 11255 Preliminary comments on Text of ISO/IEC 21000-9 FCD Thomas DeMartini et al. (MPEG-21 File Format) 11256 Preliminary Comments on ISO/IEC 21000-16 CD (Binary Thomas DeMartini et al. Format) 11260 Proposed URI scheme for mp4 file format Yongju Cho et al. 11265 LASER adaptive to time varying resources Kyung Mo Park et al. 11287 A Proposal to Improve Compression Efficiency of LASeR Jihun Cha et al. Binary Representation 11289 Requirements for Streaming Digital Items Ian Burnett 11290 Classification of MPEG MIME types Myriam Amielh et al. 11325 Using MPEG-21 Part 16 in Applications Robbie De Sutter et al. 11330 Mobile requirements for lightweight scene representation Philippe Lucas et al. 11330 Mobile requirements for lightweight scene representation Philippe Lucas et al. 11332 Results of the Core Experiment on Laser Binarization Cédric Thiénot et al. 11335 study of ISO/IEC 21000-16 CD Claude Seyrat 11337 Requirements for Laser Binarization Claude Seyrat 11337 Requirements for Laser Binarization Claude Seyrat 11345 MPEG-21 binarisation status with MPEG-7 BiM reference Gregoire Pau et al. software 11356 Report of work on the CE on Harmonization with SVG Jean-Claude Dufourd 11357 Report of work on the CE on LASeR Binary Representation Jean-Claude Dufourd 11361 LASeR/SAF reference software: codec aligned with study Jean-Claude Dufourd 11374 Implementation of LASeR (and of SVG) in the GPAC project Cyril Concolato 11375 Analysis of the study of CD of LASeR Cyril Concolato 11376 Results of the Core Experiment on Laser Binarization Andreas Hutter et al 11396 CE report on systems extension (Siemens Index) Andrea Kofler-Vogt et al. 11419 MAF Photo Repository and Player Wo Chang 11421 LASeR web site and logo Jean-Claude Dufourd et al. 11422 Supporting the storage of MPEG-21: Part 13 Scalable Video Mohammed Zubair et al. by an extension of the ISO Base Media File Format 11425 Extending the AVC File Format (14496-15) to support FRExt Mohammed Zubair et al. 11448 Summary of Voting on ISO/IEC CD 14496-20 SC 29 Secretariat 11449 Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3 SC 29 Secretariat 11451 Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1 SC 29 Secretariat 11456 Summary of Voting on ISO/IEC CD 21000-16 SC 29 Secretariat
59 Annex 7 Report of MDS meeting
Source: Ian S Burnett, PhD, Chair MDS Subgroup
1. General Information about MDS at the 70th MPEG meeting in Palma The MDS subgroup commenced with the following summarey, kick-off:
. Overview of MDS activities: • Work items for MDS are only MPEG-21 related • Goals of the week . MDS schedule (m11466 on NIST site): • Joint meetings • Breakout groups • Continuously updated, check version number . Questions
Since there were no explicit MPEG-7 activities excepting some involvement in joint Profiles activities – see Requirements report, the workplan included:
MPEG-21: • DID 2nd Ed (FCD) • REL (“Profiles”) • RDD (COR/1) • DIA AMD/1 (PDAM, COR/1 WD) • DIP (FCD) • Ref SW (FCD) • Conformance (CD) • Event Reporting (WD) • IPMP (WD)
A further area of work was URI Fragment Identifiers for MPEG media types.
In further detail, the MPEG-21 activities were:
. MPEG-21 Digital Item Declaration (Part 2): • Review proposals on IPMP reqts, Prelim. NB Comments on FCD • Output: MPEG-21 DID 2nd Ed à Study of FCD
. MPEG-21 Rights Data Dictionary • Output: MPEG-21 RDD COR/1 à WD (no action taken in Palma due to personal difficulties of a participant)
. MPEG-21 Digital Item Adaptation (Part 7): • Output: MPEG-21 DIA AMD/1 à at PDAM – Study generated
60 . MPEG-21 Reference SW (Part 8): • Review SW contributions, NB Comments • Output: MPEG-21 Ref. SW à Study on FCD • . MPEG-21 Digital Item Processing (Part 10): • Review AHG report, Test results, NB Comments • Output: MPEG-21 DIP à FCD
. MPEG-21 Conformance (Part 14): • REL Profile for conformance work – based on mobile/OMA • Output: MPEG-21 Conformance à WD continuing (see Integration report)
. MPEG-21 Event Reporting (Part 15): • Review CE & AHG results • Output: MPEG-21 Event Reporting à CD
A further activity was undertaken on URI Fragment Indentifiers:
Fragment Identification for MPEG Media Types using a URI Fragment scheme based on MIME Types. A full featured media pointer mechanism for URI access to fragments of MPEG media files.
Outputs: WD from the meeting and a new part (17) of MPEG-21 requested.
2. Notes on discussions on Input Documents
The MDS subgroup formed two permanent Break Out Groups:
IPMP (Chair: Simon Watt) and Event Reporting (Chair: FX Nuttall)
These two break out groups met throughout the week in preassigned rooms. Other, informal, Break Out Groups were formed during the week for the purposes of:
DIA Ammendment and Core Experiment discussions DID 2nd edition editing and preliminary DoC work DIP FCD – continuing work on DoC of NB comments and completing the FCD REL – discussion of the referenec software. Fragment Identifiers – preparation of the WD.
The MDS group considered all input documents, or summaries (agreed with the contributors) of the contributions and their treatment from the Break out groups.
An object oriented approach for the DIBO Frederik De Keukelaere,Thomas DeMartini,Jeroen Bekaert,Rik Van 11338 de Walle, APIs
Input: Discussed in AHG/BoG.Proposes an object oriented API for DIBOs in DIP. 61 API now fixed for all issues that were raised in discussions. The OO DOM API simplifies the current DIBO API and makes it much clearer.
Actions: Updated input software based on discussions – MDS is happy that software meets change object criteria Adopt OO API based on BNB comments. Proposal for DOM API to be adopted ‘by value’ but we need dicussions with FNB to see if meets NB comments. Informative text to be created for FCD about tracking mechanism and usage for Rights processing.
11339 Saar De Zutter,Frederik De Keukelaere,Rik Van de Walle, Proposal for DIP bootstrapping
Input: Proposal to include bootstrapping for DIs – using e.g. a Main DIBO
Actions: Produce text based on input (addresses FNB comments) Further discuss proposed mechanism for bootstrapping Main DIBO or Entry point for DIBOs Consider calling methods from methods – RunDIM DIBO proposed – text will be introduced to FCD. Entry point might allow launch of e.g a WWW page on DI loading. FNB to be consulted on possible solutions.
DIP discussions – new text to be created by various MPEG members. Monday pm – reviewed text on Profile signalling.
Tuesday
11212 Shane Lauf,Gerrard Drury,Ian Burnett, Proposed extensible DIDL schema
Input: Proposal from IPMP AHG to create a schema mechanism to have a ‘protected’ IPMP DID and be able to drop the unprotected DI into a ‘locked box’ in IPMP_DIDL. Proposal introduces alternate views of the DID model – IPMP now instead of just the DIDL as a starting point.
Actions Question of style – separate Model schema or combine DIDL+Model. Some regard that it would be better to minimise number of namespaces and files. Details to be discussed during the week.
11213 Shane Lauf,Ian Burnett, Proposed IPMP DIDL schema
Input: Introduces proposed structure of IPMP DID elements and schema.
Actions IPMP BoG using this during discussions and growing into the CD text
Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Preliminary Comments on ISO/IEC 21000-2 2nd Edition Schirling,Anthony Vetro,Xin 11252 Wang, FCD (Digital Item Declaration)
62 Input: Comments being addressed in Study of FCD
Actions FCD changes recommended.
11351 Watt, UKNB Comments on ISO/IEC FCD 21000-2 : Digital Item Declaration
Input: Comment on the importance of the IPMP_DIDL work and that it needs to be considered by the DID activity. In particular bearing in mind the FCD of DID 2nd edition.
Actions Text to be created incorporating changes for the Study of FCD.
Preliminary BNB comments on 11355 BNB, ISO/IEC 21000-2 2nd edition FCD
Input: Comments on FCD being addressed in Study of FCD
Actions FCD changes recommended.
Preliminary comments of DID v.2 11430 Myriam Amielh,Gerrard Drury ,Shane Lauf ,Ian Burnett, FCD
Input: Comments on FCD being addressed in Study of FCD.
Actions FCD changes recommended. 7.2, 7.4 discussed in more detail
Editors' Input towards CD of 11193 Niels Rump for the editors, 21000-15 Proposed Changes to MPEG-21 11296 Kyunghee Ji,Youngjoo Song,Nammee Moon,Jaegon Kim, Event Reporting WD v.2.0 Proposed Common Event 11315 Senator Jeong,Yeon-Jeong Jeong,Weon-Geun Oh,Ki-Song Yoon, Descriptor and DataType
Input: Comments on WD of ER
Actions 11193: Significant issues taken from this input document. Structure of CD remains the same: 3 parts: ER Description, Event Conditions, ER Structure. 11315: Incorporated but not presented – noone present in Palma. Connection with DIA to be explored Connection with RDD to be explored Identification of Users: REL Principle ID approach
11249 Chris Barlas ,Niels Rump, MPEG-21 - 63 Comatose or Just Sleeping?
MAF Photo Repository and 11419 Wo Chang, Player Suggestion to create MPEG-A Part 4 – MPEG-21 Content 11288 Ian Burnett, Format (MCF) Requirements for Streaming Digital 11289 Ian Burnett, Items
Input: Inputs on Future directions of MPEG-21 and MAF. Dealt with fully in Reqts report.
Actions See Reqts report.
Usage scenarios for composition of motion picture and study of constraint description model for 11440 Satoshi Ito,Toru Kambayashi, digital rights
Input: Four usage scenarios for Rights in Motion Pictures and missing elements in MPEG-21. Various scenarios for video delivery in Motion Picture industry. Suggests that there are some ‘lacking’ areas in REL functionality. Three solution approaches – Di structure/SMIL solutions but the best is to add extension of right – ‘playwithconstraint’ to REL.
Actions Similarity to inputs from the REL development phase.
Software implementation of a light- weight REL based DRM system for 11270 Teemu Saarinen,Artur Lugmayr, video streaming to mobile devices
Input: Simple implementation of light-weight REL system on mobile. Includes example license and explanation of the lightweight REL. Walkthrough of the application is provided. Propose solution as reference software.
Actions Possibly utility software. Going to get a demo later this week. Update REL s/w plan and propose for utility module for part 8 (insert in study) We will need NB comments to support its inclusion. Part of discussion for MAF part 4.
Data Types and Methods for Implementing MPEG-21 REL 11211 Thomas DeMartini,Vincent Tieu,Xin Wang, Interpretation Reference Software
Input: Datatypes and methods to achieve mapping from input to output for REL Interpretation Reference software. 64 Actions: Substantial work. We now believe that the way forward should be to take this to conclusion in April. Conformance will be in a constrained subset – perhaps suitable for the MAF 4.
Mobile MPEG-21 Peer 11189 Shane Lauf,Ian Burnett, Implementation
Input:
A demonstration of a complete MPEG-21 browser that includes IPMP etc. Operates on a mobile phone and the Sun WTK.
Actions: DID Parser to be reference s/w (including IPMP_DIDL parser).
IPMP_Scheme Description for 11178 Zhongyang Huang,Ming Ji,Shengmei Shen,Taka Senoh,Takafumi Ueno, MPEG-21 IPMP Examination of technology in IPMP 11179 Shane Lauf, WD 1.0 Notes from the Mountain View 11184 on behalf of the MPEG-21 IPMP AdHoc group., MPEG-21 IPMP AdHoc Meeting
11221 Eva Rodriguez,Huang Zhongyang, IPMP Information Schema IPMPTransfer Description for MPEG- 11271 J. J. Chae,Jeho Nam,Jae-Gon Kim, 21 IPMP An improved IPMP tool schema for 11348 Hendry,Jeongyeon Lim,Qonita M. Shahab,Kyung-Ae Cha,Munchurl Kim,Keunsoo Park, Resource Protection An improvement to the MPEG-21 11349 Hendry ,Munchurl Kim ,Keunsoo Park, IPMP Info Schema
Inputs
11178-11184 – Mountain View AHG inputs and dealt with there
11221 11349 : These were considered and in discauusions two schemas were created to cover these spaces.
11271 11348: Not yet addressed – will be addressed Wednesday .
Actions Discussions continued during the IPMP BoG which met independently throughout the week.
Report of CE on Conversion Christian Timmerer,Klaus Leopold,Dietmar Jannach,Hermann Hellwagner,Mariam 11262 Kimiaei, Parameters
Input
Existing technologies – WSDL, SWRL, OWL-S evaluated. OWL-S descriptions can be included in PDAM.
Actions
65 DIA discussions with RDD – semantics New/continued CE using OWL-S 1.1 and WSDL syntatical description of parameters
Report of CE on Bit-Stream Adaptation in Constrained and Gabriel Panis,Christian Timmerer,Joerg Heuer,Debargha Mukherjee,Michael 11405 Ransburg,Ingo Wolf,Andreas Hutter,Hermann Hellwagner, Streaming Environments
Input
Detailed CE report. Design for Process Unit Architecture described. Transmmission of adaptation related metadata and media data discussed gBSD Transformation-Bitstream adpatation – 2 approaches examined and filesizes / processing times examined.
Actions:
Continue CE with strong focus on combined meta and media data processing. Aiming at inclusion in current ammendment.
Preliminary Comments on ISO/IEC 21000-7 PDAM1 (Digital Item Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Schirling,Anthony Vetro,Xin 11253 Wang, Adaptation)
Input
Preliminary NB comments. Conflicts on tools placements. Various editorial comments
Actions:
Discussions and incorporation into the Study document.
Comments on ISO/IEC 21000-7 11371 Christian Timmerer,Joerg Heuer,Gabriel Panis,Hermann Hellwagner,Andreas Hutter, COR/1 WD v.1
Input
Proposal to correct bs1:length in DIA COR/1 WD but there is actually no error.
Actions:
Probably withdraw WD – wait for full consultation. AHG mandate.
Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Kim,Hae-Kwang Kim,Seungji 11218 Yang,Truong Cong Thang,Yong Man Ro, N & AA.
Input
MPEG-21 DIA utility s/w on www.titr.uow.edu.au/mpeg/
Actions:
Update DIA software modules document and update reference software site (software uploaded). NB comments will be required to promote update to the FDIS
66 Joint with Reqts
MPEG 21 as a secure 11220 FX Nuttall, interoperable DRM ?
Input
Points out that it is currently one player=one DRM in general. Asks if MPEG-21 could address DRM interoperability.
Discussion related to the scope of MPEG-21 IPMP. Full DRM or allow interoperability with a full DRM solution? What exactly does the industry need in terms of DRMs? Commercial input will dictate some of the DRM interoperability – but MPEG needs to provide the technical means. MPEG-21 should provide the framework to allow DRM interoperability when the industry getsto the point of needing that functionality. MPEG-21 will not create a complete DRM – just will have the containers in MPEG-21. Need to get into some of those issues or decide not to – we should consider the scope again. Could we have a MAF and inform IPMP from an MAF. In considering the scope we should work on what is ‘out of scope’. Must be commercially motivated - consumer wants to be able to buy ‘a device’ and then play ‘any content’. We need tools that will make the industry succesful in achieving these goals. Interoperability is the key word but the meaning is hard to define – if we define clearly the scope of IPMP we define interoperability for all MPEG-21. Should consider interworking as well as interoperability – a diversity of solutions but you can go from A to B to C and everything talks …. May need to specify the interworking glue.
Dichotomy in IPMP emphasised – one group an interoperable DRM, one group facilitating communication between different DRM systems.
Actions: Review scope of IPMP – what is out of scope, in particular. MAF to inform the IPMP – specify what it will be about and what it is not..
The reference conformance test 11276 SuSan Im,SangHoon Oh,SeokHoon Kim,Spencer Cheng, model(based on Mpeg-21 dii&didl)
Input:
Proposes a way of conformance testing MPEG-21.
Actions:
To be discussed further at Integration/MDS joint mtg.
Joint with Systems
Application Specific Binary Coding 11274 Itaru Kaneko ,Nobuyuki Kinoshita ,Spencer Cheng, (ASBC) of MPEG-21 descriptors Input: ASBC-Application Specific Binary Coding – proposal for binary coding of MPEG-21 descriptors. Additional tool to increase performance on binarisation.
Discussion: Concern that the XSLT in evry decoder would be too complex.
67 Actions: Core Experiment with MPEG-21 binarisation
11291 Myriam Amielh,Ernest Wan, A Framework for MPEG URI fragment Identifiers
Input: Ongoing work on URI addressing schemes for MPEG MIME types.
Actions: Obviously a need for Fragment Identifiers across MPEG AHG working on it Standard part for specific technologies – possible options – new std or MPEG-21 WD for end of the week
Joint meeting with Integration
MPEG-21 Ref. SW & Conformance (16h30 - 17h30) with Integration - TBD Marte (MDS Room) Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Preliminary Comments on ISO/IEC FCD 21000-8 Schirling,Anthony Vetro,Xin 11254 Wang, (Reference Software)
11261 Shane Lauf,Ian Burnett, IPMP DIDL Reference Software Contribution Frederik De Keukelaere,Rik Van 11336 de Walle, Contribution to DID conformance
Data Types and Methods for Implementing Thomas DeMartini,Vincent 11211 Tieu,Xin Wang, MPEG-21 REL Interpretation Reference Software Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Kim,Hae-Kwang Kim,Seungji Progress of MPEG-21 DIA Utility Software Yang,Truong Cong Thang,Yong 11218 Man Ro, Modules C, D, F, G, L, M, N & AA. SuSan Im,SangHoon The reference conformance test model(based on Oh,SeokHoon Kim,Spencer 11276 Cheng, Mpeg-21 dii&didl)
See Integration report for full details of these documents and treatment.
Resolution from MDS that proponents make an NB comment on inclusion
11276: Using such tools would allow us to test the coverage of our reference software. We should have this as a methodology under consideration.
Thursday
11271 J. J. Chae,Jeho Nam,Jae-Gon Kim, IPMPTransfer Description for MPEG-21 IPMP
Proposal that this should be extended to messaging in the full MPEG-21 scope. However, the problem seems to be that there are other envelope mechanisms – e.g. SOAP. Is this related to MPEG-4 IPMPx in terms of the architecture?
Consensus that we might possibly standardise messages – but which messages?
Resolution from MDS noting that messages may be required in the broader MPEG-21 standard parts and that we invite MPEG members to consider bringing inputs related to suggested 68 requirements for messages to the 71st meeting. At that meeting requirements for messages in MPEG-21 will be discussed.
3. Summary of Outcomes on Part basis
The following outcomes were generated at the meeting:
MPEG-21 Digital Item Declaration (Part 2): Reviewed proposal on split DID schema from IPMP Several improvements from NBs for DID 2nd Edition Output: MPEG-21 DID 2nd Edition Study of FCD Preliminary treatment of advance NB comments
MPEG-21 IPMP Components (Part 4) (Title changed to reflect the work) Substantial work to create a stable and mature IPMP Components CD, consisting of IPMP DIDL IPMP INFO Schemas (2) Initial discussions on areas not covered at this stage Output: MPEG-21 IPMP ComponentsCD TuC for MPEG-21 IPMP
MPEG-21 Digital Item Adaptation (Part 7): Reviewed CE results on Conversion Parameters New CE focusing on using OWL-S 1.1 and WSDL syntactical description of parameters Reviewed CE results on Bit-Stream Adaptation in Constrained and Streaming Environments Continue CE with strong focus on combined meta and media data processing.
Output: MPEG-21 DIA Study of PDAM 1, New CEs
MPEG-21 Reference SW (Part 8): Reviewed contributions for MPEG-21 Reference SW Major contribution on complete REL Ref. SW Substantial integrated DIA s/w including a DIA adaptation engine (utility s/w), many modules updated Output: Study on MPEG-21 Ref. SW CD & SW Implementation Plans
MPEG-21 Digital Item Processing (Part 10): Completed FCD – addressing all 151 NB comments Resolved issues on Rights and Base Operations Significant informative annexes and text added A number of complete informative examples added Harmonisation between DIMs and J-DIXOs OO API Adopted – broadened appeal by using DOM
Output: 69 DoC for DIP CD MPEG-21 DIP FCD Reference software workplan
MPEG-21 Event Reporting (Part 15): Completed the CD of the MPEG-21 ER Significant editing work and integration with other MPEG-21 parts was succesfully completed.
Output: MPEG-21 Event Reporting CD
MPEG-21 Fragment Identifiers for MPEG Media Types (Part 17): New part of MPEG-21 requested Significant new WD created based on inputs at this and previous meetings.
Output: MPEG-21 Part 17 WD Request for new part 17 of MPEG-21
4. Output Documents and Resolutions from the MDS Subgroup
14.1 Multimedia Description Schemes group
14.1.1 The Multimedia Description Schemes subgroup recommends approval of the following documents
MPEG-7
None
MPEG-21
No. Title TBP Available 21000-2 MPEG-21 Digital Item Declaration 6770 Study of ISO/IEC FCD 21000-2 DID 2nd edition N 04/11/14 Study of Preliminary Comments on ISO/IEC FCD 21000-2 DID 2nd N 04/10/22 6771 edition
No. Title TBP Available 21000-3 MPEG-21 Digital Item Identification
No. Title TBP Available 21000-4 MPEG-21 IPMP Components 6772 ISO/IEC CD 21000-4 MPEG-21 IPMP Components Y 04/12/07 6773 TuC for 21000-4 MPEG-21 IPMP Components N 04/10/22
No. Title TBP Available 21000-5 MPEG-21 Rights Expression Language 70 6774 Workplan for MPEG-21 REL/RDD Reference Software v.8 N 04/10/22
No. Title TBP Available 21000-6 MPEG-21 Rights Data Dictionary
No. Title TBP Available 21000-7 MPEG-21 Digital Item Adaptation Study of preliminary comments on MPEG-21 DIA ISO/IEC 21000-7 N 04/10/22 6775 PDAM-1 6776 Study of text of MPEG-21 DIA ISO/IEC 21000-7 PDAM-1 N 04/11/24 6777 Workplan for Core Experiment on DIA Conversions N 04/10/22 Workplan for Core Experiment on Bit-Stream Adaptation in N 04/10/22 6778 Constrained and Streaming Environments 6779 MPEG-21 DIA Software Implementation Plan v.9 N 04/10/22
No. Title TBP Available 21000-8 MPEG-21 Reference Software
No. Title TBP Available 21000-10 MPEG-21 Digital Item Processing 6780 ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing Y 04/11/30 DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item N 04/10/22 6781 Processing 6782 MPEG-21 DIP Software Implementation Plan v.4 N 04/10/22
No. Title TBP Available 21000-15 MPEG-21 Event reporting 6783 ISO/IEC CD 21000-15 MPEG-21 Event Reporting Y 04/12/07
No. Title TBP Available 21000-17 Fragment Identification for MPEG Media Types 6784 WD 1.0 of ISO/IEC 21000-17 Fragment ID for MPEG Media Types N 04/11/14 Request for sub-division of ISO/IEC 21000: Part 17 Fragment 6823 Identification for MPEG Media Types
MPEG-21 related resolutions:
Part 4 Intellectual Property Management and Protection Components
14.1.2 a) The Multimedia Description Schemes subgroup requests that the name of ISO/IEC 21000-4 be changed to Intellectual Property Management and Protection Components.
14.1.3 b) The Multimedia Description Schemes subgroup notes that ‘messages’ may be required in the broader context of MPEG-21, rather than being a sole requirement of part 4. Thus, MPEG members are invited to submit suggested requirements on MPEG-21 messaging to the 71st meeting. At that meeting requirements for messages will be considered by the Requirements subgroup.
71 Part 10 Digital Item Processing
14.1.4 a) The Multimedia Description Schemes subgroup reminds members that new submissions to the Digital Item Processing Reference software, conformant to the FCD, are now required.
14.1.5 b) The Multimedia Description Schemes would like to thank the National Bodies of Australia, Austria, Belgium, France, Japan, republic of Korea, Singapore and US for their detailed comments on MPEG-21 Digital Item Processing CD and their assistance during the FCD editing activities.
Part 15 Event Reporting
14.1.6 a) The Multimedia Description Schemes subgroup reminds proponents of Event Reporting tools that integrated reference software implementations must be provided and that core experiments must be successfully completed in order for promotion of the tools.
Ad Hoc groups:
14.1.7 The Multimedia Description Schemes group recommends establishing the following Ad Hoc groups: No. Title Mtg 6785 AHG on MPEG-21 DIP& DID 2nd Edition Y 6786 AHG on MPEG-21 Event Reporting Y 6787 AHG on MPEG-21 DIA Y 6788 AHG on MPEG URI Fragment IDs Y
5. Ad-Hoc Groups From MDS at the 70th MPEG meeting
N6785 14.1.8 AHG on MPEG-21 DIP & DID 2nd Edition Mandates 1. Carry out editing of DIP FCD according to disposition of NB comments on CD. 2. Carry out editing of Study of DID FCD. 3. Encourage contributions on improving MPEG-21 DIP FCD. 4. Carry out further study of preliminary comments and encourage further comments on DID FCD. 5. Monitor implementation of the DIP software implementation plan. Chairman Gerrard Drury (gerrardx@xenikos.com) Co Chair Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be) Duration Until the 71st Meeting Meetings AhG Meeting to be held on the Sunday prior to 71st meeting. Other business to be conducted by email or phone. Reflector mpeg-21-dipx@xuow.edu.au Subscribe See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dip
N6786 14.1.9 AhG on MPEG-21 Event Reporting Mandate: 1. Continue developing the reference software, as to comply with CD 2. Produce CD 1.0 during editing period 72 Chairs: FX Nuttall (fx at nuttall.org) Andrew Tokmakoff (tokmakoff at telin.nl) Duration: Until the 70th Meeting Meetings: A pre- meeting will be held on the weekend before the Hong Kong meeting. Other business will be conducted by E-mail or telephone conference. Reflector: mpeg-21-event-reporting@lists.telin.nl Subscribe: See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-reporting
N6787 14.1.10 AHG on MPEG-21 DIA Mandate: 1. Carry out Core Experiments on DIA and make recommendations to modify and improve the MPEG-21 DIA AMD/1. 2. Produce the Study of PDAM/1 by 2004/11/24. 3. Produce an editors' input on Study of PDAM/1. 4. Investigate possible issues in the existing MPEG-21 DIA specification. 5. Follow and maintain the MDS DIA reference software implementation document, including tracking of the proposed deliveries of software to the Reference Software Web site. Chairs Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at) Thomas DeMartini (Thomas.DeMartini_at_CONTENTGUARD.COM) Duration: Until the 71th Meeting. Meetings: AHG Meeting to be held on the weekend prior to 71th meeting. Other business will be conducted by e-mail or telephone conference. Reflector: mpeg21-uma_at_merl.com Subscribe: To subscribe send email to avetro_at_merl.com (Anthony Vetro).
NXXXX 14.1.11 AHG on MPEG-21 URI Fragment IDs Mandates 1. Explore solutions for addressing fragments of ISO-based files 2. Investigate addressing of fragments of vector graphic images. 3. Improve WD for 21000-17 4. Provide Reference Software for mp( ) Chair Myriam Amielh (myriam.amielh@cisra.canon.com.au) Co Chairs Gerrard Drury (gerrard@enikos.com) YongJu Cho (yongjucho@etri.re.kr) Duration Until the 71th Meeting Meetings Pre-meeting to be held in Hong-Kong prior to 71th meeting Reflector mpeg-21-list@imec.be Please use the prefix [medialoc] Subscribe Send email to owner-mpeg-21-list@imec.be
15 MDS Schedule for the 70th MPEG meeting in Palma de Mallorca, ES
MPEG MDS Chair: Ian S Burnett MPEG-21 v.1.0 Number Source Title
73 Monday Morning (9h00-13h00) MPEG Plenary Plenary room
Monday Afternoon (14h00-20h00)
Kick-off of MPEG MDS activities (14h00- 14h30) Marte (MDS Room) Agenda, Goals and Issues for the week for MDS Group Ian S Burnett
Review of AHG resolutions, CE results and action points (14h30-16h00) Marte (MDS Room)
11165 Simon Watt, AHG on MPEG-21 IPMP Myriam Amielh,Gerrard 11164 Drury,YongJu Cho, AHG on MPEG 21 Media Locators Christian Timmerer,Thomas 11166 DeMartini, AHG on MPEG-21 DIA Gerrard Drury,Frederik De 11167 Keukaleare ,Munchurl Kim, AHG on MPEG-21 DIP
11168 FX Nuttall,Andrew Tokmakoff, AHG on MPEG-21 Event Reporting
Define BoGs and Mandates (16h00- 16h30) Marte (MDS Room) REL, RDD, DID, DIA, DIP, ER, BOG Room = Marte (IPMP), ER IPMP Saturno
MPEG-21 DIP (16h30 - 17h30) Marte (MDS Room) An object oriented approach for the DIBO Frederik De Keukelaere,Thomas DeMartini,Jeroen 11338 Bekaert,Rik Van de Walle, APIs Saar De Zutter,Frederik De Keukelaere,Rik Van de 11339 Walle, Proposal for DIP bootstrapping
Tuesday Morning (09h00-13h30) MPEG-21 IPMP & ER BoG (09h00- 19h00) Jupiter & Saturn
MPEG-21 DID Comments (09h00 - DID Comments/Inputs (09h00 10h00) - 09h45) Marte (MDS Room)
11212 Shane Lauf,Gerrard Drury,Ian Burnett, Proposed extensible DIDL schema Preliminary Comments on ISO/IEC 21000- 2 2nd Edition FCD (Digital Item Thomas DeMartini,Marco Hurtado,Martha 11252 Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang, Declaration)
74 UKNB Comments on ISO/IEC FCD 21000- 11351 Watt, 2 : Digital Item Declaration Preliminary BNB comments on ISO/IEC 11355 BNB, 21000-2 2nd edition FCD Myriam Amielh,Gerrard Drury ,Shane Lauf ,Ian 11430 Burnett, Preliminary comments of DID v.2 FCD
11213 Shane Lauf,Ian Burnett, Proposed IPMP DIDL schema
MPEG-21 DID Media Locators (10h00 - DID Media Locators (10h00 - 10h15) 10h15) Marte (MDS Room) A Framework for MPEG URI fragment 11291 Myriam Amielh,Ernest Wan, Identifiers
MPEG-21 RDD (12h00 - 12h30) ER (10h15 - 10h45) Marte (MDS Room) 11193 Niels Rump for the editors, Editors' Input towards CD of 21000-15 Proposed Changes to MPEG-21 Event Kyunghee Ji,Youngjoo Song,Nammee Moon,Jaegon 11296 Kim, Reporting WD v.2.0 Proposed Common Event Descriptor and Senator Jeong,Yeon-Jeong Jeong,Weon-Geun Oh,Ki- 11315 Song Yoon, DataType
MPEG-21 with Reqts (10h45 - 11h30) Neptune (Reqts Room)
11249 Chris Barlas ,Niels Rump, MPEG-21 - Comatose or Just Sleeping?
MPEG-21 with Reqts/Audio etc(11h30 - 13h00) Neptune (Reqts Room) 11419 Wo Chang, MAF Photo Repository and Player Suggestion to create MPEG-A Part 4 – 11288 Ian Burnett, MPEG-21 Content Format (MCF) 11289 Ian Burnett, Requirements for Streaming Digital Items Tuesday Afternoon (14h30-18h30)
MPEG-21 REL s/w & s/w Inputs(14h30- 15h30) Marte (MDS Room) Usage scenarios for composition of motion picture and study of constraint description 11440 Satoshi Ito,Toru Kambayashi, model for digital rights Software implementation of a light-weight REL based DRM system for video 11270 Teemu Saarinen,Artur Lugmayr, streaming to mobile devices Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference 11211 Thomas DeMartini,Vincent Tieu,Xin Wang, Software
11189 Shane Lauf,Ian Burnett, Mobile MPEG-21 Peer Implementation
MPEG-21 IPMP Inputs Marte (MDS Room)
75 (15h30- 17h00) IPMP_Scheme Description for MPEG-21 Zhongyang Huang,Ming Ji,Shengmei Shen,Taka 11178 Senoh,Takafumi Ueno, IPMP Examination of technology in IPMP WD 11179 Shane Lauf, 1.0 Notes from the Mountain View MPEG-21 11184 on behalf of the MPEG-21 IPMP AdHoc group., IPMP AdHoc Meeting
11221 Eva Rodriguez,Huang Zhongyang, IPMP Information Schema IPMPTransfer Description for MPEG-21 11271 J. J. Chae,Jeho Nam,Jae-Gon Kim, IPMP An improved IPMP tool schema for Hendry,Jeongyeon Lim,Qonita M. Shahab,Kyung-Ae 11348 Cha,Munchurl Kim,Keunsoo Park, Resource Protection An improvement to the MPEG-21 IPMP 11349 Hendry ,Munchurl Kim ,Keunsoo Park, Info Schema
MPEG-21 DIA Inputs(17h00- 18h00) Marte (MDS Room) Preliminary Comments on ISO/IEC 21000- Thomas DeMartini,Marco Hurtado,Martha 11253 Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang, 7 PDAM1 (Digital Item Adaptation) Christian Timmerer,Klaus Leopold,Dietmar 11262 Jannach,Hermann Hellwagner,Mariam Kimiaei, Report of CE on Conversion Parameters Comments on ISO/IEC 21000-7 COR/1 Christian Timmerer,Joerg Heuer,Gabriel 11371 Panis,Hermann Hellwagner,Andreas Hutter, WD v.1 Gabriel Panis,Christian Timmerer,Joerg Report of CE on Bit-Stream Adaptation in Heuer,Debargha Mukherjee,Michael Ransburg,Ingo 11405 Wolf,Andreas Hutter,Hermann Hellwagner, Constrained and Streaming Environments Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Progress of MPEG-21 DIA Utility Software Kim,Hae-Kwang Kim,Seungji Yang,Truong Cong 11218 Thang,Yong Man Ro, Modules C, D, F, G, L, M, N & AA.
MPEG Social Event (19h30 - midnight)
Wednesday Morning (09h00-13h30)
MPEG Plenary (9h00- 11h00) Plenary room
MPEG-21 IPMP & ER BoG (11h00- 18h00) Jupiter & Saturn MPEG-21 Reqts Joint (11h30 - 12h30) Marte (MDS Room) MPEG 21 as a secure interoperable 11220 FX Nuttall, DRM ? The reference conformance test SuSan Im,SangHoon Oh,SeokHoon Kim,Spencer 11276 Cheng, model(based on Mpeg-21 dii&didl) José M. Martínez,Víctor Valdés,Luis Herranz,Jesús A Simple Profile for MPEG-21 DIA Usage 11239 Bescós, Environment description tools Wednesday Afternoon (14h30-19h00)
76 MPEG-21 Systems Joint (14h00 - 14h30) SYSTEMS Application Specific Binary Coding (ASBC) 11274 Itaru Kaneko ,Nobuyuki Kinoshita ,Spencer Cheng, of MPEG-21 descriptors
MPEG-21 MDS PLENARY/DISCUSSIO N (14h30 - 15h30) Marte (MDS Room) MPEG-21 with Reqts (15h30 - 16h30) Neptune (Reqts Room)
11249 Chris Barlas ,Niels Rump, MPEG-21 - Comatose or Just Sleeping? MPEG-21 Ref. SW & Conformance (16h30 - 17h30) with Integration - TBD Marte (MDS Room) Preliminary Comments on ISO/IEC FCD Thomas DeMartini,Marco Hurtado,Martha 11254 Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang, 21000-8 (Reference Software) IPMP DIDL Reference Software 11261 Shane Lauf,Ian Burnett, Contribution
11336 Frederik De Keukelaere,Rik Van de Walle, Contribution to DID conformance Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference 11211 Thomas DeMartini,Vincent Tieu,Xin Wang, Software The reference conformance test SuSan Im,SangHoon Oh,SeokHoon Kim,Spencer 11276 Cheng, model(based on Mpeg-21 dii&didl)
Thursday Morning (09h00-12h30) MPEG-21 IPMP & ER BoG (9h00- 16h00) Jupiter & Saturn MPEG-21 with Reqts/Audio etc(09h00 - 10h00) Neptune (Reqts Room) 11419 Wo Chang, MAF Photo Repository and Player Suggestion to create MPEG-A Part 4 – 11288 Ian Burnett, MPEG-21 Content Format (MCF) 11289 Ian Burnett, Requirements for Streaming Digital Items MPEG-21 DIP Status (10h15 - 11h00) Marte (MDS Room) MPEG-21 DIA Status (11h00 - 11h30) Marte (MDS Room)
MPEG-21 ER Status (11h30 - 12h00) Marte (MDS Room) MPEG-21 with Reqts/Audio etc(12h00 - 13h00) Neptune (Reqts Room)
Thursday Afternoon (14h30-19h00) MPEG-21 REL Status Marte (MDS Room)
77 (14h30 - 15h00) MPEG-21 IPMP Status (15h00 - 16h00) Marte (MDS Room)
Plenary MDS and Reports of BoG (16h00 - 17h00) Marte (MDS Room) Review of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00) Marte (MDS Room)
Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Marte (MDS Room) Approval of resolutions, AHGs and Output documents
Friday Afternoon (14h00-21h00) MPEG Plenary Plenary room Contact: Ian S Burnett
78 Annex 8 Report of Video meeting
Source: Jens-Rainer Ohm, Miroslaw Bober
IDCT in MPEG Standards
Recently, attention was brought to the fact that the ANSI/IEEE 1180 standard (DCT/IDCT implementation accuracy) had been withdrawn in 2003. As MPEG-1 and MPEG-2 Video, as well as MPEG-4 Visual take reference to this standard in terms of the required definition of IDCT precision, it is necessary to define an equivalent text in the framework of MPEG standards. It was therefore decided to request a sub-division of MPEG-1 and define a new part ISO/IEC 11172-6: Specification for Implementation of Inverse Discrete Cosine Transform. The CD was issued at the Palma meeting. (N6707/N6735). In a future meeting (most probably in January), corrigenda on 11172-2, 13818-2 and 14496-2 will be started to change references from ANSI/IEEE 1180 into 11172-6. An AHG was established to resolve the IDCT issue. In addition to the immediate replacement action, it will be explored if a new description of an IDCT (most probably non-normative, but different than what was in IEEE 1180) needs to be developed in addition to the replacement of the IEEE description; and if yes, to establish the requirements towards possibly issuing a call for contributions for the new IDCT description, to be issued at the January meeting, and develop the criteria to evaluate those contributions If such an activity is started, it could later be amended to 11172-6.
Documents reviewed: IDCT Specification: A 11224 Gary Sullivan Problem and Opportunity USNB Contribution: 11225 A. G. Tescher for USNB Replacement of IDCT Standard Peter Schirling, Joan L. Mitchell, Arianne T. 11268 A new way to look at IDCT Hinds, Nenad Rijavec
No. Title TBP Available 11172-6 MPEG-1 Implementation of IDCT 6707 Request for Sub-division of ISO/IEC 11172-6 No 04/10/22 Text of ISO/IEC 11172-6 CD: Specification for No 04/10/22 6735 Implementation of Inverse Discrete Cosine Transform
MPEG-4
New Levels in Visual Simple Profile
The FPDAM on the 'new levels in simple profile' amendment (FPDAM2) to MPEG-4 Visual (N6709 + N6708 DoC) was issued. Minor text modifications were made by request of the US NB. The conformance FPDAM10 was issued as well (N6742 + N6741 DoC). Conformance streams were made available prior to the meeting, and will further be examined by the MPEG-4 Visual maintenance AHG. 79 Documents reviewed: Summary of Voting on 11446 SC 29 Secretariat ISO/IEC 14496- 2:2004/PDAM 2 Summary of Voting on 11447 SC 29 Secretariat ISO/IEC 14496- 4:200X/PDAM 10
New Version of MPEG-4 Visual List of Problems Reported Version 14 of the document "MPEG-4 Visual List of Problems Reported" (N6710) was issued. One problem related to the text part (14496-2:2004) in the area of shape coding was added which was identified during the processing of new streams for the upcoming conformance corrigendum. This also is identified as a new bug in the software which will be fixed in the near future.
Documents reviewed: Yi-Shin Tung, Chung-Neng Wang, Tihao Chiang, MPEG-4 Visual: List of 11327 Jens-Rainer Ohm Problems Reported, v.13.1
Conformance Corrigendum WD2.0
Two Draft Corrigenda on Visual bitstreams conformance were issued, one relating to the second (200X) edition (development status as of Visual version 2), and one relating to amendment 1 of the second edition (Studio and FGS profiles conformance). Many video conformance streams are presently removed by the DCORs, with exact reasons given in the appendix. As it is planned to have the ballot periods only ending after the Hongkong meeting, Study of DCOR documents will probably be issued in January to resolve all issues that will potentially be corrected until then. After approval of the COR (April 2005), profiles which would have lost conformance will be removed from 14496-2. After the corrigendum work will be finished, it is recommended by the Video Subgroup to produce a new edition of the conformance part of MPEG-4. To better maintain conformance and make it better usable, 14496-4 should clearly be structured into sub- parts (Video, Audio etc.) in this future edition.
Documents reviewed: Proposed corrections to Yoshihisa Yamada, Shun-ichi Sekiguchi, Kohtaro 11230 visual part of MPEG-4 Asai conformance text Test Bitstreams for Shape 11394 Herbert Thoma Coding
Software
The Video Subgroup recommends producing a new edition of 14496-5 in the near future. This could include all bug fixes done by the recent activities of the MPEG-4 maintenance AHG. To better maintain the software, 14496-5 should be structured into sub-parts (Video, Audio etc.) in this future edition
AVC
In Palma, a JVT meeting was held in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to corrigendum issues (N6711), as well as conformance and software
80 related to the Fidelity Range Extensions amendment. The video subgroup recommended approval of the JVT-related documents by MPEG.
Output documents related to MPEG-4 Video and AVC
No. Title TBP Available 14496-2 MPEG-4 Visual Disposition of Comments on ISO/IEC 14496-2:2004 No 04/10/22 6708 PDAM2 Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in No 04/10/22 6709 Simple Profile 6710 MPEG-4 Visual: List of Problems Reported version 14.0 Yes 04/10/22 14496-4 MPEG-4 Conformance Text of ISO/IEC 14496-4:200X DCOR1 Visual Bitstreams No 04/11/30 6738 Conformance Corrigendum Text of ISO/IEC 14496-4:200X/Amd.1 DCOR1 Visual No 04/11/30 6739 Bitstreams Conformance Corrigendum Disposition of Comments on ISO/IEC 14496-4:200X No 04/10/22 6741 PDAM10 Text of ISO/IEC 14496-4:200X FPDAM10 Conformance No 04/10/22 6742 Extensions for New Levels of Visual Simple Profile 14496-10 MPEG-4 Advanced Video Coding 6711 Text of ISO/IEC 14496-10:2004/DCOR1 No 04/10/22
MPEG-7
MPEG-7 related work in Redmond
The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.
11188 Akio Yamada Contribution to MPEG-7 Visual Conformance Proposed Corrigendum item on ISO/IEC 15938- 11216 Akio Yamada 3:2002/Amd.1 Soo-Jun Park, Myung Gil CE Report for Situation/View-based Photo Clustering 11280 Jang Experiment (VCE-1, Cross Check) Soo-Jun Park, Myung Gil GT set proposed for situation/view based photo 11281 Jang clustering experiment (VCE-1, Cross Check) Photo EXIF modification report on Ground Truth set Soo-Jun Park, Myung Gil 11282 of Situation/View based photo clustering CE (VCE-1, Jang Cross Check) Soo-Jun Park, Myung Gil GT set proposed for category based photo 11283 Jang classification experiment (Cross Check) Soo-Jun Park, Myung Gil 11284 Dataset of VCE-1 and VCE-2 Jang Soo-Jun Park,Min-Sung Proposal for a new CE: Query-by-ROI (region of 11286 Ryu, Chee Sun Won interest) Soo-Jun Park, Myung Gil CE Report for Image Categorisation into Classes 11293 Jang (VCE-2, Cross Check) 11297 Sang-Kyun Kim, Seungji CE Report for Situation/View-based Photo Clustering Yang, Yong Man Ro, Ji- Experiment (VCE-1) 81 Yeun Kim Sang-Kyun Kim, Seungji GT set proposed for situation/view based photo 11298 Yang, Yong Man Ro, Ji- clustering experiment (VCE-1) Yeun Kim Sang-Kyun Kim, Seungji Photo EXIF modification report on Ground Truth set 11299 Yang, Yong Man Ro, Ji- of Situation/View based photo clustering CE (VCE- Yeun Kim 1) Sang-Kyun Kim, Seungji A proposal of GT set determination where "Time" 11300 Yang, Yong Man Ro, Ji- and "Visual" information conflict for Situation/View Yeun Kim based photo clustering (VCE-1) Sang-Kyun Kim, Seungji CE Report for Category-based Photo Clustering 11301 Yang, Yong Man Ro, Ji- Experiment (VCE-2) Yeun Kim Sang-Kyun Kim, Seungji GT set proposed for category based photo 11302 Yang, Yong Man Ro, Ji- classification experiment (VCE-2) Yeun Kim Sang-Kyun Kim, Seungji CE Report for Face-based Photo Clustering 11303 Yang, Yong Man Ro, Ji- Experiment (VCE-3) Yeun Kim Sang-Kyun Kim, Seungji Photo contribution status for face-based photo 11304 Yang, Yong Man Ro, Ji- clustering experiment (VCE-3) Yeun Kim Sang-Kyun Kim, Sang Software cross-check result of Dominant Color 11305 Hyun Kim Temperature experiment (VCE-4) Akio Yamada, Sang-Kyun 11308 MPEG-7 Visual XM Document version 21.1 Kim Akio Yamada, Sang-Kyun 11309 WD 2.1 of MPEG-7 New Visual Extensions Kim Karol Wnukowicz, Report on Dominant Color Temperature Descriptor 11324 Wladyslaw Skarbek CE (VCE-4) Karol Wnukowicz, Extension of Dominant Color Temperature 11326 Wladyslaw Skarbek Descriptor by Spatial Coherency field Stephan Herrmann, Vasileios Mezaris, Improving the efficiency of a search and retrieval 11342 Haralambos Doulaverakis, system using MPEG-7 Visual descriptors Ioannis Kompatsiaris, Michael G. Strintzis Vasileios Mezaris, Symeon Papadopoulos, Ioannis Preliminary image categorization results using 11344 Kompatsiaris, Michael G. Dominant Color and Edge Direction descriptors Strintzis Robert O'Callaghan, Update of Results in Situation/View-Based 11387 Miroslaw Bober Clustering (VCE-1) Robert O'Callaghan, Proposal on Ground Truth for Situation/View-Based 11388 Miroslaw Bober Clustering (VCE-1) Robert O'Callaghan, Preliminary Results on Image Categorization (VCE- 11390 Miroslaw Bober 2) 11419 Wo Chang MAF Photo Repository 11420 Wo Chang MAF Photo Player Krzysztof Kucharski, Cross verification of the results in Situation/View- 11458 Wladyslaw Skarbek Based Clustering (VCE-1)
82 Work performed: - Core experiments - WD and XM - MAF - test materials collection - collection of ground truth for semantic clustering
Output documents related to MPEG-7 Visual
No. Title TBP Available 15938-3 MPEG-7 Visual 6712 Text of ISO/IEC 15938-3/Amd.1 DCOR1 No 04/10/22 6713 WD 3.0 of MPEG-7 New Visual Extensions No 04/10/22 6714 MPEG-7 Visual XM Document version 22.0 No 04/10/22 6715 Description of Core Experiments for MPEG-7 New Visual No 04/10/22 Extensions
MPEG-21
Scalable Video Coding Development Process
After the decision on the 21000-13 WD had been delayed by the last meeting, the process of SVC standardization has been clarified in detail. The document "Guidelines for the SVC CE Process and Elevation Procedure" (N6718) describes the process CE ® SVM ® WD. To establish a CE, a formal proposal is made which must be approved by the Video group. Verification by 2 independent parties is necessary in the CE, with independent software implementations written from scratch using a specification text. The Scalable Video model (SVM) has similar role as the VM in MPEG-4. It contains description of syntax, semantics, encoding and decoding processes of elements considered for later elevation into the WD. Unlike previous Core Experiments, only one consistent SVM reference software shall exist. In the whole process, each step shall provide description ready-to-add for the next step. To guarantee a stable standard, it is planned to define the WD 1.0 by the next meeting from the SVM defined in Palma. The decision of elevation into the SVM was made on the basis of CE 1 results as described below.
Core Experiment 1
It was decided by the Redmond meeting to conclude on technology elevation into the SVC standard mainly on the basis of results of Core Experiment 1. In terms of compression performance, this included cross-checked investigation of the previous "Munich" rate points, as well as additional rate points to investigate the performance for a scenario with finer granularity of scalability. A total of five different algorithm implementations was presented which fulfilled all formal delivery requirements (in particular, submission of bitstreams before determination of the random rate points). Conceptually, these algorithms can be clustered into AVC-based (respectively AVC-extended) solutions for bottom-up (layered) scalability, wavelet-based solutions for top-down (embedded) scalability and hybrid (e.g. wavelet with AVC base layer) solutions. It was found that all algorithms equally fulfilled the general scalability requirements of CE 1. Further requirements (such as low delay, non-linear adaptation) were additionally tested in other CEs, but could likewise not be used as a differentiation criterion, as not being excluded by any of the algorithms. Therefore, the subjective evaluation became key factor. To establish a clear basis for algorithm performance under visual evaluation criteria, extensive experts viewing tests were performed jointly with the test group, which could be used to determine MOS-like 83 performance measurements. The results are documented in the Report of the Subjective Quality Evaluation for SVC CE1 (N6736). In this, only one algorithm (proposed by FhG-HHI in M11245) showed consistently superior performance over all sequences and at all rate points. Even though, due to the lack of time, the visual evaluation was only performed for the 3-resolutions spatial scalability ("test 1" scenario), similar results were informally reported for the 2-resolutions spatial scalability ("test 2" scenario) in an input document (M11360). It was therefore decided to adopt this algorithm into the Scalable Video Model (SVM) 3.0 (N6716). The software which had previously been donated by FhG-HHI under usual MPEG licensing conditions will be used as the basis for the SVM implementation. The algorithm is an extension of AVC with an AVC-compatible base layer. It uses motion- compensated temporal filtering (MCTF) with adaptive prediction and update steps for efficient open-loop compression, a layered structure with "bottom-up" (switchable pyramid) prediction from lower layers. Only one decoder loop is necessary. FGS functionality is achieved as an extension of CABAC, bitstream scalability is possible at the level of NAL units. The other algorithms participating in the CE1 comparison were: - M11363 (Danae+Thomson): This algorithm extends from the Munich-Redmond CE1 "integrative" MSRA software, implementing spatial lowpass transition filters (SLTF), 3-step lifting filters, scalable encoding of motion vectors additionally. It is a "hybrid" solution with the Munich-Redmond CE2 (AVC-MCTF) codec as base layer, and could therefore also be made fully AVC base-layer compliant (only uses the decoded signal, no other information from base layer). Further results were shown with a low-delay implementation in CE 3. - M11320 (MSRA): This algorithm also extends from the Munich-Redmond CE1 "integrative" MSRA software, implementing a spatial down/upsampling procedure to perform prediction from an AVC-compatible base layer. The signal fed into the base-layer encoder can be down- sampled by conventional filters or wavelet filters. For good FGS performance, R-D optimization information is conveyed with the bitstream (causes roughly 2% overhead). OBMC is used only on the Y component in the results presented for the visual tests. - M11368 (University of Brescia): This algorithm is also developed from the MSRA software bases, but uses the "STool" an architecture for independent MCTF after 2D-DWT. For good compression performance, prediction residuals from the next-lower layer are encoded. STool is designed to avoid drift between the spatial layers in the MCTF process. - M11441 (University of New South Wales): Based on the software provided by UNSW, this is a fully embedded wavelet codec with JPEG2000 compliant code syntax. To avoid drift, it uses "safe MC" with an up-/downsampling procedure where the MCTF process is build only on the scaled information available at the respective spatial resolution (conceptionally similar to overcomplete DWT approaches). No multiple decoder loops are used, but the memory overhead is 1 1/3 maximum. OBMC with 1 pixel overlap is used. Block-wise MC is similar (down to 4x4 pixels) as in other algorithms proposed. 16 bit integer implementation is possible. One algorithm submitted to CE1 (M11277 by Samsung) was not considered due to late submission. This is a combination of AVC and Wavelet layers. Interleaving of AVC and wavelet layers is used at each spatial/temporal resolution. Intra prediction and SHTF are implemented. An adaptive spatial transform is used (9/7 or Haar filters). Multi-layer motion scalability is employed. The algorithm is implemented on top of HHI software (as provided for previous CE 2).
Properties and complexity of the different algorithms were roughly assessed as listed in the subsequent table: HHI MSRA DANAE BRESCIA UNSW MCTF Yes Yes Yes Yes Yes 1 MCTF per spatial yes No no Yes Yes layer Interlayer Prediction Intra + inter Intra + inter Intra+ inter Based on Blending (single loop) (based on (based on inverse from the 84 reconstructed reconstructed entropy coding higher BL) BL) + some levels layers of IDWT Accuracy ¼ pel 1/4pel ¼ pel 1/4pel 1/8 pel Scalable MV Yes, spatially ??? Yes, motion- No Yes, predicted accuracy spatial and MVs scalability SNR (SNR) (multi- resolution) # Decoder Loops Single MC to One at BL 1 loop per 1 MCTF decode a One in resolution per layer enhancement- (note above, resolution layer at target no full frame rate decoding)
Interpolation filter 6-tap for ½ 8-tap 8-tap 8-tap 7-tap pel + 2-tap windowed sinc windowed sinc windowed sinc windowed bineair spline (Conforming (update) to AVC) 11-tap in- band (predict) Updampling/ 6-tap ½ pel 9/7 filter 9/7 & 3-step 9/7 & 3 step 9/7 downsampling filter of AVC lifting on single level filtering OBMCTF No Yes?? Yes (SHTF, Yes?? Yes, SLTF) limited Base layer Yes Yes?? HHI No No Base layer feedback Yes Yes Yes no no into MCTF (upsampled (upsampled reconstructed) reconstructed) Spatial Transform Integer DWT DWT DWT DWT transform (AVC Base) (AVC base) (JPEG (conforming 2000), to AVC) – integer- 4x4 and 8x8 based SNR Bitplane-like Bitplanes Bitplanes Bitplanes Bitplanes scalability/bitplanes Entropy Decoder CABAC with 3D EBCOT 3D EBCOT 3D-EBCOT & 18 binary some new (more than (more than EMDC contexts; contexts EBCOT) EBCOT) (Embedded MQ coder (conforming morphological 20 context to AVC) dilation for MVs; coding) MQ Delay 2.5s, low 2.5s 2.5s, low 2.5s 2.5s delay delay demonstrated demonstrated
CE 2-7 and other technical input:
CE2-7 results showed additional properties of algorithms under test in CE1, as well as other details of technology development. CE2 investigated fully-conformant AVC base layer solutions. CE3 explored the tradeoffs of low-delay functionality; in principle results imply that this is possible with acceptable degree of coding efficiency loss (10 % loss were reported when encoding delay is constrained to 150 ms, where however the definition of overall delay is required to be updated in the next round of CE). CE4 investigated improvements of the MCTF "update step", CE5 improvements of spatial scalability, CE6 improvements of SNR scalability and FGS. CE7 was dedicated to explore non-linear adaptation (capability of different "traces" for
85 multiple adaptations with 1 dB coding efficiency loss was reported). For CE8 (Error resiliency and robustness) no results were reported.
More detailed presentation were made on the following input contributions: M11434: DANAE+Thomson algorithm under low-delay constraint (ENST). Skip forward part of either prediction or update operator. Is only encoding or decoding delay of 150 ms. Effective delay may be 233 ms. Loss corresponds to less than 10% of data rate. Not fully satisfying the CE conditions. M11385: DANAE+Thomson algorithm, SLTF component (RWTH). Shows PSNR losses as compared to EDU and no application of de-blocking. Visual results better in some cases, but not fully consistent yet. Complexity increased (number of hypotheses). M11245: AVC-compatible base layer (HHI). Uses AVC-compliant UMCTF for the base (no update, no 8x8 transform). Results show sometimes decrease, sometimes increase over AVC base layer. Compared to AVC IPPPP.. this also sometimes increases and sometimes decreases performance. M11246: Low-delay (HHI). Structure of "frame groups" with no update steps beyond boundaries. Not AVC compatibility. Loss of up to 1 dB for 150 ms (effective delay considering infinite processing power), depending on sequence. Is open loop in general, but a closed loop is run at the LLL.. frames. No modification of quantizers, may lead to more quality deviations. M11247: Adaptive update (HHI). Nonlinear function dependent on energy that is derived during the derivation process of update motion vectors. Slight increase of PSNR, removes artifacts in cases of strong motion, e.g. football. M11277: Combination of AVC and Wavelet layers (Samsung). Uses interleaving at each spatial/temporal resolution. Uses intra prediction and SHTF. Adaptive transform (9/7 or Haar). Multi-layer motion scalability. Implemented on HHI software. In some cases (City) PSNR improvement, but no visual difference. Soccer and Crew are worse. Performed visual tests. City slightly better, Harbour similar, Crew worse, Soccer similar to HHI uploads. For scenario 2, usually worse performance. Usually causes problems at lowest wavelet layer. M11401: Directional intra blocks (RPI). Allows to do MC in a sub-section of an MB, and directional interpolation in another part. Only small PSNR improvement, no visual effect either. M11328: DANAE+Thomson algorithm, Three-step lifting filters component (INRIA). Three encoding strategies: Use 3LS instead of MPEG-4 downsampling to generate the AVC base layer, use 3LS on both sides, use 3LS only for up-sampling. Has lowpass transition roughly between MPEG and 9/7 filters. Improvements at mid resolution where 3LS is used for 4CIFCIF downsampling, no improvement for scenario 2. Corresponding length 29/40 M11365: tradeoff motion/texture (Siemens). Gives some improvement at low data rates, but results not complete yet. M11248: Multiple non-linear adaptations (HHI). First approach "dead end" which is multiplexing of streams; second approach "multiple base layers" which gives better coding efficiency. In general, worse than the linear adaptation, mostly at the highest rate points (up to 1 dB). Tradeoff between motion and texture data has to be observed for more points - change of motion information changes residuals. M11457: Reduced QCIF bit rate (Samsung). Shows tradeoff between quality at lower and higher layers (all higher rate points can be improved when the highest QCIF rate is improved). Layer-mixing technique: Partial down-sampling without changing the bitstream, only operation of extractor and decoder. Not allowing complexity scalability. M11398: Improvements of CE1 (HHI). Problem: Block artifacts in highpass frames interfere with upsampling filters. Gives improvement mostly for Crew and Foreman, City gives up to 1 dB improvement.
86 M11399: Bit-rate underflow for highest QCIF rates was detected. Proposal to use test conditions with other range of rates without rate overlap, which would give more reasonable results for combined scalability. M11427: FGS subband enhancements (Nokia). Take base layer information into account when selecting contexts. zero/nonzero base used as context selector for the FGS significance map. Relates also to AVC-characteristic rounding offset, e.g. sign is not necessarily guaranteed. Define a "coded region flag" to reduce the number of zeros. Define "spatial contexts" with coefficients from neighboring frequencies. Gives roughly ½ dB improvement over first HHI FGS implementation, in some sequences comes close to WGS case. In particular effective with MCTF base layer. Not clear how large the gain over present implementation is, may be additive gain. M11428: FGS block enhancements (Nokia). Compromise between block-based (Poznan) and subband based (HHI) approaches. "Cyclical block coding" distributes loss over all macroblocks of one frame. "coded block flag" skips a bitplane of entire block. M11418 (CE6 Univ. Poznan). SNR scalability using data partitioning, implemented in HHI software. Granularity is one macroblock. Spiral scan starting from center of image. Only subjective assessment possible: Works well in cases where people look at the center, e.g. City; worse on Crew where relevant content may appear all over the image. M11187: Region of interest which could be at any place of the scene to decide about truncation of motion and texture information. Depending on amount of motion, at higher rates up to 2 dB SNR gain over HHI software (visibility?). Two encoder MC loops, but only one decoder loop. M11234 (NTT). Proposes lossless enhancement in case of 4x4 transform. Bitplane coding not viable, because coefficient space is much coarser than image space. Uses restrictions of possible coefficient configurations even/odd, dividable by 10 etc. Compared to J2K and FRExt lossless variation (turning transform off). Intra coding comparable to J2K, 5% better than FRext (generally roughly ½ compression). Inter case 14% worse than FRExt; usually roughly ¼ to 1/3 compression. Question was raised where fine granularity is needed in applications between "visually lossless" and "lossless". M11235 (NTT). Look up solution for general problem: how many bits are needed for low layer; how can bits be re-allocated between low layer and high layer? Experiment performed on 2-layer TS in CIF resolution; ESCOT used at each layer. Results presented averaging low/high layer PSNR for different re-allocation ratio. In principle, add an FGS layer for the low MCTF band M11236 (Univ. Brussels on error resilience). UMCTF, Haar or 5/3 filtering; no intra blocks, no scalable motion; MDC, but here embedded MDC scalar quantizers, equivalent to usual J2K embedded quant.; as usually in MDC, redundancy is introduced, possible to adapt the amount of redundancy. Use configurations with up to 4 descriptions. Less quality in lossless case, but improves when channel losses are getting higher. Question raised: how does it compare to present SVC algorithms (e.g. from CE1) M11241 (complexity scalability, Thomson). Purpose: decoders of different complexity level (both at low and high layer). "Reduced resolution update" proposed to AVC for improved coding performance: residue is downsampled before transformation step: has coding advantage at low to medium bitrates, in particular at low to medium rates. RRU bitstream could be used as lower-layer bitstream, motion vectors in base layer, but needs to be down- scaled. Has certain amount of drift, but not too serious; example: Spatial scalability with two layers; EI, EP pictures. Intra blocks encoded at full resolution. Decoder similarity with the Redmond HHI proposal, but do not use update step. Encoder different, as mode decisions are made at high resolutions; this causes drift at the low resolution. This approach of complexity scalability leads to PSNR loss in particular at higher rates, but visually not that much distinguishable; for the lower resolution, gives slightly higher detail, but this has higher bitrate.
87 The following set of Core Experiments in SVC were newly defined (N6719): CE1: Low-delay constraints CE2: Coding efficiency in fine-granular SNR scalability CE3: Inter-layer prediction for motion and residual CE4: Complexity scalability CE5: Scan modes
Applications and Requirements of SVC
A breakout group was active during the week to discuss further improvements of the Applications and Requirements of SVC document (N6730). In particular, linking of applications with specific requirements was performed, and clustering of applications and application domains was started. It is expected that these improvements will be helpful in future CE evaluations, and also with regard to SVC profile definitions to be developed later. Therefore further discussion and development of applications-and-requirements related criteria will remain in the mandate of the CE AHG.
Documents reviewed: a) General
Draft Guidelines for the SVC CE Process and 11331 Jens-Rainer Ohm Elevation Procedure Comments on 'Software Copyright Licencing (sic) 11267 Paul Jessop Disclaimer for MPEG Standards' Andreas Hutter on behalf of GNB Comment on proposed new SW Copyright 11463 the GNB disclaimer for MPEG reference software b) Core Experiments
CE1 Vittorio Baroncini, Thiow 11333 Suggested Test Method for SVC CE Visual Tests Keng Tan, Tobias Oelbaum Edouard Francois, Vincent Bottreau, Jean Charles Discussion on evaluation criteria for experts viewing 11372 Gicquel, Mathias Wien, tests in SVC CE1 Jerome Vieron Jean-Charles Gicquel, 11360 Stéphane Pateux, Isabelle Subjective evaluation of CE1 results Amonou, Sylvain Kervadec SVC CE1 - Bosch verification of HHI results for 11243 Marco Boltz medium grain and combined scalability Heiko Schwarz, Tobias Hinz, Heiner Kirchhoffer, Technical description of the HHI proposal for SVC 11244 Detlev Marpe, Thomas CE1 Wiegand SVC CE1 - Samsung verification of Univ. of Brescia 11275 Woo-Jin Han (System I and II) Ruiqin Xiong, Xiangyang 11320 MSRA scheme for SVC CE1 Ji. Jizheng Xu, Feng Wu Cross-Verification of DANAE+Thomson results on 11321 Ruiqin Xiong, Jizheng Xu SVC CE1 88 Vincent Bottreau, Edouard Francois, Stephane Pateux Technical description of the DANAE+Thomson 11363 Benoit Timmerman, M. proposal for SVC CE1 Wien Vincent Bottreau, Edouard Francois, Stephane Pateux, SVC CE1: DANAE+Thomson verification of MSRA 11364 Benoit Timmerman, M. contribution Wien Nicola Adami, Michele SVC CE1: STool - a native spatially scalable 11368 Brescianini, Riccardo approach to SVC Leonardi, Alberto Signoroni Marco Tagliasacchi Cross-verification of UNSW proposal for SVC CE1 11437
David Taubman, Reji SVC Core Experiment 1, Description of UNSW 11441 Mathew, Davide Maestroni, Contribution Stefano Tubaro
CEs 2-8 Heiko Schwarz, Tobias Technical description of the HHI proposal for SVC 11245 Hinz, Detlev Marpe, CE2 Thomas Wiegand Justin Ridge, Yiliang Bao, 11426 Verification of SVC CE2 contribution for HHI Yilong Liu Hongkai Xiong, Chen CE Verification Report of HHI on CE2.3: Adaptive 11237 Wang, Li Song, Feng Wu Block Transforms 11329 Francesco Ziliani Coordinator's report on SVC's CE3: Low Delay Gregoire Pau, Beatrice Response to the SVC CE-3 on coding efficiency with 11343 Pesquet-Popescu low-delay constraints Heiko Schwarz, Jikun Shen, Technical description of the HHI proposal for SVC 11246 Detlev Marpe, Thomas CE3 Wiegand 11386 Konstantin Hanke SVC CE3 - Verification of ENST results 11294 Diego Santa-Cruz Verification of results for SVC on CE3: Low Delay Joohee Kim, Hyeyeon Kim, 11223 Responses to CE4 in SVC Doohyun Kim Heiko Schwarz, Heiner Technical description of the HHI proposal for SVC 11247 Kirchhoffer, Detlev Marpe, CE4 Thomas Wiegand Response to SVC CE4 - Spatial Lowpass Transition 11385 Konstantin Hanke Filtering Yongjun Wu, John W. 11401 Directional Intra-prediction for CE4 Woods Heiner Kirchhoffer, Heiko Verification of the Samsung AIT proposal for SVC 11257 Schwarz CE4 Maria Trocan, Gregoire 11318 Pau, Beatrice Pesquet- Cross-Verification of RWTH Results on SVC CE-4 Popescu 11352 Mathias Wien SVC CE4: RWTH Verification of HHI contribution 11359 Leszek Cieplinski Cross-verification of RPI results on SVC CE-4 11397 Heiko Schwarz Coordinators report on SVC CE5: Spatial Scalability 11328 Vincent Bottreau, Christine SVC CE5 - Precise Description of IRISA Proposal Guillemot, Rashid Ansari,
89 Edouard François Benoit Timmerman, Peter Response to SVC CE5 - Optimization of tradeoff 11365 Amon, Andreas Hutter between motion information and texture Benoit Timmerman, Peter 11367 SVC CE5 - Verification of IRISA results Amon 11424 Justin Ridge SVC CE6 co-ordinator report Lukas Blaszak, Marek 11418 SVC CE6 results at Poznan University of Technology Domanski, Rafal Lange Heiko Schwarz, Karsten Technical description of the HHI proposal for SVC 11248 Sühring, Detlev Marpe, CE7 Thomas Wiegand SVC CE7 - Non-linear adaptation results from Bosch 11242 Marco Boltz and verification of HHI results Julien Reichel, Francesco 11258 SVC CE7: Verification of HHI results Ziliani, Diego Santa Cruz Woo-Jin Han, Bae-Keun Performance analysis of reduced QCIF bit-rates in 11457 Lee SVC CE1 based on HHI software c) Technical input Related to CE Woo-Jin Han, Bae-Keun Technical description of Samsung proposal for SVC 11277 Lee CE1 Won Ha Kim, Seyoon 11285 Verfication of SAMSUNG SVC software for CE1 Jung Heiko Schwarz, Tobias Further improvements of the HHI proposal for SVC 11398 Hinz, Detlev Marpe, CE1 Thomas Wiegand Heiko Schwarz, Detlev Further results for the HHI proposal on combined 11399 Marpe, Thomas Wiegand scalability Justin Ridge, Yiliang Bao, 11427 Marta Karczewicz, FGS subband enhancements for scalable video coding Xianglin Wang Justin Ridge, Yiliang Bao, 11428 Marta Karczewicz, FGS block enhancements for scalable video coding Xianglin Wang
Other Zhengguo Li, Xiaokang Yang, Kengpang Lim, 11187 Customer Oriented Scalable Video Coding Xiao Lin, Susanto Rahardja, Feng Pan 11214 Truong Nguyen, Min Li New spatial transform in SVC Seishi Takamura, Bandoh Proposal of SNR Scalability Method with up to 11234 Yukihiro, Yoshiyuki Lossless Enhancement Yashima Yukihiro Bandoh, Seishi 11235 Takamura, Yoshiyuki Proposal of inter-band bit re-allocation for SVC Yashima Fabio Verdicchio, Adrian Munteanu, Augustin Resilience in Scalable Video Coding using Embedded 11236 Gavrilescu, Jan Cornelis, Multiple Description Scalar Quantization Peter Schelkens
90 Peng Yin, Jill Boyce, 11241 Complexity Scalable Video Codec Purvin Pandit Lee Men Huang, Shen MCTF-based Scalable Video Coding in Low Delay 11311 Sheng Mei, Yoshimasa Mode Honda Nicola Adami, Michele Brescianini, Riccardo Fully embedded entropy coding with arbitrary 11378 Leonardi, Alberto multiple adaptation capabilities Signoroni Markus Beermann, 11391 Quality-adaptive reconstruction-filtering - first results Mathias Wien
Output documents related to MPEG-21 SVC
No. Title TBP Available 21000-13 Scalable Video Coding 6716 Scalable Video Model Version 3.0 No 04/11/08 6717 SVM 3.0 Software No 04/11/08 Guidelines for the SVC CE Process and Elevation No 04/10/22 6718 Procedure Description of Core Experiments in MPEG-21 Scalable No 04/10/29 6719 Video Coding 6736 Report of the Subjective Quality Evaluation for SVC CE1 No 04/10/22 6830 Applications and Requirements of Scalable Video Coding No 04/10/22
Explorations
3D AV Coding
As originally planned, the Call for Evidence on multi-view video coding (N6720) was issued at the Palma meeting, with responses expected in January. Beforehand, concerns had been raised that the test sequences presently available have been captured without recording the camera parameters. These would be necessary to achieve perfect rectification (to simplify encoding) and view interpolation. It was mentioned that some test sequences obviously also have misalignments in color between the different cameras The CfE was not delayed nevertheless, because (according to the discussion of the breakout group Arguments for increased coding efficiency by doing rectification not fully evident at the moment Proposals may or may not use camera parameters, rectification & color normalization For the CfE, it is therefore considered sufficient to use non-rectified, non-normalized sequences as input. For a possible subsequent CfP, more test sequences would be needed, including exact specification of camera parameters. For the CfE, the sequence "objects1" which has strongest color artifacts was removed from the test set. To obtain new test materials, a request for more test material is made. The formats and required camera parameters are described in the document "Requirements on Test Material for Multi-view Video Coding Experiments" (N6721). The testing methodology in the CfE must be based on experts viewing similar to the SVC experience. As algorithms may use rectification, PSNR measurements versus original sequences would be useless. In such cases PSNR measured between "original rectified" and "decoded rectified" sequences should be provided as additional information to investigate the performance of proposals, e.g. in terms of constant reconstruction quality for different views. The technical
91 input was reviewed as described in the AHG report. Contributions related to "Free Viewpoint Television" were considered useful to better specify the applications in the Applications and Requirements document. This includes description on more specific FTV systems, architectures and requirements. An update of the requirements documents was made including examples of system architectures. Separation into video-related and systems-related requirements is made, and the requirement to support camera parameters is included. This document "Requirements of Multi-View Video Coding" (N6834) is also referenced by the CfE
Documents reviewed: Hideaki Kimata, Masaki Anchor bitstreams for preliminary Call for Evidence 11231 Kitahara on multi-view video coding Hideaki Kimata, Masaki Framework on free-viewpoint video with shared 11232 Kitahara memory video coding Multiple Image View Synthesis for Virtual 11238 Eddie Cooke Viewpoint Rendering (S) Aljoscha Smolic, Karsten Mueller, Philipp Merkle, 11240 Predictive Compression of Dynamic 3D Meshes (S) Matthias Kautzner, Thomas Wiegand 11259 Masayuki Tanimoto Free Viewpoint Television - FTV Yung-Lyul Lee, Woo-chul 11266 Multi-view video coding using 2D direct mode Sung Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Multi-view Video Coding using Layered Depth 11278 Kugjin Yun, Chunghyun Image Ahn, Sooin Lee Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Coding of Layered Depth Image using Coherency 11279 Kugjin Yun, Chunghyun between Point Samples Ahn, Sooin Lee Sukhee Cho, Daehee Kim, Kugjin Yun, Chunghyun 11292 Multi-view video coding using image stitching Ahn, Soo In Lee, Yongtae Kim, Kawnghoon Sohn Kazumasa Yamazawa, 11350 Hideaki Kimata, Hitoshi Proposal for MPEG-A of omni-directional video (R) Habe Anthony Vetro, Hanspeter Comments on Draft Call or Evidence on Multi-View 11434 Pfister, Wojciech Matusik, Video Coding Jun Xin Wojciech Matusik, Calibration and Rectification Procedures for Multi- 11435 Hanspeter Pfister, Tim Camera Systems Weyrich, Anthony Vetro Jun Xin, Anthony Vetro, Preliminary studies on view interpolation for multi- 11436 Hanspeter Pfister, Wojciech view video coding Matusik
Video Coding Tools Repository
Several breakout meetings were held to discuss VCTR matters during the MPEG week. Three contributions are reviewed. In addition to an update of the previous Study document, most work was contributed to the development of a precise description of the intra coding tool from MPEG-
92 4 Visual Simple Profile according to the VCTR principles. The following functional units are defined: Parsing/Decoding FUs o Variable length decoding (VLD) unit o Runlength decoding (RLD) unit o Macroblock generator (MBG) unit MB-based FUs o DC Reconstructor (DCR) unit o Inverse scan (IS) unit o Inverse AC prediction (IAP) unit o Inverse quantization (IQ) unit o Inverse transform (IT) unit The inter-relationships with the global control unit are also precisely described. Details on VCTR can be found in Study 2.0 document (N6723). The specification of Simple Profile intra coding tool in terms of the VCTR concepts is contained in N6724. This could also be interpreted as an alternative (hardware/software independent, not C-syntax like) description of an MPEG-4 Visual tool.
Documents reviewed: Yoshihisa Yamada, Kazuo Coding performance of Intra-only coding in 11295 Sugimoto, Kohtaro Asai, AVC High Profile Tokumichi Murakami 11319 Kohtaro Asai Intra coding tools for AVC High Profile Euee S. Jang, Sunyoung Lee, JongWoo Won, Sungwon 11322 Hanyang/Humax Contribution to VCTR Park, YongHo Cho, YoungRyul Lee
Wavelet Video Coding
It was discussed that results of SVC CE1 and other technical input shows further development potential of motion-compensated wavelet solutions, which may however not perfectly fit with the Scalable Video Model framework presently under development, and may also not converge with this in the near future. It was therefore decided to establish an AHG with mandates 1. To explore further technical progress in the field of motion-compensated wavelet video coding under consistent evaluation criteria 2. To study the relationship between wavelet technology and the emerging Scalable Video Model (SVM)
Workshop on Future Directions of Video Compression
Potentially, new video technology is developing outside MPEG (industry and academia) that may e.g. be interesting To identify future application domains To identify newly developing approaches of video compression technology To identify whether our traditional standardization paradigms still hold It was therefore decided to establish an AHG which has the mandates to gather information and prepare a workshop on future video compression technology, to be held co-located with a future WG11 meeting.
93 Output documents related to Explorations
No. Title TBP Available 3D AV 6720 Call for Evidence on Multi-View Video Coding Yes 04/10/22 6721 Requirements on Test Material for Multi-view Video Yes 04/10/22 Coding Experiments 6834 Requirements of Multi-View Video Coding Yes 04/10/22 Video Coding Tools Repository 6722 Study of Video Coding Tools Repository V2.0 No 04/10/22 6723 VCTR Textual Description V1.0 No 04/10/25
AHGs established by the Video Subgroup
No. Title Mtg 6724 AHG on Video IDCT Specification Y 6725 AHG on Maintenance of MPEG-4 Visual related Documents, Reference N Software and Conformance 6726 AHG on Maintenance of MPEG-7 Visual related Documents and Reference N Software 6727 AHG on Description Tools for MPEG-7 New Visual Extensions Y 6728 AHG on Core Experiments in Scalable Video Coding Y 6729 AHG on Scalable Video Model and SVM Software N 6730 AHG on 3DAV Coding Y 6731 AHG on Video Coding Tools Repository Y 6732 AHG on further Exploration in Wavelet Video Coding Y 6733 AHG on Organization of a Workshop on Future Directions in Video Y Compression
94 Annex 9 Report of Audio meeting
Source: S. Quackenbush, Chair, Audio Subgroup
1 OPENING OF THE MEETING...... 3 2 ADMINISTRATIVE MATTERS...... 3 2.1 Approval of previous meeting report...... 3 2.2 Approval of agenda and allocation of contributions...... 3 2.3 Communications from the Chair...... 3 2.4 Joint meetings...... 3 2.5 Received National Body Comments and Liaison matters...... 3 2.6 Task Groups...... 3 3 AHG MEETINGS...... 3 3.1 Synthetic Music Representation (Sunday 0900 – 1800)...... 4 3.2 MPEG-4 Lossless Coding (Sunday 0900-1100)...... 4 3.3 Spatial Audio Coding (Sunday 1100-1600)...... 4 3.4 Scalable Speech and Music Coding (Sunday 1600-1800)...... 6 4 AUDIO PLENARY, JOINT MEETING AND TASK GROUP ACTIVITIES...... 7 4.1 Review of AHG reports...... 7 4.2 Received national body comments and liaison matters...... 7 4.3 Audio plenary discussions...... 7 4.3.1 Proposed change to MPEG-2 AAC Corrigendum text...... 7 4.3.2 Proposed profile HE-AAC Version 2...... 7 4.3.3 Spatial Audio Coding...... 7 4.3.4 MPEG Audio Coders...... 7 4.4 Joint Meetings...... 8 4.4.1 MAF and MPEG-21: MPEG-A Part 4 (Tue 1130-1300)...... 8 4.4.2 Requirements at Audio on new audio profile, CfI on Scalable Coding / use cases...... 8 4.4.3 Timestamps and Backward-compatible Audio Decoders...... 9 4.5 Task Group discussions...... 9 4.5.1 MPEG-4 Audio Issues...... 9 4.5.2 Lossless Coding...... 9 4.5.3 MPEG-7...... 11 4.5.4 Spatial Audio Coding...... 11 4.5.5 Symbolic Music Representation...... 11 4.5.6 Scalable Speech and Music Coding...... 12 5 MEETING DELIVERABLES...... 12 5.1 Press statement...... 12 5.2 Dispositions of Comments...... 12 5.3 Responses to Liaison and NB comments...... 12 5.4 Recommendations for final plenary...... 12 5.5 Establishment of Ad-hoc Groups...... 12 5.6 Approval of output documents...... 12 6 FUTURE ACTIVITIES...... 12 6.1 Schedule of future meetings...... 12 6.2 Agenda for next meeting...... 12 6.3 All other business...... 13 6.4 Closing of the meeting...... 13 ANNEX A PARTICIPANTS...... 14 LIST OF SYMBOLIC MUSIC REPRESENTATION PARTICIPANTS...... 16 ANNEX B AUDIO CONTRIBUTIONS AND SCHEDULE...... 17 ANNEX C TASK GROUPS...... 22 ANNEX D OUTPUT DOCUMENTS...... 23 ANNEX E AGENDA FOR THE 71ST MPEG AUDIO MEETING...... 24 95 96 Opening of the meeting The MPEG Audio Subgroup meeting was held during the 70th meeting of WG11, October 18- 22, 2004 in Palma de Mallorca, ES. The list of participants is given in B.
Administrative matters
Approval of previous meeting report The 69th Audio Subgroup meeting report had been previously distributed by e-mail and was approved. Approval of agenda and allocation of contributions The agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in C. Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.
Joint meetings The joint meetings with Audio over the course of the week are listed here and are reported on below. Groups What Where Day Time Requirements, MPEG-A Req Tue 1130-1300 Systems, Video, (incl DRM functionality for MPEG-A) Audio Requirements, New audio profile, CfI on Scalable Audio Tue 1630-1730 Audio Coding and use cases Systems, Audio Timestamps and Backward- Audio Tue 1730-1830 compatible Audio Decoders Requirements, MPEG-A MPEG-21 Zeus Wed 1400-1500 Systems, Video, Audio Received National Body Comments and Liaison matters The NB Comments and Liaison documents for the meeting that require a response are as shown below. No. Title Response by 11226 USNB Contribution: Issues for audio lossless coding S. R. Quackenbush 11227 USNB Contribution: Fine-grain scalable audio codec S. R. Quackenbush 11228 USNB Contribution: Preliminary comments on 14496- S. R. Quackenbush 3:2001/PDAM 4 and 5 11316 KNB comments on MPEG-4 BSAC multi-channel S. W. Kim Task Groups Task groups were convened for the duration of the MPEG meeting, as shown in D Results of task group activities are reported below.
AhG meetings
97 In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report. Synthetic Music Representation (Sunday 0900 – 1800) Paulo Nesi and Giorgio Zoia chaired this meeting. The group activity was divided in three separate “sessions.” The first part of the morning was dedicated to two input presentations. Hartmut Ring and Hartmut Lemmel from Capella, Germany, made first two presentations on how and in which terms the CapXML format can meet or not, in its actual status, the major CfP requirements and implement some of the Test Cases under discussion. Giuseppe Nicotra from Arca, Italy, presented some issues and typical test cases for the representation of music through Braille; a short discussion followed after which it was decided to reintroduce one Test Case for Braille. Giuseppe Nicotra and Neil McKenzie was charged to propose this test case during the week. The second part of the morning was dedicated to the finalization of the table of weights for the evaluation process. The process has been carried on without remarkable problems; consensus was reached item by item either in unanimous way or by acceptance of voting results at majority. A few aspects being alternative to other ones and with the same weight were firstly considered for removal and after some discussion assigned to a low weight. Thus the identified aspects in the evaluation model have been maintained in the model, and weights have been finalized. Then the evaluation model has been finalized. The final session in the afternoon was dedicated to progress on the set of Test Cases for the different Requirements and Aspects. Like for the morning session, consensus was reached item by item and a relevant set of Test Cases to be retained as final has been selected. MPEG-4 Lossless Coding (Sunday 0900-1100) Tillman Liebchen, TUB, chaired this meeting. He opened the meeting by presenting the draft AHG report. Tillman Liebchen, TUB, presented m11347, CE8 on multichannel compression. 11314 Noboru Harada, Takehiro Proposal of CE for improved floating- Moriya point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding) This CE produces modest improvement in performance, but with almost no increase in decoder complexity. He anticipates that this technology will be in a distinct profile. Noboru Harada, NTT, presented m11314. 11314 Noboru Harada, Takehiro Proposal of CE for improved floating- Moriya point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding) This document proposes using approximate common factor coding as a means of improving compression of IEEE floating-point data. This imposes significant complexity on the encoder, but almost no additional complexity on the decoder. Rongshan Yu, I2R, presented m11382. This proposes a Core Experiment on a new predictor in the ALS architecture. 11382 Dong-Yan Huang, Haibin Proposal for Lossless Audio Coding Huang, Rongshan Yu, Xiao Lin, Susanto Rahardja The predictor is backward-adaptive, such that no side information is transmitted for the predictor coefficients. Furthermore, the predictor is constructed as the cascade of four stages of either RLS or LMS adaptive FIR filters. Schuyler Quackenbush, Audio Research Labs, presented m11395. 11395 S. R. Quackenbush Cross-check on ALS Core Experiment 98 This document is a crosscheck on I2R m11382. All aspects of the I2R data were verified, except that there was a minor difference in the compression of one item, which was due to using an encoder that was slightly different (i.e. with bugfixes) from the I2R encoder. Spatial Audio Coding (Sunday 1100-1600) Schuyler Quackenbush chaired this meeting. The agenda for the AHG was discussed and approved. Test Site Reports Schuyler Quackenbush, Audio Research Labs, presented the test report from University of Miami on behalf of Jon Boley. 11202 Jon Boley Spatial Audio Coding Listening Test Report- University of Miami
Jeongil Seo, ETRI, presented the test report from the ETRI listening test site. 11263 Inseon Jang, Jeongil Seo, Spatial Audio Coding RM0 Selection Test Kyeongok Kang Report - ETRI
Takeshi Norimatsu, Panasonic, presented on behalf of Kobe University 11269 Masayuki Morimoto, Hayato Report on the Evaluation Tests for Spatial Audio Coding Systems
Naoya Tanaka, Panasonic, presented 11323 Naoya Tanaka, Takeshi Report on the Listening Tests for the Norimatsu Spatial Audio RM0 Selection
Juergen Herre, FhG, presented 11340 A. Hoelzer, C. Spenger, D. Report on Spatial Audio Coding Subjective Weninger, J. Herre Tests at FhG Test Site
Heiko Purnhagen, Coding Technologies, presented 11381 Heiko Purnhagen, Kristofer Spatial Audio Coding Listening Test Site Kjörling, Werner Oomen Report - CT/Philips These tests were conducted in three listening rooms, two at Coding Technologies and one at Philips. Mart Vinton, Dolby Labs, presented 11215 Mark Vinton Testing Environment and Procedures for Spatial Coding Performed at Dolby Laboratories These were conducted in two rooms, in which tests 1b and 2b were conducted in a separate room. Sang-Wook Kim, Samsung, presented 11317 Kim Report on verification of test bitstream submissions to Spatial Audio Coding RM0 test
Schuyler Quackenbush, Audio Research Labs, presented 11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding RM0 Selection Tests The data in the report, both tabular and graphical, was presented. It was suggested to additionally report average spatial audio coding side information per test per proponent, and whether the maximum side information rate of 32 kb/s was met for all coded items for all proponents. Finally, it was suggested to emphasise that in each of test 4a and 4b, all decoded items used common side information.
99 Test report was discussed and experts agreed that the data presented was correct. The ranking of proponent systems, at the 95% level of significance, was agreed to be: Test System Ranking 1 ctp = fhg > dol > pan 2 ctp > fhg = dol > pan 3 ctp = fhg > dol > pan Where “=” indicates equivalent to and “>” indicates better than. The Audio Chair noted that two systems (ctp and fhg) were best for each of tests 1 and 3, and amongst the best for test 2. He asked if there was consensus to not conduct the Evaluation Process, as documented in N6691, “Workplan for the Evaluation of Spatial Audio Coding Responses” but rather consider that RM0 will be the merger of the ctp and fhg systems. There was consensus on this proposition, and the proponents of the ctp and fhg systems came forward with a proposal for such a merge. Representative from the two systems gave a presentation. It advocated that merging the ctp and fhg systems would bring MPEG the best RM0 since the two systems have complementary strengths. It was agreed that the result would be assessed by a listening test prior to acceptance as RM0. By the time of the April MPEG meeting the following would be accomplished with respect to the merger activity: 1. Reference code and bitstreams available a. Source code compiles and decodes submitted bitstreams to exactly tested waveforms 2. Syntax description available 3. WD text (may be preliminary) 4. Listening test results available a. Bitstreams and associated decoded waveforms available b. Perhaps decoder executable to permit verification of bitstreams and waveforms c. Systems under test will be: RM0, ctp, fhg, hidden reference, lp35 anchor d. Configurations tested will be 5-2-5 and 5-1-5 (as in Test 1 and Test 2) e. Listening tests will be conducted at least by Coding Technologies, Philips and FhG, with a total of at least 30 listeners.
Juergen Herre, Fhg, presented 11384 Juergen Herre Additional Information on Fraunhofer/Agere Spatial Audio Coding Submission This presentation information on proponent system side information bitrates, variability of performance across test items, and interpretation of test 4, “artistic side information.” The contribution draws information found in the test report as a means to make its points. Artistic downmix: in Test 4, a common side information sequence was used for multichannel decoding based on several different stereo mixes. The test results shows that all decodings have comparable performance, and that the performance is always rated as better than the stereo downmix. Heiko Purnhagen, Coding Technologies, presented 11403 Heiko Purnhagen, Kristofer Additional Information on CT/Philips Kjörling, Werner Oomen Spatial Audio Coding System This presentation noted the following about the system proposed by CT/Philips It affords attractive computation efficiencies when used with an HE-AAC base coder. It builds upon tools that have already been standardized (i.e. tools from the parametric stereo coder). Werner Oomen, Philips, presented 11393 Kristofer Kjörling, Werner Analysis of spatial evaluation results Oomen, Jeroen Breebaart
100 This proposed that post-screening be done based on absolute score given to the hidden reference, specifically that listeners must score the hidden reference above 90 or else all data from that listener is removed from the test. The contribution in fact did such post-screening and presents the results. Scalable Speech and Music Coding (Sunday 1600-1800) Pierrick Phillipe, France Telecom, presented 11370 Pierrick Philippe, Jean Bernard Contribution to requirements and use Rault cases for Scalable Audio/Speech Coding The conclusions of the contribution are that the CfI should Have greater focus on mobile applications. Incorporate some requirements from this contribution into the CfI. Specifically request additional information on mobile applications Jim Johnston, Microsoft, presented 11251 Johnston CFI proposed to AGH on Scalable coding This is a draft of the CfI associated with the Scalable Speech and Audio exploration.
Audio plenary, joint meeting and task group activities
Review of AHG reports There were no requests to review any of the AHG reports. Received national body comments and liaison matters The Audio Chair presented the USNB Comments and members of the Korean NB presented KNB Comments. Those NB Comments are listed in Section , which also indicates who will respond to those comments. Audio plenary discussions
Proposed change to MPEG-2 AAC Corrigendum text Andreas Schneider, Coding Technologies, presented 11400 Andreas Schneider Proposed Addition to MPEG-2 AAC Corrigendum This contribution proposes extending the MPEG-2 AAC “Characterization” naming scheme to support the SBR tool, e.g. “5.1.1.1 channel AAC-LC + SBR level 5” decoder, where the “level 5” indicates a level in the MPEG-4 HE-AAC profile. The Audio Chair proposed that this be denoted as, e.g. “5.1.1.1 channel AAC-LC SBR/5” decoder and text be added to clarify that the “/5” indicates that the SBR tool has the same capabilities as does the SBR tool in a HE-AAC level 5 profile decoder. Proposed profile HE-AAC Version 2 Kristofer Kjörling gave a presentation on the proposed HE-AAC V2 profile. This profile incorporates the parametric stereo tool, and is expected to have significant interest from industry. It will use the same hierarchical signalling scheme as is found in the HE-AAC profile. Spatial Audio Coding Jeongil Seo, ETRI, presented 11264 Jeongil Seo, Han-gil Moon, A New Cue Parameter for Spatial Audio Seungkwon Beack, Inseon Jang, Coding Kyeongok Kang, Jinwoo Hong This contribution proposes a new parameter VSLI, Virtual Source Location Information, for the coding of spatial representations of multichannel audio signals. The proposed coding scheme
101 achieves a resolution in the horizontal plane of as fine as 2 degrees. The authors believe that since their proposed coding scheme has a much higher dynamic range, it is more effective than ICLD. Since RM0 has been selected at this meeting (and there is a workplan in which RM0 is available at the 72nd MPEG meeting), this contribution is informative only. The authors anticipate submitting this as a core experiment at the 72nd meeting. Schuyler Quackenbush asked if proponent coded material could me made available to MPEG for informational purposes. There was no objection, so that material will be available with filenames “in the clear” (as contrasted to the double-blind naming of the test material) shortly after the close of this MPEG meeting. Sang Wook Kim, Samsung, expressed interest it the “in the clear” coded material. MPEG Audio Coders Pierrick Philippe, France Telecom, presented 11341 Alexandre Cotarmanac'h, MPEG General Audio Codecs Pierrick Philippe This document presents an overview of the functionality, history and description of the audio coding tools in MPEG. Experts familiar with particular MPEG technology are encouraged to review this document and add to it, especially with regard to relevant application scenarios, subjective performance data, and description of technology. The Audio Chair noted that at a future date this will a public document, and so it is in the interest of technology proponents to review and add to the document. Sang-Wook, Samsung, noted that an FTP site with material processed by MPEG technology at various bitrates would be very valuable. Joint Meetings
MAF and MPEG-21: MPEG-A Part 4 (Tue 1130-1300) MPEG-21 could be used in both media download and streaming. Ian Burnett, UoW, proposed that the following components of MPEG-21 are relevant to the problem: a. MPEG-21 part 9 (MPEG-21 file format) b. Restrict the scope of DID such that it is compatible with target applications, i.e. that only the necessary components are available and that it is compatible with low-complexity devices. c. Binarization of MPEG-21 DID according to MPEG-21 part 16 (BiM) d. A profile of REL suitable for a given application space e. Binarization of MPEG-21 REL according to MPEG-21 part 16 (BiM) The problem is to specify a single package (MPEG-21 file format) that is able to express the relationship between or structure of the media components in the file (using DID). It was noted that MPEG does not currently specify a means for encryption. Bernhard Grill, FhG, expressed the opinion is that the MPEG-A effort should try to “invent” the minimum amount of technology and adopt the largest commonality with mechanisms that are currently in the marketplace. The stated goal of Part 4 is to use MPEG-21 technology to publish protected media for either download or steaming distribution, however there was extensive discussion on the problem that should be solved in this application format, and a clear consensus on the problem statement was not reached. Requirements at Audio on new audio profile, CfI on Scalable Coding and Use Cases New audio profile Kristofer Kjörling, Coding Technologies, presented 11310 Kristofer Kjörling Additions to the profiles under consideration
102 11312 Kristofer Kjörling, Werner Company support for the proposed High Oomen, Takeshi Norimatsu, Efficiency AAC v2 Profile Toshiyuki Nomura, Jean- Bernard Rault The contribution reported on the performance of the proposed technology (30% additional compression of stereo signals with respect to the HE-AAC profile). There was consensus in the Audio Subgroup to create this new profile Action by Audio Subgroup is to attach this to the Lossless Audio Coding (ASL) amendment, and to discuss whether this it the best profile name. CfI on Scalable Coding with additional use cases Jim Johnston, Microsoft, presented a document that represents the merger of the following documents 11251 Johnston CFI proposed to AGH on Scalable coding 11370 Pierrick Philippe, Jean Bernard Contribution to requirements and use Rault cases for Scalable Audio/Speech Coding There was discussion of both the CfI and the additional use cases. It was agreed that the key functionality requested in the call was scalable coding for both speech and audio signals. The CfI should include the following sections: Application scenarios These might include Scalable to lossless, including across sampling rates Low bit rate channels (e.g. 3gpp requirements) Functionality and implied requirements Timetable for submission Evaluation of evidence This should be with respect to existing MPEG technology (both scaleable and fixed-rate), such that the submitted technology is significantly better in performance (in a rate-distortion sense) that MPEG technology.
The Audio group will continue to discuss the target applications, desired functionality and evaluation of evidence. Timestamps and Backward-compatible Audio Decoders Schuyler Quackenbush, Audio Research Labs, presented N6682 Timestamps and Audio Codec Behavior There was discussion of the problem statement and a proposed solution, which will be reviewed by System experts. Task Group discussions
MPEG-4 Audio Issues Eunmi Oh, Samsung, presented 11217 Eunmi Oh, Miyoung Kim Fine Grain Scalability in MPEG-4 BSAC multi-channel audio coding After extensive discussion, it was the consensus of the Audio Subgroup that the proposal in this contribution be incorporated into the “Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions” document. Werner Oomen, Philips, presented 11392 Heiko Purnhagen, Werner Proposed corrigenda to AMD2, Oomen (parametric) The contribution proposes to add several changes that are editorial or clarifications changes to AMD 2, and the Audio Subgroup agreed to add them to the existing Proposed Corrigenda text, and to issue the Corrigenda at this meeting.
103 Werner Oomen, Philips, presented 11389 werner oomen, Frans de Bont, Working draft proposal for SSC Erik Schuijers conforma nce This contribution proposes to do conformance on a “per-tool” basis, e.g. for each of sinusoidal, noise and transient coding tools, and also for the PS tool. Andreas Schneider, Coding Technologies, presented 11380 Kristofer Kjörling, Heiko Working draft proposal for PS Purnhagen, Andreas Schneider, conformance Werner Oomen This contribution proposes PS tool conformance as applied to both HE-AAC and SSC coders. The Working Draft specifies restrictions for conformant bitstreams. The conformance procedure removes the influence of the AAC decoder, so that only the behaviour of SBR+PS is tested. There will be bitstreams that test various aspects of the PS tool, and the figure of merit for some bitstreams may be more than just the normal criterion (i.e. RMS error and maximum difference with respect to the reference decoded waveform). The Working Draft defines 10 bitstreams, all of which are available, and all conformance-testing tools (e.g. conformance AAC decoder) are available. Lossless Coding The presentation of lossless coding related contributions began in Sunday’s AhG meeting, and continued during the MPEG meeting. Yuriy Resnik, RealNetworks, presented 11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher Predictor Orders) The crosscheck showed that, while peak complexity is proportional to predictor order, average complexity (averaged over the entire signal duration) is proportional to the square root of the predictor order. The task group agreed to incorporate the result of this CE into the ALS text. Yuriy Resnik, RealNetworks, presented 11404 Yuriy A. Reznik Cross-Check of SLS CE4 ( Lazy Bitplane Coding) The task group agreed to incorporate the result of this CE into the SLS text. Rongshan Yu, I2R, presented 11377 Rongshan Yu Proposed WD changes for Lazy Coding for MPEG-4 Audio Scalable Lossless (SLS) Coding This presented the integration of CE4 (Lazy bitplane coding) into the ALS PDAM text. This will form the basis of a “Study on PDAM” WG11 document. Rongshan Yu, I2R, presented 11379 Rongshan Yu Proposed changes for ISO/IEC 14496- 3/PDAM5 (Scalable Lossless Coding) There was lengthy discussion on this contribution, much of which was to review the current status of the SLS text. One conclusion is that the SLS text must explicitly indicate that the SLS enhancement is added to AAC reconstruction values. The contribution proposes a deterministic rule to compute the bitplane in which to start the SLS enhancement. There was discussion as to whether this is the best rule, and there was no consensus on this point. The group agreed to get additional data on how often the use of the rule is required (information provided later in the week indicates that the rule would be used for approximately 1% of all reconstructed time/frequency values). Discussion ASL CE 6 on Higher Order Prediction This CE is now completes, and the Audio Subgroup approves it to be incorporated into the Study on PDAM text. ASL CE 7 on New Control Parameter for Entropy Coding The technical content of this proposal is minor and not controversial. Takehiro Moriya, NTT, stated that he did a cross check during the MPEG meeting and that it was successful. Audio Subgroup approves it to be 104 incorporated into the Study on PDAM text. Tillman Liebchen noted that he could integrate the technology into RM0 shortly after the close of this MPEG meeting. ASL CE 8 on Multichannel Extension for ALS During the meeting Tillman confirmed that when considering higher number of channels (e.g. higher than 8), the proposed technology continues to deliver increasing performance. The Audio Subgroup approved that this be incorporated into the Study on PDAM text. ALS CE 9 on floating point Approximate Common Factor. The technology promises to deliver up to 40% compression improvement relative to the existing floating-point compression. There was consensus on progressing this CE. ALS CE 10 on LMS Predictors The task group collected additional information during the week. The consensus of the Audio Subgroup is that this CE will be ongoing, that I2R will bring information on an integer implementation of the LMS predictor to the next meeting, and that all parties are encouraged to bring additional information concerning the performance and complexity of the proposed predictor and resulting system, relative to the current ALS predictor and system. The Audio Subgroup feels that this is promising technology that has demonstrated superior compression. SLS CE 4 Lazy Bitplane Coding The Audio Subgroup reviewed this work and accepted this CE as complete. The text for this CE will be incorporated into the Study on Document. The source code implementing CE 4 has already been integrated into the Reference Model. SLS CE 5 Alternate Error Mapping This fixes a potential quantization reconstruction divergence between encoder (with unconstrained AAC encoder) and deterministic SLS decoder. The Audio Subgroup Audio Subgroup approved that this be incorporated into the Study on PDAM text. SLS CE 6 Reduced Complexity of SLS (Lower Complexity IntIMDCT) This was discussed, considering issues both of complexity and accuracy. Ralf Geiger agreed to supply at the next MPEG meeting information on transform accuracy (as in the manner done in the “CE” that preceded RM0. A crosscheck on this CE was provided by I2R during the MPEG week. Position on US NB Comments The Audio Subgroup always desires to make the best use of technology that it has developed, and in this respect endorses that there be a “non-core” mode in the SLS specification. The Audio Chair notes that this was not a position of unanimous consensus. Jim Johnston, member of the US delegation, objected to this position, in that in his opinion, it does not represent an acceptable response to the US NB comment. Yuriy Reznik, RealNetworks, presented 11406 Yuriy A. Reznik Status of Performance and Complexity of Lossless Audio Coding Architectures This contribution contains a wealth of data concerning the performance and complexity of the various lossless coding architectures, and he highlighted some preliminary information on the performance and compression of the LMS predictor proposed by I2R. Later in the week the Audio Subgroup reviewed and revised the “Summary” section of this document. There was consensus on all of the bullet points, but performance figures are subject to revision. MPEG-7 Mattias Wien, Aachen, presented 11353 Holger Crysandt Verification Report of Core Experiment on Audio Rhythm Patterns The first contribution is a cross-check on an ongoing Core Experiment. It showed results identical to that obtained by FhG. This concludes the CE, and the Audio Rhythm Pattern descriptors will be incorporated into the PDAM text.
Gregiore Carpenter, IRCAM, presented 11313 Gregoire Carpentier, Jerome Proposal for a Core Experiment on Barthelemy WeightedScalesDS
105 This descriptor determines a base pitch, a transposing ratio per frequency sample and a vector of weights for use with the transposing ratio. This CE was accepted, and more information is expected at the next meeting. Spatial Audio Coding A workplan for the merger of the ctp and fhg systems was drafted. There was considerable discussion on the details of the listening test, particularly the criteria that the merged system must satisfy in order to become RM0. Symbolic Music Representation The SMR Task Group met in a plenary meeting during the whole day on Tuesday. The morning activity was spent to finalize the Test Cases. Test Case for Braille proposed by G. Nicotra and N. McKenzie, was discussed and finally approved in a slightly edited version. Further discussion took place on Test Case for requirement 31. Text has been amended and the final text and content were approved by the group. Discussion moved then to the finalization of the mathematical model inside the “Evaluation Model and Procedure” document. In particular, debate focused on the relative relevance to be given to MPEG integration requirements. After evaluation of different opinions and review of some expectations and heuristics on evaluations, a constant weight of 2/3 was included in the model. The SMR Evaluation Model and Procedure has been considered approved by the Task Group at this point, together with the Test Cases. An Excel sheet has been prepared to help self- assessment of proponents. During the Palma meeting some further discussion has been finally dedicated to the feedbacks, expressions of interest and contributions received by the Group so far, and to the expectations for the Call. The following day input document M11354 “MPEG-4 and SMR: report on available functionality for graphics” was presented and discussed at the SNHC plenary. Important suggestions and understanding were gained during this discussion with SNHC experts. Editing has been made on M11354 to reflect main conclusions, with the purpose of making this available to proponents as annex to the Evaluation document. Later on the current status of activity has been presented and discussed at the Audio plenary, where Paolo Nese, EPFL, presented 11307 Paolo Nesi, Giorgio Zoia, Proposed SMR Evaluation Model and Pierfrancesco Bellini, James Procedure Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier This document presents the process for evaluating the responses to the Call for Proposals for Symbolic Music Representation. The process consists of: proponents evaluating their own submission with respect to a very detailed list of requirements or desired behaviour MPEG experts evaluating the degree to which the submission is capable of being integrated into the existing MPEG framework of tools Computation of a single numerical Figure of Merit base on all evaluations. The evaluation is done in conjunction with a database of test cases, which will be available via FTP. The rest of the work on Wednesday has been mainly editorial. Final editing on the Evaluation document has been made first by James Ingram and Giorgio Zoia based on the decisions taken on Tuesday. Final proofreading was carried on by Kia Ng, Tillmann Weyde and Paolo Nesi. Scalable Speech and Music Coding There were several editing sessions on the draft CfI. At the final editing session there was considerable discussion on the form of the CfI, and there was lack of consensus on issuing the
106 CfI at this meeting. To insure that such issues would not further delay the CfI, a Workplan was drafted that clearly states what tasks must be completed to insure a adequate CfI and who would do the tasks, all of which should be completed prior to the next MPEG meeting.
Meeting deliverables
Press statement The Audio part of the press statement was prepared.
Dispositions of Comments There were no DoC to prepare. Responses to Liaison and NB comments There were no liaison responses. The responses to the NB comments were prepared and approved. Recommendations for final plenary The Audio recommendations were presented and approved.
Establishment of Ad-hoc Groups The following ad-hoc groups were established by the Audio subgroup: No. Title Mtg 6817 AHG on Audio Standards Maintenance No 6818 AHG on MPEG-7 Audio No 6819 AHG on Spatial Audio Coding No 6820 AHG on MPEG-4 Lossless Audio Coding Yes 6821 AHG on Symbolic Music Representation Yes 6822 AHG On Exploration of Scalable Audio and Speech Coding Yes Approval of output documents All output documents, shown in E, were presented in Audio plenary and were approved.
Future activities
Schedule of future meetings Ad Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting. Agenda for next meeting The agenda for the next MPEG meeting is shown in F
All other business There was none. Closing of the meeting The 70th Audio Subgroup meeting was adjourned Friday at 13:30.
107 Annex B Participants First Name Last Name Country Affiliation E-mail address Benjelloun Abdellatib FR France Telecom R&D Abdellatib.benjellountouiun@francetelecom.com Cotarmanac'h Alexandre FR France Telecom R&D alexandre.cotarmanach@francetelecom.com Jon Boley USA Univ. of Miami jdb@jboley.com Jeroen Breebaart NL Philips Jeroen.breebaart@philips.com Sang Bae Chon KR Seoul National Univ. strlen@acoustics.snu.ac.kr Kok Seng Chong SG Panasonic Singapore kschong@psl.com.sg Martin Dietz DE Coding Technologies diz@codingtechnologies.com Christof Faller CH EPFT Christof.faller@epfl.ch Bernhard Feiten DE Deutsche Telekom bernhard.feiten@t-systems.com Ralf Geiger DE FhG IIS AEMT ggr@emt.iis.fraunhofer.de Bernhard Grill DE FhG IIS grl@iis.fraunhofer.de Matthias Gruhne DE FhG IIS AEMT ghe@emt.iis.fhg.de Noboru Harada JP NTT n-haraca@theory.brl.ntt.co.jp Jürgen Herre DE FhG IIS hrr@iis.fhg.de Boehm Johannes CE Thomson Johannes.Boehm@Thomson.net James Johnston USA Microsoft jamesdj@microsoft.com Mi Young Kim KR Samsung Mykim2002@samsung.com Sang-Wook Kim KR Samsung swkim@samsungait.com SeungHynn Kim KR LG Electronics speedk@lge.com Kristofer Kjörling S Coding Technologies kk@codingtechnologies.com Tilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.de Han Gil Moon KR Seoul National Univ. fullmoon@acoustics.snu.ac.kr Takehiro Moriya JP NTT t.moriya@ieee.org Sua Hong Neo SG Panasonic shneo@psl.com.sg Paolo Nesi I UNIFI – DSI nesi@dsi.unifi.it Toshiyuki Nomura JP NEC t-nomura@da.jp.nec.com Takeshi Norimatsu JP Panasonic Norimatsu.takeshi@jp.panasonic.com Eunmi Oh KR Samsung sait@samsung.com Werner Oomen NL Philips werner.oomen@philips.com Hee-Suk Pang KR LG Electronics hspang@lge.com Pierrick Philippe FR France Telecom R&D pierrick.philippe@francetelecom.com Heiko Purnhagen S Coding Technologies hp@codingtechnologies.com Schuyler Quackenbush USA ARL srq@audioresearchlabs.com Susanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sg Jean Bernard Rault FR France Telecom R&D jeanbernard.rault@francetelecom.com Vijii Raveendian US Qualcomm vgi@qualcomm.com Yuriy Reznik USA RealNetworks yreznik@real.com Andreas Schneider DE Coding Technologies snd@codingtechnologies.com Alan Seefeldt USA Dolby ajs@dolby.com Jeongil Seo KR ETRI seoji@etri.re.kr Ralph Sperschneider DE FhG IIS ralph.sperschneider@iis.fraunhofer.de Naoya Tanaka JP Panasonic tanaka.naoya@jp.panasonic.com Mauri Väänänen FIN Nokia Res. Center mauri.vaananen@nokia.com Mark Vinton USA Dolby msv@dolby.com David Virette FR France Telecom R&D david.virette@francetelecom.com Ingo Wolf DE Deutsche Telekom WolfI@t-systems.de Lin Xiao SG I2R linxiao@i2r.a-star.edu.sg Rongshan Yu SG I2R rsyu@i2r.a-star.edu.sg Giorgio Zoia CH EPFL giorgio.zoia@epfl.ch List of Symbolic Music Representation Participants Paolo Nesi DSI, University of Florence Italy. Giorgio Zoia EPFL Switzerland. Pierfrancesco Bellini DSI, University of Florence Italy. Andrea Vallotti DSI, University of Florence Italy. Hartmut Ring Capella Germany. Hartmut Lemmel Capella Austria. Bernd Jungmann Capella Germany Neil McKenzie FNB Netherlands. Maurizio Campanai Exitech S.r.l/WEDELMUSIC Italy. James Ingram Germany. Jerome Barthelemy IRCAM France. Gregoire Carpentier IRCAM France. Kia Ng ICSRiM, University of UK. Leeds Tillman Weyde University of Osnabrueck Germany. Giuseppe Nicotra Arca Progetti Italy. Martin Russ British Telecom UK.
109 Annex C Audio Contributions and Schedule Time Agenda Item MPEG-2/4/7 SMR Number Title Source
Sunday 0900-1800 AHG on Symbolic Music Representation 11307 Paolo Nesi, Giorgio Proposed SMR Evaluation X Zoia, Pierfrancesco Model and Procedure Bellini, James Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier 0900-1100 AHG on Lossless Coding 11314 Noboru Harada, Proposal of CE for improved X Takehiro Moriya floating-point compression using ACFC (Approximate- Common-Factor Coding) in ALS (Audio Lossless Coding) 11347 Tilman Liebchen, Report on MPEG-4 ALS Core X Patrick Runge Experiment 8 (Multi-channel extension for ALS) 11382 Dong-Yan Huang, Proposal for Lossless Audio X Haibin Huang, Coding Rongshan Yu, Xiao Lin, Susanto Rahardja 11395 S. R. Quackenbush Cross-check on ALS Core X Experiment
1100-1600 AHG on Spatial Audio Coding 11202 Jon Boley Spatial Audio Coding X Listening Test Report- University of Miami 11215 Mark Vinton Testing Environment and Procedures for Spatial Coding X Performed at Dolby Laboratories 11263 Inseon Jang, Jeongil Spatial Audio Coding RM0 X Seo, Kyeongok Kang Selection Test Report - ETRI 11269 Masayuki Morimoto, Report on the Evaluation Hayato Tests for Spatial Audio X Coding Systems 11323 Naoya Tanaka, Report on the Listening Tests Takeshi Norimatsu for the Spatial Audio RM0 X Selection 11340 A. Hoelzer, C. Report on Spatial Audio Spenger, D. Weninger, Coding Subjective Tests at X J. Herre FhG Test Site 11381 Heiko Purnhagen, Spatial Audio Coding Kristofer Kjörling, Listening Test Site Report - X Werner Oomen CT/Philips
110 Time Agenda Item MPEG-2/4/7 SMR Number Title Source 11317 Kim Report on verification of test bitstream submissions to X Spatial Audio Coding RM0 test 11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding RM0 Se lection X Tests (lunch break) 11384 Juergen Herre Additional Information on Fraunhofer/Agere Spatial X Audio Coding Submission 11393 Kristofer Kjörling, Analysis of spatial evaluation Werner Oomen, Jeroen results X Breebaart 11403 Heiko Purnhagen, Additional Information on Kristofer Kjörling, CT/Philips Spatial Audio X Werner Oomen Coding Sys tem
1600-1800 AHG on Scalable Audio Coding 11251 Johnston CFI proposed to AGH on X Scalable coding 11370 Pierrick Philippe, Jean Contribution to requirements X Bernard Rault and use cases for Scalable Audio/Speech Coding
Monday 0900-1300 MPEG Plenary 1300-1400 Lunch 1400-1800 Audio Plenary Audio Chair Opening of the meeting
Administrative matters Approval of agenda Approval of 69th MPEG meeting X report 11200 Schuyler Quackenbush 69th MPEG Audio Subgroup X Report X Communications from the Chair - Review of Sun Chairs meeting Allocation of contributions to X agenda and schedule Joint meetings X Review of AhG reports X 11152 Wo Chang, Olivier AHG on MAF X Avaro 11171 Ralph Sperschneider AHG on Audio Standard X Maintenance 11172 Matthias Gruhne AHG on MPEG-7 Audio X 11173 S. Quackenbush AHG on Spatial Audio X Coding 11174 Tilman Liebchen AHG on MPEG-4 Lossless X Audio Coding 11175 Paolo Nesi, Giorgio AHG on Symbolic Music X Zoia Representation
111 Time Agenda Item MPEG-2/4/7 SMR Number Title Source 11176 Jim Johnston AHG on Exploration of Scalable Audio and Spee ch X Coding Task groups and mandates X National body comments 11226 A. G. Tescher for USNB Contribution: Issues X USNB for audio lossless coding 11227 A. G. Tescher for USNB Contribution: Fine- X USNB grain scalable audio codec 11228 A. G. Tescher for USNB Contribution: X USNB Preliminary comments on 14496-3:2001/PDAM 4& 5 11316 Kyuheon Kim KNB comments on MPEG-4 X BSAC multi-channel 1400-1600 Plenary discussions 11400 Andreas Schneider Proposed Addition to MPEG- X 2 AAC Corrigendum 11264 Jeongil Seo, Han-gil A New Cue Parameter for X Moon, Seungkwon Spatial Audio Coding Beack, Inseon Jang, Kyeongok Kang, Jinwoo Hong
1800- HOD Meeting
Tuesday 0900 Audio Plenary Audio Chair Outline plan for the day
0900-1200 ALS / SLS 11402 Yuriy A. Reznik, Revision of MPEG-4 ALS X Tilman Liebchen Core Experiment 7 11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher Predictor X Orders)
11377 Rongshan Yu Proposed WD changes for Lazy Coding for MPEG-4 X Audio Scalable Lossless (SLS) Coding 11379 Rongshan Yu Proposed changes for ISO/IEC 14496-3/PDAM5 X (Scalable Lossless Coding) 11383 Ralf Geiger Proposal for Reduced Complexity of SLS 11404 Yuriy A. Reznik Cross-Check of SLS CE4 X ( Lazy Bitplane Coding)
112 Time Agenda Item MPEG-2/4/7 SMR Number Title Source 11346 Tilman Liebchen Proposed Text of Study on X ISO/IEC 14496- 3:2001/PDAM4 (Audio Lossless Coding)
1130-1300 Requirements, Systems, Audio DRM functionality for MAF-MP
1300-1500 Lunch
1500-1630 MPEG-4 11217 Eunmi Oh, Miyoung Fine Grain Scalability in X Kim MPEG-4 BSAC multi- channel audio coding
1630-1730 Req at Audio New audio profile, CfI on Scalable Coding / use cases 11310 Kristofer Kjörling Additions to the profiles X under consideration 11312 Kristofer Kjörling, Company support for the X Werner Oomen, proposed High Efficiency Takeshi Norimatsu, AAC v2 Profile Toshiyuki Nomura, Jean-Bernard Rault 11251 Johnston CFI proposed to AGH on X Scalable coding 11370 Pierrick Philippe, Jean Contribution to requirements X Bernard Rault and use cases for Scalable Audio/Speech Coding
1730-1830 Sys at Audio Timestamps and Backward-compatible (Alexandre Audio Decoders from Systems)
1930-2200 Social
Wednesday 0900-1100 MPEG Plenary
1100-1200 MPEG-7 11313 Gregoire Carpentier, Proposal for a Core X Jerome Barthelemy Experiment on WeightedScalesDS 11353 Holger Crysandt Verification Report of Core X Experiment on Audio Rhythm Patterns 11392 Heiko Purnhagen, Proposed corrigenda to X Werner Oomen AMD2, (parametric) 11380 Kristofer Kjörling, Working draft proposal for PS X Heiko Purnhagen, conformance Andreas Schneider, Werner Oomen
113 Time Agenda Item MPEG-2/4/7 SMR Number Title Source 11389 werner oomen, Frans Working draft proposal for X de Bont, Erik SSC conforma nce Schuijers
1230-1300 SMR 11307 Paolo Nesi, Giorgio Proposed SMR Evaluation X Zoia, Pierfrancesco Model and Procedure Bellini, James Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier
1300-1500 Lunch
1400-1500 Requirements, Systems, Audio MPEG-21 and MAF
Lossless Coding Review and resolve CE issues X
Thursday
0900 Audio Plenary Audio Chair
0900-1130 Scalable Audio CfI
1130-1200 MPEG-4 Review and resolve BSAC issues X
1200- Spatial Audio Coding Workplan for RM0 X
1300-1500 Lunch
Scalable Audio CfI
General 11341 Alexandre MPEG General Audio Codecs X Cotarmanac'h, Pierrick Philippe
NB Comment Responses X
Lossless 11406 Yuriy A. Reznik Status of Performance and X Complexity of Lossless Audio Coding Architectures
1730-1900 Audio Plenary Status for Chairs Meeting 1800- Chairs Meeting
Friday
0800-0900 Scalable Audio CfI
0900-1300 Audio Plenary Report on Chairs meeting and Audio Chair outline of plan for the day Discussion of unallocated contributions Meeting deliverables Press statement Dispositions of comments
114 Time Agenda Item MPEG-2/4/7 SMR Number Title Source Responses to NB comments Liaison statements Recommendations for final plenary Establishment of new Ad-hoc groups Approval of output documents Future activities Agenda for next meeting A.O.B. Closing of the Audio meeting
1300-1400 Lunch
1400- MPEG Plenary
115 Annex D Task Groups 1. MPEG-4 Audio Issues Chair: S. Quackenbush Mandates: 1.1. Review contributions 1.2. Discuss proposed profile for HE-AAC 1.2.1. Draft amendment text if appropriate 1.3. Review Proposed changes in MPEG-4 BSAC multi-channel audio coding 1.4. Review and respond to KNB comment 1.5. Review any proposed new edition documents
2. Lossless Coding Chair: Y. Reznik Mandates: 2.1. Review contributions 2.2. Review and respond to USNB comment 2.3. Review CE status 2.4. Review and revise latest performance results 2.5. Produce study on documents as appropriate 2.6. Produce workplan documents as appropriate
3. MPEG-7 Chair: Matthias Gruhne Mandates: 3.1. Review contributions 3.2. Produce Text of 15938-4:2002/PDAM 2, High-Level Description Extensions 3.3. Produce appropriate workplan documents
4. Spatial Audio Coding Chair: S. Quackenbush Mandates: 4.1. Review submissions 4.2. Review recommendations in AHG report 4.3. Produce Report on Selection Test for Spatial Audio Coding System RM0 4.4. Produce workplan for RM0
5. Symbolic Music Representation Chair: P. Nesi, G. Zoia Mandates: 5.1. Review contributions 5.2. Produce Procedures for the Evaluation of Symbolic Music Representation
6. Scalable Speech and Audio Coding Chair: J. Johnston Mandates: 6.1. Review and respond to USNB comment 6.1.1. Review contributions 6.2. Recommend next steps in exploration
116 Annex E Output Documents No. Title TBP Available 13818-7 MPEG-2 AAC Study on 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness No 04/10/22 6789 correction” 14496-3 MPEG-4 Audio 6790 14496-3:2001/AMD 2:2004/DCOR 1 (SSC) No 04/11/05 Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new No 04/11/05 6791 audio profiles and BSAC extensions. 6792 Study on 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) No 04/10/22 Study on 14496-3:2001/PDAM 6, Lossless coding of 1-bit oversampled No 04/10/22 6793 signals Status of Performance and Complexity of MPEG Lossless Audio No 04/11/05 6794 Coding Architectures 6795 Draft 3rd Edition of 14496-3 No 04/10/22 6796 Workplan for Audio Lossless Coding (ALS) No 04/10/22 6797 Workplan for Scalable Lossless Coding (SLS) No 04/10/22 6798 Proposed Clarification of Audio Codec Timestamp Behavior No 04/10/22 14496-4 MPEG-4 Conformance 6799 Working Draft of High Quality Parametric Audio Conformance No 04/10/22 6805 Working Draft of Parametric Stereo Conformance No 04/10/22 6806 Working Draft of additional test sequences for BSAC Conformance No 04/10/22 6807 Working Draft 0.1 AudioBIFS v3 Conformance No 04/10/22 6808 Workplan for Audio contribution to MPEG-4 Conformance No 04/10/22 6809 Status of MPEG-4 Audio Conformance No 04/10/22 15938-4 MPEG-7 Audio Working Draft of 15938-4:2002/PDAM 2, High-Level Description No 04/10/22 6810 Extensions 6811 Workplan for Weighted Scale DS No 04/10/22 Music notation 6812 SMR Evaluation Model and Procedure YES 04/10/22 Spatial audio coding 6813 Report on Spatial Audio Coding RM0 Selection Tests No 04/10/22 6814 Workplan for MPEG-4 Spatial Audio Coding No 04/10/22 Scalable Speech and Audio Coding 6815 Workplan on CfI on Scalable Speech and Audio Coding No 04/10/22 Promotion 6816 MPEG General Audio Codecs History and Tools No 04/10/22
117 Annex F Agenda for the 71st MPEG Audio Meeting
Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Approval of agenda 2.2. Approval of 70th meeting report 2.3. Communications from the Chair 2.4. Allocation of contributions 2.5. Joint meetings 2.6. Review of AhG reports 2.7. Review of task groups and mandates 2.8. Received national body comments and liaison matters 2.9. Plenary issues 3. Task group activities 3.1. MPEG Maintenance 3.2. MPEG-4 Lossless Coding 3.3. MPEG-7 Audio 3.4. MPEG-Music Player Application Format 3.5. Spatial Audio Coding 3.6. Symbolic Music Notation 3.7. CfI on Scalable Speech and Audio Coding 4. Discussion of unallocated contributions 5. Meeting deliverables 5.1. Press statement 5.2. Dispositions of comments 5.3. Responses to NB comments 5.4. Responses to Liaison statements 5.5. Recommendations for final plenary 5.6. Establishment of new Ad-hoc groups 5.7. Approval of output documents 6. Future activities 6.1. Agenda for next meeting 7. A.O.B. 8. Closing of the meeting
118 119 Annex 10 Report of SNHC meeting
Source: Mikaël Bourges-Sévenier (Mindego Inc.)
Opening of the Meeting
Approval of the agenda Goals for the week The goals of this week are: Review on-going AFX CE and explorations Review GFX proposals to answer last meeting's questions on the WD Issue GFX CD if technology is stable
120 Schedule Time Monday Tuesday Wednesday Thursday Friday :00 08 :30 :00 11206 AFX CE review Document review 09 :30 11409 Presentation review MPEG Plenary Document number attribution :00 10 11205 … last items... :30 :00 11194 11240 AFX explorations review 11 MPEG Plenary :30 :00 11196 11354 12 :30 :00 13 Lunch break Lunch break Lunch break Lunch break :30 :00 11272 11238 GFX CD discussion and 14 Lunch break :30 review :00 Roll call, agenda 11423 15 :30 11203 :00 11207 16 :30 11210 :00 17 11222 :30 11197 :00 18 Liaison MPEG Plenary :30 Demos in Systems :00 19 :30 :00 20 Social event Chairs :30 Chairs :00 21 :30 :00 22 :30
121 Allocation of joint meetings Sub-Groups Monday Tuesday Wednesday Thursday Friday Systems Requirements MPEG-7 Video Video/3DAV MDS
Rooms allocation SNHC Eros Systems Discobolos Requirements Chairs/HoD/Liaisons Allocation of contributions
N° Title Schedule Activity D1 Monday D1 MPEG Plenary D1 09h00- MPEG Gen. 14h00 Report of AhG on MPEG-J extensions Mikaël Bourges- Sévenier SNHC D1 15h00- SNHC Gen. 16h00 Agenda, FAQ, Web site Mikaël Bourges- 15:00 Sévenier 11203 Implementation issues in MPEG-4 Reference Software Marius Preda Son Tran Francoise Preteux 11207 MPEG-4 Player 3D @ Work: demonstration of a weather forecast Marius Preda 15:30 application Son Tran
122 N° Title Schedule Activity Francoise Preteux SNHC D1 16h00- AFX 18h30 11210 Results on the CE for multi-resolution footprint-based representation Jerome Royan 16:00 Patrick Gioia 11222 New proposal for multi-resolution footprint-based representation Jerome Royan 16:30 Patrick Gioia 11197 CE - Shadow: Final Results on Reference Software Implementation Helge Drumm 17:00 Thomas Di Giacomo Systems D1 18h30- Graphics 19h30 Demos: INT and FT 18h30 D2 Tuesday D2 SNHC D2 9:00 – 13:00 AFX 11206 XMT encoding issues for BBA Marius Preda 9:00 Octavian Folea Françoise Preteux 11409 BBA implementation into AFX encoder: Donation to ISO Marius 11205 Marius Preda Enriching stream control in BBA Francoise Preteux 11194 CE Report for Physically-Based Animation of Cloth with Thomas Di Giacomo 11:00 PhysicsShapeProperties node Nadia Magnenat- Thalmann Marius Preda Francoise Preteux 11196 Proposal of a PhysicsBoneProperties node Thomas Di Giacomo Nadia Magnenat- Thalmann Marius Preda Francoise Preteux SNHC D2 14:00 – GFX 17:00
123 N° Title Schedule Activity 11272 Comment on MPEG-J extension for rendering Itaru Kaneko 14:00 Mark Callow 11423 Architecture updates and considerations for MPEG-4 Part 21 Mikael Bourges- 15:00 Sevenier D3 Wednesday D3 MPEG Plenary D3 09h00- MPEG Gen. 11h00 SNHC D3 11h00- SNHC Gen. 13h00 11238 Multiple image view synthesis for virtual viewpoint rendering Eddie Cooke 11:00 11354 MPEG-4 and SMR: report on available functionality for graphics 12:00 11240 Predictive compression of dynamic 3D meshes Aljoscha 12:30 SNHC D3 14h00-16:00 AFX AMD1 + COR1 review 15:00 D4 Thursday D4 SNHC D4 9h00-13h00 AFX AFX CE review 9:00 AFX explorations review 11:00 SNHC D4 14h00- GFX 18h00 GFX discussions and review D5 Friday D5 SNHC D5 9h00-11h00 SNHC Gen. Document number attribution 9:00 MPEG Plenary D5 14h00- MPEG Gen. 22h00
124 General issues
Web site The SNHC Web site is http://www.sait.samsung.co.kr/snhc/
AFX Reference software The AFX Reference Software has been transferred to NIST and is available via CVS at 1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php 2. :pserver:
The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX. http://www-artemis.int-every.fr/~preda showcases many technologies developed by SNHC. At this meeting, it was decided to update this web page with demonstrations companies will provide. It would be preferable to also provide our Player3D in binary form so that non-MPEG interested parties can play those contents. However, we have to check with ISO if this is possible. AFX encoder and other tools New tools added BBA encoder complements AFX encoder features, see section . Miscellaneous Node templates up to v.7 uploaded. It contains node definitions of MPEG-4 Part 11 AMD4 and MPEG-4 Part 16 AMD1. XMT-A Schema updated with node definitions up to templates v.7 MPEG-J updated with node definitions up to templates v.7 Standards from SNHC In red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.
Std Pt Edit. Project Description CfP WD CD FCD FDIS PDAM FPDAM FDAM DCOR COR 4 11 2003 Amd.4 XMT and MPEG-J 03/12 04/07 05/01 extensions 4 16 2004 Cor.1 AFX Corrigendum 04/03 04/07 05/01 4 16 2004 Amd.1 AFX extension 03/07 04/07 05/01 05/07 4 21 2005 MPEG-J extensions 03/12 04/07 04/10 05/01 05/07 for rendering
125 AFX activities
Specifications updates The list of modifications for existing specifications handled by SNHC is as follows. Part 16/COR1 None Part 16/AMD1 National Body comments from the PDAM ballot have been answered in document w6747. Part 21/CD 1.0 Architecture has been updated and questions left in the working draft have been answered. The text is in w6751. Conformance and reference software M11203 – Implementation issues in MPEG-4 Reference Software Son Tran solved many bugs in IM1. This contribution is only informational for SNHC as these modifications are handled by Systems group. M11207 – MPEG-4 Player 3D INT made an impressive demonstration of a weather forecast application using Player3D (AFX reference software) with technologies such as BIFS, AFX, MPEG-J. SNHC is thrilled to see a Player3D that is now suitable for demonstration purposes.
The demonstration is available at http://www-artemis.int-every.fr/~preda/ Core experiments M11210 – Results on the CE for multi-resolution footprint-based representation A 2D ½ representation for buildings is transmitted instead of a 3D representation. Modeling of the buildings uses a grammar to describe roofs, windows etc. During rendering, each node in the PBTree has a geometric error to determine if extra info is needed to refine the node. For texture mapping, metadata such as (number of floors, height of first floor etc.) are used to add windows and other exterior elements of a building.
Results The CE shows the needs for a specific representation for buildings that is not available in MPEG-4 specification. It also shows that view-dependent multi-resolution streaming defined within AFX specification works. The technology demonstrates a linear decoding/reconstruction time vs. size of the building representation. The test was carried over city of Rennes, France, with real-time progressive reconstruction of 35000 buildings. M11222 – New proposal for multi-resolution footprint-based representation Multi-resolution building representation was proposed at the previous meeting and the following issues were raised Not generic enough No access to bounds of the geometry for collision detection or other applications
The proposal addresses these questions. A new decoder specific info for this new AFX decoder is proposed. It is defined so that footprint is separated from other descriptive information that may be useful for one application or another. Likewise, the building parameters refer to the VRML/BIFS
126 node ID so information reconstructed from the decoder can update the VRML node and hence be used for collision detection (or other behaviors defined in VRML/BIFS).
Resolution SNHC VM is updated to record the technology. CE continues on integration of the technology within an MPEG-4 scene and within Player3D. M11197 – CE shadow: final results on Reference Software implementation For using this node, the scene graph must implement all traversal operations: identification of all nodes in the graph, go to left/right child, go to parent node etc… The technology has been implemented into the reference software but the code is not yet available in CVS.
Resolution Close the CE. Techno is mature and go in the VM and later to AFX AMD2 when it will start. Integrate the technology into CVS. M11194 – CE Physically-based animation of cloth The CE was started at the 68th meeting in Munich. A node for mass-spring systems is proposed. A spring is a link between 2 masses, each spring has a stiffness and a damping factor.
Experts in the field think that it is a simplistic way to represent mass-spring systems. For example, topology information may be useful but is not provided.
The issue is that this generic description doesn't guarantee a consistent behavior across players. Often, one creates such physics model and fine tune for a physics engine on a player. It seems that unless we mandate an algorithm on the player side, effects cannot be guaranteed.
How does collision detection in the standard work with this proposal?
Resolution Mass-spring systems seem working fine for specific class of models. The models need to be fine- tuned to produce the correct animation and it is often related to the algorithm used in the player. CE continues and should provide more results on the possibilities of this model and in particular that guarantees similar animations across players. M11197 – Proposal of PhysicsBoneProperties node Ragdoll dynamics is used heavily in games today. The PhysicsBoneProperties node link a bone (in the BBA tool already in AFX) to its physical properties (mass, damping, stiffness, external force applied to the bone).
Resolution Add to CE on Physics-based animation to study integration with BBA. Demo session in Systems SNHC demonstrated the following applications in Systems hosted demo session: Demonstration of Weather forecast. Demonstration of city navigation BBA updates M11206 – XMT encoding issues for BBA Bugs corrected in XMT-A:
127 As
Resolution Accepted M11197 – BBA implementation into AFX encoder The AFX encoder in the reference software has been updated with BBA stream generation directly from XMT encoding definition. The AFX encoder documentation has been updated.
Notes AFX encoder tool supports: BBA, interpolator compression, 3DMC encoding directly from XMT And soon (next meeting?): wavelet subdivision surfaces and MeshGrid
Resolution Accepted M11197 – Enriching stream control in BBA Currently you can play BBA stream but it is not possible to use VCR-like control (play/pause/rewind etc.). It is proposed to add media capabilities following VRML definition of media nodes such as MovieTexture to SBVCAnimation node. A new field activeUrlIndex is added whose semantic is to be used to select pre-built animations (e.g. walking, running animations for a virtual character).
Discussion Adding the possibility to choose between pre-built animations is useful but it is not clear how transitions between animations are controlled. Translations are linear interpolations, rotations uses slerp. transitionTime field is added to specify the time between transitions. BIFS also provides MediaControl node, which can work with the new definition.
Resolution Since a FNB comment requests addition of this node in AFX AMD1 and the node is implemented, we accept it in AFX AMD1. Explorations M11238 – Multiple image view synthesis (MVS) for virtual viewpoint rendering From arbitrary views from any number of video inputs (camera setup independent), a 3D rendering of an object is created based on the viewpoint of the user. The virtual views contain holes i.e. missing information that need to be filled using algorithms proposed in this document.
The technology has the following advantages: Modular: any number of reference images/cameras Flexible: 3D scene surface definition
128 This method needs intrinsic camera parameters (i.e. property of the CCD chip) as well as extrinsic ones (i.e. where the camera is in the world and focal plane). These parameters must be carried along with the video stream as they may change over time; having them in a separate stream would make management more complex.
Resolution In AFX, we have a similar technology called Depth Image Based Representation (DIBR). The exploration continues in order to explore how DIBR can be used to render MVS and if any tool is missing. M11354 – MPEG-4 and SMR: functionality for graphics So far, CfP on SMR has been issued to define a format to describe music notations, how it can be integrated in MPEG-4/-7/-21, and in sync with other media.
SMR needs the following features SMR decoder must estimate the notation based on what is played. SMR decoder receives AU containing parts of the score. The user may view parts of the score, the user may interact with playback, notes, transpose score etc… 2D graphics for music symbols
BIFS may be sufficient and the group is analyzing if there are other possibilities. Display of notations, some animations may be rather demanding for BIFS so the exploration to new possibilities such as GFX.
Resolution None, this discussion was to help SMR group understands the different rendering possibilities in MPEG-4. M11240 – Predictive compression of dynamic 3D meshes (D3DMC) This document shows tests made with MPEG-4 tools on dynamic 3D meshes, using 3DMC, textures H.264/AVC, and for rendering: view-dependent texture mapping in AFX.
The tests were run with different quality parameters to compare existing solutions and D3DMC: 3D mesh resolution (number of vertices), number of video textures, video quality, and mesh quality.
3DMC tool (ISO/IEC 14496-2) is for static meshes but here the idea is to use a sequence of static meshes and send a predictively encoded stream.
Test sequences: Microsoft Chicken crossing (400 time-consistent meshes with 3030 vertices). The test is made for different group of meshes (i.e. 1 intra every N frames). Doo Young 3DVO, 220 time-consistent meshes with 1000 vertices
The results show that D3DMC significantly outperforms 3DMC.
Resolution Start CE to validate these results and compare to coordinate interpolator compression tool and BIFS-Anim tool which is used for streaming data. Explore for other attributes like colors, textures coordinates…
129 Goal: explore compression of static and dynamic meshes.
MPEG-4 Part 21
M11272 – Comments on MPEG-J extension for rendering In Japan, each mobile manufacturer provides its own API. Each API provides mostly the same features. A content creator makes applications and provides them for each API/format.
Needs: Vendors need to have some way to protect their content uniquely (e.g. it works on player A but not on player B) -> out of scope of MPEG-4 Part 21 Authoring development platform issues? We don't understand what the issues are. Beware of Java profiles used to develop Graphics API => try to be independent of the Java profile M11423 – Architecture updates and considerations for MPEG-4 Part 21 Decoder Add a state interface for the state of the decoder getCurrentMediaTime() returns in ms. getCompositionBuffer()
Architecture is better that in the WD as it allows more flexibility. It is also more efficient because it enables the Java side to have minimal work and the native side to do the heavy work in software or in hardware.
The proposal focuses on JSR-239, the architecture must be updated with JSR-184, as in the WD.
Resolution Get rid of synchronization and use media time only (no equation) About synchronization of AV clock and internal clock, we believe at this time that it is an implementation matter. The Java binding to OpenGL ES must be proposed to JSR-239 expert group for review and comments. Discussion Timing and synchronization In this discussion we try to define the requirements for timing and synchronization, for lip-sync applications, graphics-video sync applications, and so on.
Q: What is the jitter (delay between Java call and response from native) on media time? A: Current estimate of implementers is that crossing JNI could be up to 10ms in worst case scenario. This heavily depends on JVM implementation, CPU etc., and on the implementation of the player on the terminal.
Q: Is it necessary to have the same frame-rate for video and graphics? A: No unless the graphics rate is unacceptably slow.
Q: Can you tell the renderer to render at a given time? A: You know the start time to render a frame. You know also the video frame rate, so the application knows how long it has to complete a video frame. Typically, it is content-dependent
130 how long it takes to render a graphics frame. So it depends on the cleverness of the application to take into account these time delays. Therefore, do we leave it as implementation specific (e.g. to the MPEGlet) or do we specify it in this spec (e.g. in MPEG-J)? Answer: we leave it implementation specific and invite proposals/comments if inadequate.
Note: it is possible to query the media time from the decoder (getMediaTime() method) at any time during the lifecycle of an MPEGlet.
Resolutions of SNHC
Output documents
No. Title TB Availab Editor P le 14496-16 MPEG-4 Animation Framework eXtension (AFX) 6747 Study text of DoC on ISO/IEC 14496- No 04/10/22 Marius Preda 16/PDAM1 6748 Study text on ISO/IEC 14496-16/PDAM1 No 04/10/22 Marius Preda 6749 AFX CE description No 04/10/22 Marius Preda 6750 AFX VM 16.0 No 04/10/22 Marius Preda
14496-21 MPEG-J extensions for rendering 6751 Text of ISO/IEC 14496-21 CD Yes 04/11/05 Mikaël Bourges- Sévenier Resolutions MPEG-4 Part 16 The SNHC subgroup would like to express its gratitude to all reviewers who submitted comments on AFX PDAM1. The SNHC subgroup acknowledges demonstration of new applications using 3D graphics technologies developed by SNHC and would like to encourage companies using these technologies to provide demonstrations. Part 21 The SNHC subgroup recommends approval of MPEG-4 Part 21 "GFX" CD. By making it publicly available, the SNHC subgroup wishes to gather a wider industry support. The SNHC subgroup recommends a Java binding to OpenGL ES contained in GFX CD text. It will be submitted to JSR-239 expert group for review and comments. Establishment of SNHC Ad-Hoc groups
No. Title Meetin Chair g 6752 AhG on AFX documents, CEs, and 05/01/1 Marius Preda software 6 6753 AhG on MPEG-J extensions for 05/01/1 Mikaël Bourges- rendering 6 Sévenier
131 N6752 Ad Hoc Group on AFX documents, CEs, and software Mandates: 1. Maintain and edit SNHC VM document. 2. Coordinate SNHC CE and EE activities. 3. Coordinate collection of demonstration data set of SNHC tools Chairman: Marius Preda (INT) Co-chairs: Mahnjin Han (Samsung AIT) Patrick Gioia (France Telecom R&D) Duration: Until 71th meeting Meetings Sunday before 71th meeting Reflector: mpeg-snhc AT gti. ssr. upm. es Subscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message “subscribe” as the first line in the body.
N6753 Ad Hoc Group on MPEG-J extensions for rendering Mandate: 1. Maintain and edit 14496-21 (GFX) documents 2. Harmonize Java bindings to OpenGL ES with JSR-239 expert group 3. Investigate GFX implementation in IM1 Chairman: Mikaël Bourges-Sévenier (Mindego Inc.) Co-chairs: Vishy Swaminathan (Sun Microsystems) Itaru Kaneko (Waseda University) Duration Until 71th meeting Meetings: Sunday before 71th meeting Reflector: mpeg-j AT it-aru. com Subscribe: Send an email to mpeg-j-request AT it-aru. com with the message “subscribe” as the first line in the body.
Closing of the Meeting See you in Hong-Kong in January.
132 Annex 11 Report of Integration meeting
Source: Jean-Claude Dufourd, ENST
Opening of the Meeting
Allocation of contributions Monday Plenary Marius Preda 11169 Mahnjin Han AHG on AFX documents, CEs, and software Patrick Gioia Joint with MDS on Wednesday 16:00 – 17:00 11254 Thomas de Martini et al Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software) 11211 Thomas de Martini et al Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference Software 11261 Shane Lauf et al IPMP DIDL Reference software contribution Teemu Saarinen Software implementation of a light-weight REL based DRM system for video streaming to 11270 Artur Lugmayr mobile devices Frederik De Keukelaere 11336 Contribution to DID conformance Rik Van de Walle 11218 Hyuk-Min Kwon et al Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & AA. SuSan Im SangHoon Oh 11276 The reference conformance test model(based on Mpeg-21 dii&didl) SeokHoon Kim Spencer Cheng Integration Plenary on Thursday 14:00 – 16:00 11177 Jean-Claude Dufourd Initial Reference Software for LASeR and SAF 11361 Jean-Claude Dufourd LASeR/SAF reference software: codec aligned with study 11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance Son Tran 11203 Marius Preda Implementation issues in MPEG-4 Reference Software Francoise Preteux Gregoire Pau 11345 MPEG-21 binarisation status with MPEG-7 BiM reference software Claude Seyrat
List of standards under development Std Pt Edit. Project Description CfP WD CD FCD FDIS 4 4 200x Cor.1 Visual Bitstreams 04/03 04/10 05/04 4 4 200x Amd.1/Cor.1 FGS Bitstreams 04/10 05/04 4 4 200x Amd.9 AVC FRExt 04/03 04/07 05/01 05/07 Conformance 4 4 200x Amd.10 New Levels of SP 04/07 04/10 05/04 Conf 4 4 audio conf 4 5 2004 Amd8 AVC FRExt + Audio 04/07 05/01 05/07 SBR Ref Soft 21 8 200x 1st Ed. Reference software 03/03 04/03 05/01 05/07 21 14 200x 1st Ed. Conformance 03/10 05/01 05/07 05/12 Latest references
Project P. Standard Issue No. MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4 02/12 Awaji N5457
133 Conformance 2nd Ed.) MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio 02/07 N5083 and Streaming Video Profile) Klagenfurt MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368 MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711 MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865 MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475 MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07 N4937 Klagenfurt Request documents
MPEG-2 Reference Software The text of the second edition is ready, the editor requests a two month editing period for gathering the software and checking everything once more.
MPEG-4 Conformance (14496-4)
11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance This document presents a view of the audio BIFS conformance. It signals that there is no conformance for AudioBuffer. More higher-quality sound material is needed. 3 test scenarios are proposed, no bitstreams were generated yet. Subjective testing is discussed. The proponents are asking for help.
More work was done by Samsung on test sequences for BSAC to test PNS.
The editor for Audio conformance suggests to consider a new edition for MPEG-4 conformance.
MPEG-4 Reference Software (14496-5) It is suggested to consider a new edition for MPEG-4 reference software.
Son Tran 11203 Marius Preda Implementation issues in MPEG-4 Reference Software Francoise Preteux Some bugs were found in the MPEG-4 Systems reference software: - rotation parameter in an MPEG-J call - parser of BIFS encoder - missing instruction in the mux parser for video Fixed files are attached to the document. The proponents recommend to update the reference software.
MPEG-21 Conformance REL conformance will be restricted to a realistic use case.
Frederik De Keukelaere 11336 Contribution to DID conformance Rik Van de Walle
134 This results from the discussions in the plenary in Redmond. Ghent Univ. has packaged their 40+ examples of the reference software. The Integration subgroup wishes to thank Ghent University for their diligence in presenting a solution to this issue.
11276 Su San Im et al The reference conformance test model(based on Mpeg-21 dii&didl) A selection of this contribution was presented, the part suggesting a methodology to create a conformance test suite for MPEG-21 DIDL. This is going into an output document from Integration, methodology under consideration for the creation of MPEG-21 conformance.
MPEG-21 Reference Software
11254 Thomas de Martini et al Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software) These preliminary comments have been discussed and a study of the reference software document, without the actual software, will be issued as an output of this meeting.
Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference 11211 Thomas de Martini et al Software This constitutes a workplan to be fulfilled by ContentGuard, Inc. over the next two meetings. This requires a delay by one meeting on the reference software (FDIS by April).
11261 Shane Lauf et al IPMP DIDL Reference software contribution Presentation and demo of the software contribution.
Software implementation of a lightweight REL based DRM system for video streaming to 11270 Teemu Saarinen et al mobile devices Presentation and demo of the software contribution. This is a candidate for inclusion in the reference software, so it will go to the Study document.
11218 Hyuk-Min Kwon et al Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & AA. Summary of the status of the DIA software modules: many modules were updated.
135 Resolutions of Integration
Resolutions 1. The Integration subgroup recommends to start the work on a new edition of MPEG-4 conformance. 2. The Integration subgroup recommends to start the work on a new edition of MPEG-4 reference software. Documents
MPEG-2
No. Title TBP Available 13818-5 MPEG-2 Reference Software 6737 ISO/IEC 13818-5 MPEG-2 Reference Software 2nd edition Y 04/12/22
MPEG-4
No. Title TBP Available 14496-4 MPEG-4 Conformance 6738 Text of ISO/IEC 14496-4:200x/DCOR1 Visual Bitstreams N 04/10/22 Text of ISO/IEC 14496-4:200x/Amd1/DCOR1 FGS and Studio N 04/10/22 6739 Bitstreams 6740 Study of ISO/IEC 14496-4:200x/FPDAM9 AVC FRext Conformance N 04/11/30 DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple N 04/11/30 6741 Profile Conformance ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile N 04/11/30 6742 Conformance
No. Title TBP Available 14496-5 MPEG-4 Reference Software Study of ISO/IEC 14496-5:200x/PDAM8 AVC FRext Reference N 04/11/30 6743 Software
MPEG-21
No. Title TBP Available 21000-8 MPEG-21 Reference Software 6744 Draft DoC on ISO/IEC 21000-8 FCD MPEG-21 Reference Software N 04/10/22 6745 Study of ISO/IEC 21000-8 FCD MPEG-21 Reference Software N 04/10/22
No. Title TBP Available 21000-14 MPEG-21 Conformance 6746 Methodology under consideration for MPEG-21 conformance Y 04/10/29 6867 WD4.0 of MPEG-21 Conformance N 04/10/22
136 137 Annex 12 Report of Test meeting
Source: Tobias Oelbaum
Opening of the Meeting
Goals for the week The goals of this week are: Discussion about procedure for visual quality evaluation for SVC CE1 Conduction of the SVC CE1 test Processing of the results of the SVC CE1 tests; documentation of the results and the test procedure Review and discuss input documents on objective quality metrics for impairment introduced by watermarking Discussion on the validity of the “1sigma” method as a good approximation of the 95% confidence intervall. Joint Meetings The following joint meetings were scheduled with Video - SVC CE1 testing with Requirements – Video PAT Evaluation Contributions 11195 Objective Impairment Test Method for Video PAT Evaluation 11201 The Guideline for Selection of Test Stimuli in Evaluation of Video Watermarking 11333 Suggested Test Method for SVC CE Visual Tests 11360 Subjective evaluation of CE1 results 11372 Discussion on evaluation criteria for experts viewing tests in SVC CE1 11429 Comparison of statistical methods for assessment of subjective video quality
Test Activities
SVC CE1 testing After discussion at the SVC AHG meeting it was decided to do a visual quality evaluation of the proposals to CE1. It was agreed to perform this quality evaluation on a reduced set of sequences (4 out of 8) and to do this quality evaluation using the SSMM (Single Stimulus Multi Media) method as used in the SVC CfP. The reason for selecting this method instead of the proposed expert testing method was the strong requirement of the group to have an indication about the size of the quality gap between the different proposals. Results were presented at a joint meeting with Video and are documented in N6736. A detailed description of the performed visual quality evaluation is documeted in N6736. MPEG-21 Video PAT Evaluation 11195 Proposes objective quality evaluation method for impairment introuced by watermarks. Though interesting ideas for the subjective evaluation of watermarks are presented, the
138 proposed method is not evaluated so far and references to similar work in this areas are not available. Encouraged to present the proposal in an extended form atthe next meeting. 11201 Proposes a guideline for the selection of test stimuli for the evaluation of video watermarking. Guideline is based on objective image properties such as amount of motion or complexity of the image. Proponent is encouraged to present his method again with supporting results that prove the efficiency of the idea presented. Statistical Analysis of Test Results 11429 Compares different statistical methods to calculate a 95% confidence interval between two different coding methods under evaluation. Proposal seems to support the assumption that the “1sigma” method gives a good approximation of the 95% CI. Encouraged proponent to perform a deeper analysis based on available test data.
Test Resolutions
Output Documents N6737 Report of the Subjective Quality Evaluation for SVC CE1 AdHoc Groups No AdHoc Groups have been set up at this meeting. Resolutions The Test subgroup would like to thank Vittorio Baroncini for providing a high end PC for the subjective quality evaluation and help in the preparation of the subjective quality evaluation.
139 Annex 13 Report of ISG meeting
Source: ISG Chair Editor: Marco Mattavelli (EPFL)
Overview The main work items of the Implementation Studies Subgroup in Palma de Mallorca are: 1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket. 2. The planning and extension of supported features for the integrated framework, putting together in a single application MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.
Input contributions w.r.t. the above items are summarized according to the following table:
Contributions
M11153 “ Report of the AHG on MPEG-4 Marco Mattavelli EPFL, Robert Turney Part 9 "Reference Hardware Xilinx Research Lab. Description" M11459 2-D IDCT Hardware Accelerator A. Navarro, A. Silva, O. Nunes, C. Implementation for Virtex-II Devices Aragao Telecommunications Institute- University of Aveiro-Portugal M11460 MPEG-4 Inverse Quantizer Hardware A. Navarro, A. Silva, O. Nunes, C. Accelerator Implementation in Virtex Aragao Telecommunications Institute- II University of Aveiro-Portugal M11461 An Ip Block For Mpeg-4 Part 9 Block- Mohammed Sayed and Wael Badawy Based Motion Estimation Architecture University of Calgary, Calgary, Alberta, Canada. M11462 Update on Hardware Reference Code Wael Badawy, and Graham Jullien for DCT & its Specifications for Advanced Technology Information MPEG-4 Decoder Processing Systems (ATIPS), Calgary, Alberta, Canada. M11442 Virtualisation Layer for Portable Miljan Vuletić, Laura Pozzi, Paolo Hardware Accelerators Seamlessly Ienne Processor Architecture Integrated into Software Applications Laboratory, EPFL M11431 Multiple IP-Core Hardware- T. Mohamed W. Badawy Accelerated Software System University of Calgary, Calgary, Alberta, Framework for MPEG4-Part9 Canada. M11411 An Ip Block For Mpeg-4 Part 10 Ihab Amer, Wael Badawy, and Graham Context-Based Daptive Variable Jullien Advanced Technology Length Coding (Cavlc) Information Processing Systems
140 (ATIPS), Calgary, Alberta, Canada. M11412 A Hardware Block for 2x2 Hadamard Ihab Amer, Wael Badawy, and Graham Transform and Quantization with Jullien Advanced Technology Application to MPEG–4 Part 10 Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11413 A SystemC model for 2x2 Hadamard Ihab Amer, Wael Badawy, and Graham Transform and Quantization with Jullien Advanced Technology Application to MPEG–4 Part 10 Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11414 A Hardware Block for 4x4 Hadamard Ihab Amer, Wael Badawy, and Graham Transform and Quantization in Jullien Advanced Technology MPEG-4 Part 10 Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11415 A SystemC model for 4x4 Hadamard Ihab Amer, Wael Badawy, and Graham Transform and Quantization with Jullien Advanced Technology application to MPEG-4 Part 10 Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11416 A Hardware Block for THE MPEG-4 Ihab Amer, Wael Badawy, and Graham PART 10 4x4 DCT-LIKE Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11417 A Systemc Model For The Mpeg-4 Ihab Amer, Wael Badawy, and Graham Part 10 4x4 Dct-Like Transformation Jullien Advanced Technology And Quantization Information Processing Systems (ATIPS), Calgary, Alberta, Canada. M11408 Updated Status of Shape Coding Daniel Larkin, Valentin Muresan Binary Motion Estimation Hardware Centre for Digital Video Processing, Acceleration Module Dublin City University, Dublin 9, Ireland M11366 Updated Status on Hardware Daniel Larkin, Valentin Muresan Acceleration Module for Motion Centre for Digital Video Processing, Estimation Dublin City University, Ireland M11358 Updated Status on Hardware Andrew Kinane, Valentin Muresan, Acceleration Module for SA-DCT Noel O’Connor Centre for Digital Video Processing, Dublin City University, Ireland
Detailed Report
The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description”
141 The ISG activity at the Palma meeting has mainly been devoted to the review of the contributions and to the development of the guidelines for conformance documentation of modules submitted for Part 9. In more details the following topics have been the subject of the work: the review of the contributions presenting updated HDL module submissions the review of contributions on the new proposed improvements to the API specification and implementation improvements of the “Virtual Socket”, the specification of the advanced version of the demonstration, the distribution of the WILDCARDII platform supporting a faster accomplishment of the verification of the conformance of Part 9 modules with the standard described in Part 2 and Part 10 the update of MPEG-4 Part 2 and Part 10 module submission status.
Almost all modules submitted so far are accompanied by documentation according to the template defined at Seattle meeting. Conformance part needs to be completed for most of the modules. During the meeting a clear procedure for the conformance has been defined. Five WILDCARDII modules have been distributed among the participants to the meeting that have submitted HDL modules. Therefore all can proceed with conformance testing of the submitted HDL modules using the integrated framework. The table of module submission commitment has been updated and reported in an specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6754).
An interesting proposition to extend the supported functionality of the integrated framework has been presented and discussed (Document M11442). The idea is to provide a virtual memory module that provided a access to the memory as seen by the software description also to the HW described co-processor described by Part 9. Such feature can result very attractive for simplifying the design of HDL co-processing modules that can be fully functional even when rarely used options needing access to the central memory are used or allowing a design without explicit specification of the data transfers.
The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 11th November,1st December, 13th January at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-770-970-4161, participant code 9202060193).
Resolutions The above activities have led to the following resolutions and output document approval.
MPEG-4
No. Title TBP Available 14496-9 MPEG-4 Reference Hardware Description
142 6754 Status of HDL submissions and commitments for MPEG-4 Part-9 N 04/10/22 Updated status and Documentation of the Hardware Acceleration N 04/10/22 6756 Module for SA-DCT for MPEG-4 Part 2 Updated Status and documentation of the 4xPE Hardware Acceleration N 04/10/22 6757 Module for Motion Estimation Updated status and documentation of the 2-D IDCT Hardware N 04/10/22 6758 Accelerator Module for MPEG-4 Part 2 Updated Status and documentation of the Shape Coding Binary Motion N 04/10/22 6759 Estimation Hardware Acceleration Module for MPEG-4 Part 2 Updated status and documentation of the Inverse Quantizer Hardware N 04/10/22 6760 Accelerator Implementation for MPEG-4 Part 2
15.0.1 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration.
143 Annex 14 Report of Liaisons meeting
Source: Jan Bormans
As a result of the increasing Liaison activity with ATSC, the Liaison Group received a request from ATSC to: 1. Extend the existing collaboration from the technical group level to the organisation level; 2. Consequently change the Liaison Representative; and 3. Consequently change the category of the Liaison from “C” to “A”.
After a presentation at Tuesday’s Liaison meeting, a consensus was reached to proceed as requested by ATSC.
Background: The Advanced Television Systems Committee, Inc. (ATSC) is an international, non- profit organization developing voluntary standards for digital television. The ATSC member organizations represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries.
The ATSC DTV Standard has been adopted by the United States, Canada, South Korea, Argentina and Mexico. ATSC member is are currently included in several MPEG work items including amendments 1, 4 and 5 to ISO/IEC 13818-1:2000 and ATSC continues to utilize the new standards developed by WG 11 in its future specifications for broadcast and datacast applications.
The Liaisons Group considered the following input documents:
Input Contribution Title Number M11180 Liaison Statement from the TV-Anytime Forum M11208 IEC CDV 62261-1 M11209 IEC CDV 62261-2 M11273 Activity Report of DCCSDP&DCCSDC in Japan M11433 IEC TC 100 NP M11444 Liaison Statement from the TV-Anytime Forum M11445 Liaison Statement from the TV-Anytime Forum M11470 IEC CD 60728-1
An interesting presentation from Hiroshi Yasuda-san and Takuyo Kogure-san was given during the Liaison meeting about the DCCSDP&DCCSDC activities. In the discussion following this presentation MPEG documents relevant for the DCCSDP&DCCSDC were identified. This information has been included in the outgoing Liaison Statement to the DCCSDP&DCCSDC.
To give appropriate exposure to the Call for Proposals on M3W, it was decided to send this Call a wide range of organisations (also see the Liaison resolutions below).
In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: OMA, 3GPP and W3C - on drawing the attention/updating the information on LASeR;
144 WG1 - on how existing MPEG-7 technology can fulfil requirements for JPEG’s CfP on JPSearch; and OMA - on conformance to ISO 14496 Part 12.
MPEG was also informed during the course of the meeting of IEC TC100 activities focussing on home server technology (TA8). Their scope is to develop international publications relating to multimedia home server systems and software specifications addressing the total system connected in the network. This includes e.g. the system interface, the application programming interface, the modelling for system structure and system functionality specifications. Current work includes: PT 62328 multipart standard Defines the volume and file structure adaptation required for interchanging multimedia data of a home server/broadcasting receiver which consist of a major stream and multiple associated objects. Part 3 is specific to Japanese broadcast systems ISDB, and further parts may provide similar specifications for other regions. PT 61925 Vocabulary of home server is specified from the viewpoint of equipment functions and home server technology.
New TA8 work items recently balloted/under ballot are: 100/808 Guidelines for privacy protection Scope: Guidelines for protection of user’s private information stored in consumer equipment and systems Background: Increasing number of consumer products store user information which needs to be protected from illegal access and use. Mechanisms are also needed to ensure such information can be deleted (and not remain recoverable) when equipment sold on etc 100/849 Digital rights permission code To define permission-related identifiers and permission information (permission and condition descriptors) required to digitally manage content rights and permissions in the home server environment 100/863 Conceptual model for DRM Model of protocol specifications to exchange rights information between DRM modules, to define protocols, rights description format, encrypted content format and include requirements, security model, interconnection model, license information model, protected content format model. 100/864 Conceptual model for e-publishing Model clarifies e-publishing /e-book components and relationship between these and e-publishing services.
WG 11 was also informed of the existence of a presentation “Towards full implementation of DRM” providing additional background on the above. See also http://www.itu.int/ITU-T/worksem/hnhs/index.html
Finally, the responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.
The following recommendations were issued: 16 The approval of the following documents (Liaison Statements): No. Title TBP Available General 6761 Liaison Statement to DCSDC No 04/10/22 6762 Liaison Statement to the TV-Anytime Forum on MPEG-7 MDS No 04/10/22 6763 Liaison Statement to OMA on LASer No 04/10/22 6764 Liaison Statement to 3GPP No 04/10/22 6765 Liaison Statement to W3C No 04/10/22 6766 Liaison Statement to WG 1 on JPSearch No 04/10/29
145 6843 Liaison Statement to OMA on Base Media File Format No 04/10/22 Liaison Statement to IEC TC 100 on NP: Multimedia home No 04/10/22 6866 server systems 6868 Template cover letter for M3W liaison No 04/10/29
17 The approval of the following documents (statement of benefits): No. Title TBP Available General Statement of benefits from establishing a Category A liaison with No 04/10/22 6767 ATSC
18 The approval of the following documents (other Liaison documents): No. Title TBP Available General 6768 Responses to National Body Comments No 04/10/22 6769 List of Organisations with which MPEG entertains liaisons No 04/10/22
19 The Liaison group requests to change the ATSC liaison category from C to A
20 The Liaison group requests the SC29 Secretariat to send the M3W Call for Proposals using template N6868 to the following organisations: UPnP, ATSC, DVB, OCAP, CELF, DLNA.
146