Presentaz-Chiariglione [Modalità Compatibilità]

Prospects of multimedia technologies and applications Leonardo Chiariglione IET Lectio Magistralis Bologna – 2013/10/24 The “hard” analogue times Marcus Valerius Martialis (Epigrammata LII) Commendo tibi, Quintiane, nostros -- nostros dicere si tamen libellos possum, quos recitat tuus poeta -- : si de servitio gravi queruntur, adsertor venias satisque praestes, et, cum se dominum vocabit ille, dicas esse meos manuque missos. Hoc si terque quaterque clamitaris, inpones plagiario pudorem. (Slightly less) “hard” analogue times Ludovico Ariosto (1515 AD) was afraid that people would copy his poem without rewarding him He made a business proposition to Duke Alfonso d’Este of Ferrara: YOU fine those who pirate my works and WE share the proceeds Something changed – but not so much – in 2000 years Titus Pomponius Atticus (1 st century BC) employed a large number of trained slaves to copy and produce books with retail branches in the provinces of the Roman empire A Chinese publisher's account (12 th century AC) for a book of 1,300 pages indicates a 3 to 1 ratio of selling price to production costs Gutenberg’s invention fostered the creation of the role of publisher Many analogue media technologies Movable character Cinematography printing Radio Photography Television Telephony Tape recording Facsimile Photocopy Sound recording 5 When professional copy became possible… Whereas Printers, Booksellers, and other Persons, have of late frequently taken the Liberty of Printing, Reprinting, and Publishing, or causing to be Printed, Reprinted, and Published, Books, and other Writings, without the Consent of the Authors or Proprietors of such Books and Writings, to their very great Detriment, and too often to the Ruin of them and their Families: For Preventing therefore such Practices for the future, and for the Encouragement of Learned Men to Compose and Write useful Books; May it please Your Majesty, that it may be Enacted ... (Queen Anne’s Act, 1710) 6 When personal copy became possible… Most European countries began to Grant consumers the right to make private copies, based on the principle that these are not likely to create substantial “damage” to copyright holders But in exchange they began to… Apply a levy on recording equipment (blank tapes, audio and video recorders etc…) The proceeds go to rights holders as a compensation for the loss of revenue by private copying (but not for piracy) 7 Audio features Microphones sense the sound 3D field at particular points of the field yielding different # of channels 1/2/5.1/22.2 Depending on audio type and applications, audio signals are sampledwith different parameters Sampling frequency Bits/sample Linear Signal type 8 kHz 8 No telephone signal 16 kHz 14 Yes speech 44.1 kHz 16 Yes CD Audio 48 kHz 16/24 Yes studio 96/192 kHz 24 Yes studio 8 Video features Displaying images @50-60 Hz to make the sequence appear as “natural” (chemistry based vision) Shotcuts Film: frame is repeated twice @24 Hz Television: the scanning lines of alternate TV frames shifted by ½ line vertically @ 25/30 Hz (past?) Human acuity is 150 pixels/degree or 2.5 pixel/minute At appropriate luminance a human looking at an image of height H scanned with 500-600 lines from a distance of 6H cannot see the scanning structure 9 Content life cycle is not a simple thing/1 Creation Information representation Rights collection Recording Agency Post production Talent scouting Ad acquisition Setting Ad insertion Performing Metadata Information capture 1-ry distribution 10 Content life cycle is not a simple thing/2 Switching Player 2-ry distribution Recorder Promotion Audience measurement Search Redistribution Sale Customer relationship Receiver Regulation 11 Main features of the analogue world Each “step” performs a role “Horizontal” arrangement Technologies at different steps are largely independent A lot of IP involved, typically managed by different communities (silos) About digital media Information expressed in digital form for consumption by human beings Other meanings such as the means to deliver information Forms of digital media Audio Still images Speech Graphics Video Text But also information for other human senses Touch Taste Smell … 13 Digital media representation Video (2D-3D): 200 Mbit/s, 1/2 Gbit/s, 4/8 Gbit/s Audio (multichannel): 1.5/5.75 Mbit/s, 200/640 Mbit/s, ... 3D Graphics Unrealistic audio video bitrates for today’s technologies Compression required ~ 50 years of compression R&D A lot of IP (tens of thousand patents, some expired after 20 yr) Innovation continues apace For 3D Graphics, transmission is a just recent concern 14 The audio-visual world: some 30 years ago NHK’s MUSE: transmission of HDTV for satellite NAB begins investigation of terrestrial HDTV D2-MAC/HD-MAC for future television in Europe Digital speech for telecommunication (Rec. G.711) 2/1.5 Mbit/s videoconference (Rec. H.120) CMTT video codec for contribution Beginning of px64 kbit/s videophone (Rec. H.261) 15 The audio-visual world: some 25 years ago Exploitable results for Audio and Video (AV) compression Implementation of effective AV compression algorithms possible in VLSI Digital media – unlike analogue media – can be delivery system independent A single digital AV standard to Create a huge global market of devices The goal: seamless global AV communication 16 Formats “Format” is how information is represented so that it can be processed by a machine There have been many format wars (faka ights between assembly lines), e.g. NTSC vs PAL vs SECAM VHS vs. Betamax But the development of a standard should be a fight between ideas supported by technologies A fight between technologists is less expensive than a fight between assembly lines – and the result is better 17 Definition of “standard” Webster’s A conspicuous object (as a banner) formerly carried at the top of a pole and used to mark a rallying point especially in battle or to serve as an emblem Something that is established by authority, custom or general consent as a model or example to be followed Encyclopaedia Britannica (Technical specification) that permits large production runs of component parts that are readily fitted to other parts without adjustment My definition of standard Codified agreement between parties who recognis the advantage by all doing an agreed number of things in the same way 18 Features of a standard The actual “process” (de jure or de facto) that produces the agreement is irrelevant, provided it is Fair to all parties concerned (otherwise it is market distortion) Carried out to match the needs of users (otherwise it is not very useful) The means to decide whether an implementation conforms to the agreement are part of the agreement The means to enforce the agreement are not part of the agreement Of course the “status” of some agreements may be “higher” than that of other agreements 19 The MPEG idea (end 1980’s) Different countries and industries have different agendas for media in digital form, but Digital audio-visual compression is mature The enabling technology is “common” We need a place to specify “information representation” Independent of applications (e.g. delivery) Of global scope To act as a bridge between R&D results and standards Different competences add Different agendas neutralise 20 In search of the Holy Grail (end 1980’s) ITU-T Transmission of speech (SG XV WP 1) & video (SG XV WP 2) ITU-R Broadcasting of audio (SG 10) and video (SG 11) IEC Recording of audio (SC 60 A) and video (SC 60 B) Audio-visual equipment (TC 84) Receivers (SC 12A and G) ISO Photography (TC 42) Cinematography (TC 36) Character sets (TC94/SC2) 21 Joint ISO/IEC Technical Committee JCT 1 ISO – International Organisation for Standardisation IEC – International Electrotechnical Commission JTC 1 – Information Technology is a Joint ISO/IEC Technical Committee SC 29 – Coding of Audio, Picture, Multimedia and Hypermedia Information WG 11 – Coding of moving pictures and audio IEC ISO TC xx JTC 1 TC yy SC uu SC 29 SC vv WG 1 (JPEG) WG 11 (MPEG) 22 The MPEG philosophy Develop standards for converging media Find research results from multiple sources and integrate the technologies Act as a bridge between academia/research and industry Develop software implementations of the standards as a platform for peer review and optimisation Verify the performance of the standard 23 MPEG: behind the acronym Frequency : 4 meetings/year # of meetings : 105 until July 2013 Attendance : ~500 experts Countries : actively represented ~25 Industries represented Academia Content Broadcasting Research Computers Services Consumer Electronics Telecom, … 24 The MPEG standard workflow Identify the need for a new standard Explore the field Develop requirements Competitive phase Collaborative phase Approval Assessment Maintenance 25 The MPEG worlflow/1 Identify the need for a new standard Identify the need for a standard Approval of a new standard project Explore the field Seek Industry experts Open seminars Search for required technology Develop requirements Establish scope of work Call for Proposals 26 The MPEG worlflow/2 Competitive phase Response to CfP Initial technology selection Collaborative phase Core Experiments Working Drafts Approval CD DIS IS 27 The MPEG worlflow/3 Assessment Verification Tests Maintenance Corrigenda Amendments Withdrawal 28 Patents – what they are A definition (USA) of a patentable invention

Load more