1. Index 2. Document Purposes 3. Abbreviations 4. Introduction 5
Total Page:16
File Type:pdf, Size:1020Kb
MPEG-7 Media Information doc for OpenDrama 1. Index 1. Index .......................................................................................................................................1 2. Document purposes ..................................................................................................................1 3. Abbreviations ...........................................................................................................................1 4. Introduction ..............................................................................................................................1 5. Definitions ................................................................................................................................1 6. Descriptors organization............................................................................................................2 7. Descriptors proposed for OpenDrama ........................................................................................4 8. Classification schemes ..............................................................................................................6 Audio Domain .................................................................................................................................6 Audio Presentation ..........................................................................................................................6 Audio Coding Format .......................................................................................................................6 Video Domain .................................................................................................................................6 Image Domain.................................................................................................................................6 Visual Coding Format ......................................................................................................................6 9. ANNEX: UML schemas .............................................................................................................7 2. Document purposes Introduce the MPEG-7 Media Information descriptors to be used in the OpenDrama project. 3. Abbreviations CS: Classification Scheme D: Descriptor DS: Descriptor Scheme MDS: Multimedia Description Schemes MPEG: Motion Picture Experts Group MPEG-7: also called “Multimedia Content Description Interface”. 4. Introduction The recorded material (audio, video) can have several "profiles". That means that we can have different resolutions, qualities, etc. that can be used depending on the connection of the final user. That set of MPEG7 Descriptors will hold that data called "media information". 5. Definitions ?? Content: entity that has a specific structure to represent the reality. ?? Media Information: description of a physical format of a content (storage & tx. format). ?? Media Profile: coding schemes; original = “master”; (different parameters, compression, resolution…) ?? Media Instance: physical content entity. An identifier and a locator identifies the instance. ?? Media Identification: identifies the multimedia content independently of the different available instances and profiles. ?? Media Format: media & coding parameters of the MediaProfile. 1 MPEG-7 Media Information doc for OpenDrama Reality Live audio & scene Content Audio record AV record MPEG-1 320kbps Media profile Non-compressed compressed audio audio (.wav) (.mp3 file) Media instance CD-ROM HDD copy main server spare server copy (original) HDD copy HDD copy Media Internet FTP information for access the internet Client 6. Descriptors organization Media Information DS is the main container of media information. The main members are: ?? Media Identification: contains information independent from the profile. ?? Media Profile: coding schemes. 2 MPEG-7 Media Information doc for OpenDrama Media Instance will point to the file/URL with the information. Media Format contains media & coding parameters of the MediaProfile 3 MPEG-7 Media Information doc for OpenDrama 7. Descriptors proposed for OpenDrama Here we summarize the descriptors and the interesting ones are marked. ?? Media Information o Media Identification ?? Entity Identifier ?? Audio Domain ?? Video Domain ?? Image Domain o Media Profile ?? Media Quality ?? Quality Rating (1..? ) o Rating Value o Rating Scheme ?? Rating Source ?? Rating Information Locator ?? Perceptible Defects ?? Media Instance (0..? ) ?? Instance Identifier ?? Media Locator ?? Location Description ?? Media Format ?? Content ?? Medium ?? FileFormat ?? FileSize ?? System ?? Bandwidth ?? BitRate ?? TargetChannelBitRate ?? ScalableCoding (spatial, temporal, snr, fgs) ?? VisualCoding o Format (see below Visual Coding Format) o Pixel o Frame o Color Sampling ?? AudioCoding o Format (see below Audio Coding Format) o AudioChannels (front, side, rear, lfe, track) o Sample o Emphasis o Presentation ?? SceneCodingFormat ?? GraphicsCodingFormat ?? OtherCodingFormat Media Information main container Media Identification useful to have information independent from the profiles Media Profile Media Quality may be interesting, but complicated to use (and to evaluate). Will we use this data, or will be enough with bitRate to make the user choose the profile? Media Instance Concrete file/location of data. A profile can have different instances. Media Format Coding details. Content To be defined… File Format OGG, mp3, wav, … File Size [bytes] Maybe that should be in the instance, not in the profile…? 4 MPEG-7 Media Information doc for OpenDrama Bandwidth [Hz] Depends on the acquisition filters and/or transcoding applied. BitRate [bits/s] Can be variable or fixed. In case of variable bit rate, minimum, maximum and average bit rate can be specified. TargetChannelBitRate [bits/s] Can help in deciding what profile to use. VisualCoding Visual component parameters. Format JPEG, MPEG-1, etc. (see below Visual Coding Format) Pixel Resolution [dpi], aspectRatio (width/height), bitPer (bits per pixel). Frame Height [pixels], width [pixels], aspectRatio (width/height[?]), rate[Hz], structure (progressive/interlaced). AudioCoding Audio component parameters. Format DTS, MP3, Linear PCM, etc. (see below Audio Coding Format) AudioChannels Number & configuration of channels: front, side, rear, lfe. Multitrack can be specified with track. Presentation See below Audio Presentation. Maybe can be eliminated if AudiChannels info is enough. 5 MPEG-7 Media Information doc for OpenDrama 1. Source 8. Classification schemes 1.1. Synthetic 1.2. Natural All that classifications are modifiable, that are 2. Acquisition the basic proposals from MPEG-7 group. 2.1. Photographic 2.2. Graphic Audio Domain 2.3. Mixed (MPEG7AudioDomainCS) 2.4. Chart 1. Source 2.5. Visualization 1.1. Synthetic 3. Use 1.2. Natural 3.1. Scientific 2. Acquisition 3.2. Medical 2.1. Music 3.3. Aerial 2.2. Speech 3.4. Remote-sensing 2.3. Mixed 3.5. Security 2.4. Multi-track 3.6. Broadcast 3. Use 3.7. DVD distribution 3.1. Scientific 3.2. Medical 3.3. Security Image Domain 3.4. Broadcast (MPEG7ImageDomainCS) 3.5. CD-A distribution 1. Source 1.1. Synthetic 1.2. Natural Audio Presentation 1.3. Scanned document (MPEG7AudioPresentationCS) 2. Acquisition 1. no sound 2.1. B/W photograph 2. mono 2.2. B/W graphic 3. stereo 2.3. Gray photograph 4. surround 2.4. Gray graphic 5. Home theatre 5.1 2.5. Color photograph 6. Movie theatre 2.6. Color graphic 2.7. Complex color graphic 2.8. Simplex color graphic Audio Coding Format 3. Use 3.1. Scientific (MPEG7AudioCodingFormatCS) 3.2. Meidcal 1. AC3 3.3. Aerial 2. DTS 3.4. Remote-sensing 3. MP3,MPEG-1 layer III 3.5. Security 4. MPEG-2 3.6. Printed publication 4.1. MPEG-2 BC 4.2. MPEG-2 AAC 5. MPEG-4 (…) 6. AMR Visual Coding Format 7. ITU-T G.72x 1. JPEG 8. Linear PCM 2. MPEG-1 9. Windows Media Audio 3. MPEG-2 10. ATRAC 4. MPEG-4 11. ATRAC2 5. MJPEG 12. ATRAC3 6. JPEG2000 7. H261 8. H263 Video Domain (MPEG7VideoDomainCS) 6 MPEG-7 Media Information doc for OpenDrama 9. ANNEX: UML schemas 7.