Multimedia Production for Elearning with Open Source / Linux

prepared by : Avinanta Tarigan [email protected] AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Learning - Cognitive

Knowing, or apprehending by the understanding

the awareness with perception, reasoning, judgement, intuition and memory, the mental process by which knowledge is acquired AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Learning - Cognitive

Learning : accumulation and organization of knowledge structure Hypertext-structure : reﬂect a map of knowledge in human brain As we learn : we gain new structures and links in semantic memory AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de As We Learn

In Serial (through reading)

In Holistic (through diagram/picture) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Multimedia ?

Combination of both Holistic and Serial Combined materials in text, graphic art, sound, video, and animation which are delivered via digital computer systems or other electronic means Good eLearning platform should include multimedia AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Stages in Multimedia Production

Designing

Authoring Repository MPEG3 WMV JPEG PNG MIDI MP3 WAV

Delivery

¥¡¥¡¥

¦¡¦¡¦

£¡£¡£¡£

¤¡¤¡¤

£¡£¡£¡£

¤¡¤¡¤

¢¡¢

¡ ¢¡¢ AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Stages in Designing Multimedia

Information Design Objectives - Audiences - Organisation - FlowCharts & Information Maps Interaction Design User involvment - Usability - Navigation Tools - Storyboard Presentation Design Visual Style - Layout - Interface Design - Con- tent (Text,Graphs,Audio,Video) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Authoring

Audio MIDI & Sequencing Multi Track Video (non linear editing) Video Capturing Video Editing / Composing Animation Interactive Program AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Audio: MIDI & Sequencing

MIDI : Musical Instrument Digital Interface Standards for communicating MIDI capable instruments for exchanging time sequenced song data (notes & events) Sequencer : programs which records / playback notes from / to MIDI devices Example : Rosegarden, Jazz, Brahms, etc AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de ... MIDI & Sequencing

10Bbase2 VBrick

Data transmited are notes and their properties ( velocity, note-on, note-off ), control (instruments, pitch, damper, sustain, etc) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Audio, some basics

life was beautiful ... Pressure

Time AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Audio, some basics

but after computer ...

ADC

(Analog Digital Converter) Pressure

Time (bit) Sampling Size

DAC Sampling Rate (Hz) (Digital Analog Converter) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Audio: Multitrack (Direct to Disk)

Simulating real professional studio in a box : Performing recording, processing, mixing sounds, and digital sound processing (DSP) Sounds are recorded in multitrack direct to hard- disk Set of software : ALSA, Jack, LADSPA, Ardour, Audacity AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Digital Studio

Digital

Low Impedance Analog

High Impedance Analog

MIDI Line Out

mic guitar/bass MIDI another input

L A DB15

B R

1 2 3 1 2 3

Omni I/O

usb 10Bbase2 SB Audigy2 monitor system

Result DAT / Tape Backup (Optional) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Digital Image, basics

Pixels, who they are ?

each has colors values : Red Green Blue in bit resolution : how many (square) pixels in an image properties of an image : color depth & resolution AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Digital Video, basics

Basicaly, video is sequence of images (frames)

and ofcourse sounds too ... AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Digital Video, basics

Thus properties of a video should be :

Image resolution : resolution + color depth Rate : how many frame per second (fps) Sound : sampling rate (Hz) + sampling size (bit) AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Digital Video, basics

Some video encodings and compression : AVI, MPEG-1, MPEG-2, MPEG-4, DivX Some standards : VCD : MPEG-1, NTSC-352 x 240 at 30 fps | PAL- 352 x 288 at 25 fps | Bit rate at 1.15 Mb/sec SVCD : MPEG-2, NTSC-352 x 480 at 30 fps | PAL-352 x 576 at 25 fps | Bit rate at 2.4 Mb/sec DVD : MPEG-2, NTSC-704 x 480 at 30 fps | PAL- 704 x 576 at 25 fps | Bit rate at 4.8 MB/sec AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Video: Capturing

Digital Analog Camcoder Camcoder CiscoSystems CiscoSystems Cisco 7000 Cisco 7000 SERIES SERIES FireWire IEE1394 Video Capturing Card USB

Analog : through video capturing card Digital : USB or Firewire Recorded as DV format: AVI - MOV - MPEG App : DVGrab, MainCapture, Cinelerra capture AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Video: Editing & Composing

Non-linear editing Performing composing, video transition, effect, mixing, encoding App : Cinelerra, Kino, MainActor AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Syncronization

When video, audio, MIDI are gathered together : need time syncronization SMPTE timecode (SMTPE : Society of Motion Picture and Television Engineers) Every source of data carries SMPTE, played together to get ﬁnal result AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Animation

Modelling tools Creating Wireframe objects, room, lights, and their movement Example : Blender Rendering Machine From wireframe to picture / videoframes Example : PovRay -> run on top of Linux cluster AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Interactive Program

Giving users control over what elements to present and when Embeded into Web Application Example : Simple interactive web application (PHP, Python, etc) JAVA applets / scripts Macromedia ﬂash AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Repository : format & compression

Depends on what purpose: Further authoring : original quality Delivery : good compression & widely readable Beware : higher compression ratio means lost in quality AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de ... format & compresion

Appliance Main Requirements Format of Choice

Share through CDs Quality, Player Availability MP3, MPEG

Share through internet Quality, Compression MP3, MP3PRO, MPEG,

WMA, WMV

Portable players Compression, Quality MP3PRO, MPEG

Broadcasting through in- Player Availability, Com- MPEG, WMA, RA-G2

ternet pression AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Repository : cataloging

Giving text which semantically associated to each content Indexing and categorizing functions Providing searching, directory, thumbails, and preview model for the users AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Delivery : Ofﬂine Media

Most common used : CDROM based media (format : Audio CD, Data CD, VCD, SVCD, DVD) Interactive application : shall be runable in many platform : Windows, Mac, Unix, Linux Tools : K3B: wrapper for : cdda2wav, cdrdao, cdrecord, lame, and other video/audio encoder AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Delivery : Online Media

Direct download & Play When ofﬂine playing is required When data is not too big & legal to download Streaming Transmiting sequence of data which will be played in sequence AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Delivery : Streaming

Unicast Transmited One to one : client-server Can be done by normal TCP/IP network & nodes Multicast Transmited One to many : one server to group of clients sharing same multicast address Must have network devices & nodes capable in multicasting AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Delivery : Streaming

NET

WAN

UNICAST

NET

WAN

MULTICAST AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Delivery: Streaming

Audio streaming : IceCast : set of application, in Ogg Vorbis Video streaming : Helix -> OpenSource (RealNetworks Licence) VideoLAN -> OpenSource AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Audio Streaming with IceCast

(Players)

WinAMP

auth IceS

feeding streaming auth XMMS feeding delivery IceS

auth IceCast (Server) ZinF

IceS AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Video Streaming with VideoLAN AG Rechnernetze und Verteilte Systeme http://www.rvs.uni−bielefeld.de Conclusion

song

RoseGarden Timidity Audacity MP3 Icecast XMMS midi wav OGG WinAmp

WAV K3B

DVGrab DV

MainActor

AVI AVI

Blender PovRay MPEG VideoLAN Server

VideoLAN WebServer Client

Helix Browser

Macromedia Flash

MPlayer Multimedia RealPlayer Plugins