The Dream 10th anniversary
…a viola Masterclass with New World Symphony, at the GARR Conference 2005, in Pisa...
“To perform together, from distant locations... as if distance has vanished in a click of a computer mouse” www.conservatorio.trieste.it
14:00
The LOLA team LOLA v1.4.2 To play together you need…
• Audio Latency (RTT) below ~75ms (depends on music style) • Eye Contact to synchronize • Spatial Sound immersion for expression • Room Reverbering • Continuous Presence of all musicians • Non distracting environment • and art! www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 …and real life
Audio only… www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 Audio/Video tools before LOLA… www.conservatorio.trieste.it H.323/SIP DVTS
Conference XP Skype
The LOLA team LOLA v1.4.2 Audio/Video tools before LOLA…
Latency: 200ms Audio for voice Latency: 400ms Auto echo Echo cancellation www.conservatorio.trieste.it H.323/SIP DVTS
Latency: 350ms Latency: > 300ms Echo Audio for voice Auto echo cancellation
Conference XP Skype
The LOLA team LOLA v1.4.2 Latency disables interaction
If there is No natural way for our brain to deal with events, Then we need “rules and protocols”
“Latency is not just an impediment to musical interaction; it’s an impediment to human interaction!” Dan Nichols (NIU)
www.conservatorio.trieste.it
Talking, Playing, Acting, Dancing, Driving, …
The LOLA team LOLA v1.4.2 Latency à Echo! www.conservatorio.trieste.it
Courtesy of Brian Shepard, TCU
The LOLA team LOLA v1.4.2 No Echo à No Music! www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 So, we came to LOLA…
Latency: 5ms Audio for music No echo Very Fast reliable networks Hi-Speed cameras Machine Vision Grabbers
USB3 Vision www.conservatorio.trieste.it Good PC (i5/i7) … New programming approach! 25 Mbps à 100 Mbps à 500 Mbps à 2.5 Gbps 30 fps à 90 fps 2 ch à 10 ch http://www.conts.it/artistica/lola-project/
The LOLA team LOLA v1.4.2 LOLA Motivations and Goals
• Target applications:
• Network interactive musical tasks • musical rehearsing and performances • music education and training
... but also... www.conservatorio.trieste.it
• Network interactive on stage performances • dance performances • drama performances • performing arts education and training • and beyond… • surgery, real time control…
The LOLA team LOLA v1.4.2 LOLA very basic schema www.conservatorio.trieste.it Research & Education Networks
For a detailed overview: http://www.garr.tv/home/viewvideo/675/npap-workshop- lola-update-and-demonstration-callocchio
(NPAPWS 2013 @ MDW, Vienna)
The LOLA team LOLA v1.4.2 “nice” devices…
What was running in the “red circle” situation? www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 LOLA Concerts www.conservatorio.trieste.it
Mauro Maur & Francoise de Clossey Mario Brunello Marjorie Bagley & Cheng Hou-Lee
T-Bone Burnett & Chuck Mead http://www.conts.it/artistica/lola-project/lola-video
The LOLA team LOLA v1.4.2 LOLA Concerts/ Masterclasses www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 LOLA is made by its users!
• “I need and easy backstage channel to talk to my remote technical partner!”
• “I’m not a network expert, I need a quick real time snapshot of what is going on…”
www.conservatorio.trieste.it • “What the musicians need to see is different from what the audience likes!”
• “I really need LOLA to teach in places were we will never have 1Gbps…”
• “I need HD to see details and feel closer”
The LOLA team LOLA v1.4.2 LOLA v1.4.2 answers
• “I need and easy backstage channel to talk to my remote technical partner!” • à an embedded permanent chat service • à always active, even when not “connected” www.conservatorio.trieste.it • à “send debug info to remote” • à send/receive “audio tone” to remote
The LOLA team LOLA v1.4.2 LOLA v1.4.2 answers
• “I’m not a network expert, I need a quick real time snapshot of what is going on…”
• à new detailed www.conservatorio.trieste.it “Network Monitor” panel
The LOLA team LOLA v1.4.2 LOLA v1.4.2 answers
• “What the musicians need to see is different from what the audience likes!”
• à multiple video windows layouts • à duplicate remote video window
• à fully scalable windows zoom www.conservatorio.trieste.it • à multiple cameras
The LOLA team LOLA v1.4.2 LOLA v1.4.2 answers
• “I really need LOLA to teach in places were we will never have 1Gbps…”
• à fast JPEG video compression (CUDA or CPU based) www.conservatorio.trieste.it
• à ~ 0.3 - 3ms latency
• à ~ 30Mbps (color)
• à ~ 12Mbps (b/w)
The LOLA team LOLA v1.4.2 LOLA v1.4.2 answers
• “I need HD video”
• à Digital cameras (CXP – Imperx, USB3 – Ximea, PtGrey) www.conservatorio.trieste.it
• à full color tuning
• à RGB or Bayer encoded
The LOLA team LOLA v1.4.2 Other v1.4.2 new features
• Audio Only sessions (if needed)
• Full recording of A/V sessions www.conservatorio.trieste.it • LOLA-Tester traffic generator
• Full support for Windows 8.1
• It even runs on Apple h/w (bootcamp)
The LOLA team LOLA v1.4.2 V1.4.2: Digital Cameras
• HD cameras with scalable resolution; • à from SD to HD
• Video, power, remote camera control over a single 75ohm standard video cable with BNC connectors (Gencam) or
USB3 cable www.conservatorio.trieste.it • à easy clean control
• Up to 100m (300’) cable at 60fps or more with USB3 optical extenders • à non invasive
• Native digital Bayer encoded color; • à 66% less bandwidth
The LOLA team LOLA v1.4.2 LOLA in the lab (Alpha)
• Multiple cameras per video board (CXP or USB3 card) www.conservatorio.trieste.it • à multiple viewpoints
• Single/multiple video streams
• Embedded video stream “director”
The LOLA team LOLA v1.4.2 LOLA in the field (Beta)
• Multiple sites connections support
• It works! www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 Still… www.conservatorio.trieste.it
The LOLA team LOLA v1.4.2 LOLA: How do I get it?
Freely available for non-commercial academic use! • you build your own hardware following the specs: • 1 PC with PCIe bus, CPU: • duoCore 2.0Ghz (SD in b/w) • i5 (SD in color or HD in b/w) • i7 (HD in color with CXP or USB3 cameras) • 1 RME HDSP (or equivalent) audio card; • 1 BitFlow Grabber (analog or CXP) video card or good USB3 card www.conservatorio.trieste.it • 1 fast industrial progressive scan machine vision camera • analog SD b/w (Sony HR50) • analog HD b/w (Sony HR70) • analog SD color (Hitachi KP-FD30(M), Toshiba IK-TF5) • CXP HD color (Imperx B1410C-CXP / B1411C-CXP) • USB3 XIMEA or PtGrey series • 1 fast GPU card (for HD color, NVIDIA Geoforce GTX) • (you easily build your own analog/coax camera cables)
• you sign the free non-commercial academic use license and get the s/w
• … and you’re a member of the LOLA community to start experimenting with it!
The LOLA team LOLA v1.4.2 LOLA community: [email protected]
• Conservatorio G. Tartini, Trieste, Italy • Northern Illinois University School of Music - DeKalb, IL, USA • CESNET - Czech Republic Research and Education Network - Praha, CZ • New World Symphony - America's Orchestral Academy – Miami, FL, USA • Internet2 networking consortium - Washington, DC, USA • Università degli Studi di Cassino e del Lazio Meridionale - Cassino, Italy • JAnet - UK Education and Research Network - Oxford, Didcot, UK • Universidade de São Paulo - CMU, Departamento de Música - São Paulo, Brasil • Rensselaer Polytechnic Institute - Department of the Arts - Troy, NY, USA • MAGPI - Mid-Atlantic Gigapop - Multimedia Service - Philadelphia, PA, USA • Napier University, School of Arts and Creative Industries, Music dept. -Edinburgh, UK • University of North Carolina, School of Music, Greensboro, NC, USA • Royal Academy of Music, Aarhus, Denmark
• Joseph Haydn Konservatorium, Eisenstadt, Austria www.conservatorio.trieste.it • University of Southern California, School of Music, Los Angeles,CA,USA • Berklee College of Music, Boston, MA, USA • Universität für Musik und darstellende Kunst Wien, Austria • Interlochen Center for the Arts, Interlochen, MI, USA • Conservatorio di Musica Licinio Refice - Frosinone – Italy • Royal Northern College of Music, Manchester – UK • Leeds College of Music, Leeds – UK • TAMU - Texas A&M University, S. Antonio, TX – USA • UNINETT - The Norwegian Academic and Education Network, Trondheim, Norway• Lafayette Facilities, USA • Engage 3D, Chattanooga – TN - USA • San Francisco Jazz, USA • AARNET - Australian Academic and Research Network, Sydney – Australia • Univeristy of Nebraska, Lincoln, USA • Civitium Org, Rome – GA - USA • The Exploratorium, San Francisco, USA • CESGA - Galicia Supercomputing Center, Vigo – Spain • Chapman University, USA • Universida de Vigo, Vigo – Spain • The Columbia College, Chicago, USA • National Center of Arts, Ottawa – Canada • Salford University, UK • Royal Danish Academy of Music, Copenhagen – Denmark • he Burlington Public Library, USA • University of Nevada, School of Journalism, Las Vegas – NV – USA • Tampere University, Finland • The Royal Collee of Music, London, UK • George Washington University, USA • Birmingham Conservatory of Music, UK • Conservatorio di Cosenza, Italy • Georgia Tech University, Atlanta, GA, USA • Conservatorio G. Verdi, Milano, Italy • Iowa State University, IA, USA • Pittsburgh University, USA
Contact us at [email protected]
The LOLA team LOLA v1.4.2 Questions? www.conservatorio.trieste.it
http://www.conts.it/artistica/lola-project [email protected]
The LOLA team LOLA v1.4.2