<<

The Standard vicon.com/standard

2012 The Standard

University of Southampton USING HOLLYWOOD TECHNOLOGY academics are pioneering a new way of using motion TO UNLOCK THE SECRET OF capture technology to examine the way pianists PIANIST’S SOUNDS play the piano.

By using a unique kinematic measurement technique, known as HAWK (Hand and Wrist Kinematics), researchers will be able to look at individual pianists’ playing technique - giving an insight into the posture of their hands on the keys and the movements they use - hopefully showing how this translates into the unique sound they create.

The research will also provide new information on musicians’ hand health, to combat wrist injury (for example, repetitive strain injury - a common problem for pianists).

The project is being led by world- renowned pianist and University of Southampton Music Professor David Owen Norris and Health Sciences academic Dr. Cheryl Metcalf. Professor Norris can track the hand movements of pianists by using a 12 camera T-Series system and Nexus software from Vicon.

Continued

MOCAP IN EDUCATION SERKIS PICKS VICON QUANTIC DREAM STANDING ON TWO FEET University of Bradford Vicon + The Imaginarium Powered by Vicon Human Bipedalism 04 10 17 18 The Standard 2012

Vicon Life Science

“The Vicon system is widely considered to be the industry gold standard. I have relied on the accuracy and reliability of the system to complement and facilitate the development of HAWK.”

Credit Dr. Cheryl Metcalf, who designed, playing. Pianists could appear in It is hoped that the research can Courtesy of developed and validated the a dual archive of recordings and be further developed to build Southampton University HAWK technique, says, “Human HAWK films - we could hear the an archive of pianists playing hand function is fascinating sounds they make, and we could techniques, from music students when you think of the variety see exactly how they make them. to visiting concert pianists, with of tasks we perform every day. Our hope is that in just a few the hope of establishing how However, measuring human years this unique archive would technique affects sound and hand function is complex given acquire an international standing.” advice on how to avoid injury. the many different ways we Professor Norris and Dr. Metcalf can complete a task. Creativity Discover more. trialed this technique at the The Standard is fundamental to hand function youtube.com/ University’s Multidisciplinary vicon.com/standard watch?v=p and to self-expression. HAWK Research week earlier this year. VASKTF0YQw analysis will enable us to The resulting film is available on understand the biomechanics the University’s YouTube page. of how musicians achieve The Standard their unique expressions.” “The Vicon system is widely considered to be the industry Welcome to Vicon’s latest Professor Norris says, “It’s gold standard. The development edition of The Standard. This fascinating to watch pianists’ and validation of HAWK has been edition features a great mix hands. Audiences always want a complex process; HAWK is the of Life Science, Entertainment to see exactly what’s going on first kinematic technique and Engineering customer with those flashing fingers, and to measure all the composite stories that have caught our pianists look at hands too; we movements of the wrist, hand, attention and piqued our argue about the best ways to fingers, and thumb, and the interest in recent months. make certain sounds and we Vicon system has been an compare what different players do We hope you enjoy reading integral part of that process. We with their fingers and their wrists. about the amazing work have two Vicon systems at the your peers are developing! “When I saw how the system can University of Southampton, and analyze exactly what we’re doing I have relied on the accuracy Editorial Team: with our hands, I realized that we and reliability of the system to Hayley Roberts, Lindsay Haas could find the answers to some complement and facilitate Contact: fundamental questions by the development of HAWK.” [email protected] making an archive of piano- 02 The Standard vicon.com/standard

Vicon Engineering QUEEN MARY STUDENT WINS MAJOR ENGINEERING AWARD

Melissa Gabriel, a graduate the project have been taken up was certainly no exception of Queen Mary, University by urologists who worked with and we congratulate all of the of (QMUL) has been the students on this project. competitors for their work and announced as the winner of in particular Melissa Gabriel for Dr. Tom Shannon, a judge at the her study.” the Vicon-sponsored category iMechE awards, and Founder and ‘Best Project Involving the Director at Vicon said, “Each year The presentation was followed Design or Development of a the judges’ task in choosing a by questions on the research Medical Device’ at the iMechE winner becomes ever more difficult from the judging panel made up awards. This prestigious due to the increasing quality and of healthcare professionals from international competition standard of the science and both academic and industrial attracts entries from all over engineering presented. This year organizations throughout the UK. the world and focuses on the Credit use of engineering principles Mel Gabriel (center) with Tom within healthcare research. Shannon from Vicon (left) and Gabriel presented to the judging Iain Charlton, Software Engineer panel her report, which described at Vicon and her MEng group design project in Competition collaboration with P&N Medical Chairman (right) Ltd. The project, titled “The Effect of Shockwave Lithotripsy on Encrusted Urological Stents”, investigated whether shock wave lithotripsy can safely and effectively be used to unblock urethral stents. The results of

The Standard has always been specifically designed for motion COO NOTE a great way for us to share capture. Another product we’re Imogen Moorhouse and highlight the diverse really excited about is the Active Vicon Motion Systems range of applications that use Wand. Simultaneous optical and Vicon systems. video calibration makes another industry first for Vicon. From training the next generation of visual effects artists and We look forward to seeing you technicians to injury prevention in at our booth at the many pianists, our customers never fail international and national to push boundaries and surprise conferences we are attending and delight all of us here at Vicon this season where further with their ingenuity and ambition. product announcements will be made. From a product standpoint, the recently launched Bonita Video camera range is our first synchronized video platform

03 The Standard 2012

Vicon Entertainment PREPARING FOR INDUSTRY: MOCAP IN EDUCATION AT THE UNIVERSITY OF BRADFORD

Credit Courtesy of Bradford University

The University of Bradford number of applicants. The Karl Abson, lecturer in Creative was one of the first Universities combined research-and Technology at the University of in the country to venture into industry-informed approach Bradford, says that practical the area of informatics and to teaching has been very experience is an important part computing. It’s courses in successful and beneficial of the program. He teaches a animation and visual effects to Bradford’s students with wide range of VFX subjects are especially pioneering, having world leading researchers including computer animation been created 10 years ago and and industry professionals and effects work, games, and always attracting a high teaching on its courses. interactive media.

04 The Standard vicon.com/standard

Bradford University is proud to Info be the number one university for graduate employment in the north of and number two in the UK.

“Our ethos is to help students throughout their degree, I’m using the same technology immerse themselves in these academic skills, as well as behind some of the biggest films areas, and to encourage them a good level of knowledge in and games of the last 10 years is to contribute towards their own regards to the industry itself,” very inspiring!” advancement,” said Abson. “Our explained Abson. “This gives courses are heavily influenced by students the tools needed to Employment after graduation is industry, meaning that graduates successfully make informed very high on the agenda at Bradford. are fundamentally prepared for decisions which lead to a Many of its skilled graduates find the creative industries they wish successful career.” work across the creative industries to be involved in.” including the visual effects, The final year of all degrees games, and animation sectors. Exposing students to the same at Bradford is fundamentally In recent years technology used in industry concerned with applying the studios such as Centroid 3D, means they can hit the ground skills learned throughout the located at Pinewood Studios, and running. Modules include motion course to a real-world setting. Ninja Theory have been on the capture, facial modeling, animation, list of graduate destinations. lighting, and rendering. Abson said, “In our Design for Industry module, students work Ben Guthrie, Motion Capture “We actively update our directly for clients. Our Digital Supervisor at Framestore says, technology based on industry Media Working Academy also “Practical motion capture development,” explained Abson. reinforces this message through experience is a huge benefit to “Our software ranges from standard its search for commercial work, a potential hire. When browsing packages such as Autodesk which our students can apply CVs as an employer, someone Maya, Motion Builder, and for, giving them valuable with hands-on studio or post Mudbox to more specialist professional experience.” processing experience definitely packages such as Nuke, Zbrush, goes to the top of the list. It allows Unity, and CryEngine. We also Rebecca Leybourne, a student at the employee a chance to confirm invested in industry standard the University of Bradford said, that the industry is indeed for hardware, of which the most “Learning motion capture has them, and ensures that that they notable is our Vicon motion been a great way to really bring come to the job knowing enough capture system.” my animations to life. To think to be productive right away.”

The department’s motion capture studio consists of 16 Vicon T20 “Practical motion capture experience cameras. The T20 is capable of capturing a staggering 500 is a huge benefit to a potential hire. frames per second at full frame When browsing CVs, someone with resolution. It can accurately capture high speed movements hands-on experience definitely goes such as an action sequence or a golf swing. The system is also to the top of the list.” capable of capturing both full body and detailed facial movement.

The motion capture modules are designed around industry practice and run like a real studio. Students get to take on roles from setting up the capture stage through to cleaning up data and end use.

“Students walk away with a mixture of industry specific skills based on the path they take 05 The Standard 2012

Vicon Entertainment OPTIMIZING THE CAPTURE VOLUME USING ROBOTIC RADIO FREQUENCY TECHNOLOGY Louis-Nicolas Robert, Ms. Cinema.

Last year, the Digital Imagery Research and Development Center was launched in Matane, Québec, Canada. Key players of digital imagery in entertainment and research were present at this grand opening: Autodesk Media and Entertainment; the University of Québec in Rimouski; and the Natural Sciences and Engineering Research Council of Canada. Known as CDRIN, this R&D center was developed over the last 10 years by the Cégep of Matane and marks a new way of doing business in R&D and Services.

CDRIN was specifically designed Figure 1. for R&D projects and big motion capture productions. The 8000 square foot studio includes a 20 foot truss structure with four arches that allow multiple capture volumes in the same space. In addition to that, another truss in the top of the studio was built to support two stuntmen for acrobatic motion. The studio boasts 48 T160 motion Three T160s are on a capture cameras, two Bonita rotating pod. Camera systems and Vicon’s entertainment movement is triggered by software package, Blade. It is also a radio frequency marker. equipped with other technologies such as the SPS 1000 from interactive media programming, system called SPS 1000. Quattriuum Inc. (Montreal) who urbanism, and computing. are currently working with CDRIN The first step was setting up the in R&D. One of the important paradigms of capture volume, and like any studio, CDRIN has two main objectives: CDRIN is the focus on developing it was an adventure to prepare a technology transfer and developing new tools in digital imagery and solid, specific volume. To change local, national, and international because of that, optimizing the that volume, a ladder or rig man projects relating to R&D and digital motion capture pipeline is a was needed to change the imagery. The Cégep of Matane large field of research. CDRIN is camera angle. will help develop the R&D Center currently working with Quattriuum in six key educational programs: Inc. to optimize the motion capture The project began with basic computer animation, multimedia, pipeline with the help of the questions about the capture photography, electronics, robotic Radio Frequency (RF) volume – can a new capture 06 The Standard vicon.com/standard

volume be changed or configured the Vicon cameras and conducted Vicon’s T160 cameras. We already quickly without touching any a couple of tests with the RF system. have a bunch of ideas to test cameras? Can the quality of the multiple ways to work with these data captured on the edge of the The next step will be the two innovative technologies. The volume be enhanced? Each time utilization of RF markers to rotate volume capture issue is just our OPTIMIZING THE CAPTURE VOLUME USING the response to these questions three pods simultaneously at the first branch of research, but surely always pointed to robotic tools. same time (see fig 1). With around not the last.” ROBOTIC RADIO FREQUENCY TECHNOLOGY 40 cameras, three of them (the The hypothesis was the following: red ones) are on pods that can On a larger scale, CDRIN hope the use of robotics for changing rotate on three axes. Now, the to capture with all the T160’s camera rotation can enhance the range of the volume is not static. on pods. The automatic rotation quality of capture data and can The new volume can be set capabilities will not only enhance also capture the data of a new up very quickly. After a new the quality of data capture, but volume more rapidly. This system calibration, the new volume is will also optimize the motion is based on three pods that can ready to use with faster, high capture pipeline. rotate on three axes and track quality data capture. a radio frequency marker at any place in the volume. Olivier Munger, Co-Researcher and President of Quattriuum Inc. said, Louis-Nicolas Robert is the Any type of camera can be placed “We’re just in the beginning of Info Project and Business Development on the pods. CDRIN tried three of our research using SPS 1000 and Manager at CDRIN

Vicon Engineering VIRTUAL ENVIRONMENTS WITH CLARITY “For me, the Bonita cameras really stand out for three reasons – low latency, a Discover more. youtube.com/ high refresh rate up to 200 Hz, and the watch?v=qHv 3zxvM0Uk wide field of view.”

developed, our technology quality of the experience for the requirements have grown, so last user,” said Bouchet. year we purchased our first Vicon Bonita system to use in our VR A workbench is a simpler and environments.” generally smaller VR application, Based in Laval, France, CLARTE and includes two small angled specializes in high performance The largest VR environment at screens to display CAD data for equipment in the field of virtual CLARTE is the powerwall. A the user to interact with. The reality (VR), augmented reality powerwall is a large stereoscopic view on the screens change (AR), and haptics. It offers a screen, with a projector that with the user’s perspective by service for companies wishing creates a high quality picture. tracking the person’s head. This to incorporate VR into their It is mostly used for design system is most frequently used development process. CLARTE reviews, viewing models on a 1:1 to validate the mechanical acts as a test facility for VR and scale, where picture quality and assembly of components in a AR equipment and continually sense of immersion is crucial. manufacturing setting. develop innovative experimental The user, wearing a pair of Bouchet praised, “For me, the applications based on virtual stereoscopic glasses, is tracked Bonita cameras really stand out and AR technologies. with the Bonita cameras as they interact with the display. for three reasons – low latency, Alexandre Bouchet, Responsible a high refresh rate up to 200 Hz, Technique & Scientifique at “We’ve been really impressed and the wide field of view. Two CLARTE said, “Our first with the quality of the system so cameras will create quite a large experiments in VR started with far, especially with the powerwall, tracking volume, which is pretty the installation of a Reality Center where a wide field of view and low impressive.” in 1999. As the company has latency is very important to the 07 The Standard 2012

Vicon Life Science AN INNOVATIVE APPLICATION AT THE UNIVERSITY OF BASEL Beat Göpfert

Measuring 3D deformation under dynamic loading conditions Understanding dynamic 3D Laboratory of Biomechanics and loading conditions. These results, deformation of the pelvic Biocalorimetry, the Laboratory combined with a computer Credit Courtesy of the is a crucial factor in for Movement Analysis Basel at tomography, allow the linkage University of Basel the successful design and the University Children’s Hospital between the 3D-movement of longevity of complex orthopedic Basel (UKBB) and the Paediatric the reflecting surface markers oncological implants. Orthopaedic Department of the and its underlining bone structure. UKBB. The tests were performed This opens new possibilities The current measurement at the interdisciplinary medical in validating biomechanical techniques do not offer an optimal research center, Clinical Morphology simulations based on the finite level of accuracy; thus it would be & Biomedical Engineering, at the element method and may increase interesting to utilize new technology University of Basel. the longevity of complex implant to measure the pelvic bone to see systems. if we can improve the knowledge Over the last few years, base, for a better implant design. advancement in motion capture A 3D linear stage (M-461-XYZ-M, We hypothesized it would be technology has opened the doors Newport Spectra-Physics GmbH, possible to achieve sub-millimeter for new fields of study where Darmstadt, Germany) with three accuracy by combining a material high resolution is needed. The manually-driven differential testing machine with a 3D motion combination of a servo-hydraulic micrometers (DM-13, Newport capture system, to measure material testing machine (MTS Spectra-Physics GmbH, Resolution deformation of a whole human Bionix 858, MTS Systems 0.0001 mm) was mounted on cadaverous pelvis specimen. Corporation, Eden Prairie, MN, the table of the material testing USA) with a Vicon motion capture machine in order to determine The measurement setup is the system allows the measurement the initial accuracy of the set-up. result of a collaboration of the of 3D deformation under dynamic 08 The Standard vicon.com/standard

Several markers on the stage capsule and the ligaments intact. leads towards a comfortable and could be seen by a different Then an adjustable fixture was precise measurement methodology number of cameras. This allowed fixed at the sacrum, allowing for determining 3D movements the simulation of a real test unconstrained rotational and and deformation in the range from condition, where not all markers transversal motion [Widmer micrometers to several centimeters. are simultaneously seen by all 1997]. After adjusting the pelvis Adding a CT-scan allows a linkage cameras. The accuracy of the on the testing machine, about 80 of surface 3D-deformation setup (six MX13+ and four T40 reflective markers were fixed at measurements with the underlying cameras) was dependant on the anatomically defined positions bony structure, which assists the number of cameras tracking a on the bone with cyanoacrylate. development of Finite Element marker: with six or more cameras, Finally, the dynamic loading of the Modeling and Rapid Prototyping. the accuracy was ±0.022mm; with specimen could be performed. It two cameras, it was ±0.036mm. consisted of 100 sinusoidal cycles This new approach opens possibilities at 1 Hz with amplitudes between in dynamic testing of a wide range The limiting factor of the system 100 N and either 0.5; 1; or 1.5× of materials, like anatomical was the noise level of the cameras. body weight respectively. The specimens, biomaterials, and its During static data collection, it movement was tracked at a frame combinations. The resulting 3D was possible to detect movements rate of 60 Hz. deformation dataset can be used as small as 0.01mm; however, due for a better estimation of material to the noise level of the cameras Following this, the whole specimen characteristics of the underlying this wasn’t expected for dynamic with all the markers was carefully structures. This is an important measurements. Even taking into moved to the CT-scanner. The factor in reliable biomechanical account the noise level, the CT-scan was done in the same modeling and simulation as well accuracy of the Vicon system position as the mechanical test. as the successful design of was still approximately 20 times Finally the 3D-data of the tracked complex implants. better than the resolution of a markers and the dataset from medical CT-scanner. the CT-scan were combined in Persons involved in the project: one single dataset holding the Marie Freslier; MSc biomed eng The measurement of 3D-deformation 3D-position of the markers Beat Göpfert; MEng EMBA of a human pelvic bone was done with its underlying structure. Andreas H. Krieg, M.D. in a two-leg standing position. Zdzislaw Krol; PhD. First the soft tissue was removed It can be concluded that the Dieter Wirz, M.D. from the fresh frozen and thawed combination of a Vicon system specimen, while leaving the joint with a material testing machine

“Even taking into account the noise level, the accuracy of the Vicon system was still approximately 20 times better than the medical CT scanner.”

Credit Courtesy of the University of Basel

09 The Standard 2012

Vicon Entertainment PICKS VICON FOR MOTION CAPTURE Vicon has signed an agreement to become the main motion capture technology supplier to The Imaginarium.

Credit AP/Press Association

The Imaginarium is a London- performance capture consultancy Vicon is supplying 80 of its based studio, co-founded by and production services to film cutting edge T160 motion capture actor/director Andy Serkis studios, television, and video cameras and new Blade software. and film producer Jonathan game companies as well as Nick Bolton, Vicon’s CEO says, Cavendish. The Studio offers developing its own work. 10 The Standard vicon.com/standard

“We couldn’t be happier than to be collaborating with such News in Brief talented people. This is much more than just a contract to supply equipment; we’re working closely with The Imaginarium team on this exciting venture, which aims to become a global center of WHAT’S NEW AT VICON excellence taking motion capture to a new level - technologically and creatively.” Earlier this year, Vicon announced The Imaginarium is also taking part in Vicon’s alpha project for the launch of a new range within the its next major entertainment Bonita product family - Bonita Video. software release, due to be announced soon. Bonita Video is the world’s rate of 120 Hz that captures Andy Ray, Vicon’s Sales and first reference video camera every detail in HD resolution. Support Manager added, “The designed specifically for motion The monochrome 480m will Vicon T160 cameras are the capture. Combined with the capture high speed movement most advanced motion capture world’s first dynamic calibration with an impressive frame rate cameras available today. They will technique using the Vicon of 350 fps. enable The Imaginarium to film Active Wand, video and optical on location in outdoor settings, cameras can now be calibrated Vicon’s Life Science software adding another level of realism together providing unrivalled package, Nexus, has also to the actors’ performance.” accuracy. been updated to support the new hardware. The 16 megapixel cameras and The Bonita Video range latest software will enable The launches with three new vicon.com/products/ Imaginarium to deliver high quality cameras. The 720, available Info bonita.html data which, combined with the in color or monochrome, has vicon.com/products/ studio’s unique creative direction, nexus.html will make it one of the world’s leading a fully synchronized frame performance capture studios. Nicholas Taylor, The Imaginarium’s Managing Director, says, “The Imaginarium is a world-class performance capture studio, whose ambition is to become internationally recognized for harnessing science, art and cutting edge technology to create emotionally engaging characters that delight and astound audiences all over the globe. Vicon were the obvious choice of partner for us as we pursue this goal.”

Andy Serkis and Info joined forces in 2009 to pursue their vision of combining an integrated performance capture facility with a cutting edge development and production studio.

We want your feedback. from Vicon, please take five minutes to vicon.com/support complete the customer satisfaction To ensure we’re as up to date as survey located in your Vicon Online possible on the service you’ve received Support Account.

11 The Standard 2012

Dr. Ed Biden is Professor, Info Mechanical Engineering Dean, School of Graduate Studies at University of New Brunswick, Canada. Vicon Life Science LITERATURE REVIEW THE STANDARD Ed Biden, Ph.D.

For this review we consider four papers, all of which examine measurement technology with Vicon as the data collection system.

Wolf, A., Senesh M., “Estimating An eight camera Vicon MX system be an improvement in the accuracy joint kinematics from skin motion was used for data collection. over more conventional low pass observation: modeling and filtering combined with a Point validation”, Computer Methods Markers were applied in a pattern Cluster Technique. For anyone in Biomechanics and Biomedical to either the rigid model of the who hasn’t run across Kalman Engineering, 2011, Vol 14:11, forearm or to the forearms of the Filtering, the concept is that for pp 939-946. participants. The participants’ a noisy measurement situation, motions were done in a jig which you develop a model of the The authors are looking at ways allowed independent measurement system you are going to measure to reduce the effect of skin of the movements. The motions and then as the noisy data is motion artifact. Their model for were relatively slow so that high collected and is mapped against comparison uses markers on a velocity or acceleration were not the model predictions as a means rigid body simulating the human really confounding factors. The of reducing the noise. These arm with experiments on the study hypothesis was that by are used widely in engineering of 18 volunteers (10 M and 8 F). using a Kalman Filter there would measurements.

Both Kalman Filtering and low pass filtering combined with the Point Cluster Technique improved the results but there was no particular improvement for Kalman filtering. The authors think this is due to the model not being accurate enough, which is probably true. This raises the question of just how complex a model one would need to be able to model skin characteristics.

In many ways the take home message of this paper is to always evaluate new procedures carefully before assuming they will improve on what has gone before.

Reid, M., Campbell, A., Elliott, B., “Technical Note: Comparison of Endpoint Data Treatment Methods-

12 The Standard vicon.com/standard

for Estimation of Kinematics and Gholizadeh H, Osman NA, Kamyab Hong WH, Chen HC, Yang FP, Wu Kinetics Near Impact During the M, Eshraghi A, Abas WA, Azam MN. CY, Chen CL, Wong AM. “Speech- Tennis Serve” Journal of Applied Transtibial prosthetic socket associated labiomandibular Biomechanics 2011 E Publication pistoning: Static evaluation of movement in Mandarin-speaking ahead of Print. Seal-In(®) X5 and Dermo(®) Liner children with quadriplegic cerebral using motion analysis system. Clin palsy: a kinematic study.” Res Dev These authors also look at filtering Biomech 2012 vol (1) pp 34-99. Disabil. 2011 Vol 32(6): pp 2595- but in a very dynamic activity, the Epub 2011 Jul 26. 601. Epub 2011 Jul 19. tennis serve, particularly the point where the racquet and ball meet. This paper looks at the relative Every once in a while one runs They use a 12 Camera Vicon 612 movement between a person’s across an application of movement at 500 Hz. They applied markers to limb and the socket of their analysis which seems completely the racquet, hand, wrist, forearm, prosthetic leg. A typical suspension new. The authors use an older upper arm, and thorax; but focused system has a sock-like liner put on six camera Vicon 370 plus video. on the racquet tip for this over the amputated limb and the They track facial motions while experiment. By using the racquet leg is then slid into the prosthetic speaking, for a group of 12 children tip there is no skin artifact, only socket. The authors were interested with the Spastic Quadriplegia form the intrinsic error of the system in a new system to reduce “pistoning” of Cerebral Palsy and 12 controls plus the impact dynamics. of the limb inside the prosthetic (7 boys, 5 girls in each group). Both socket. To do this they tested groups were from 7 to 11 years old. They looked at a variety of various loading conditions in a approaches which have been used primarily static way using a Six millimeter markers were placed for this problem. They report that camera Vicon 612 system. on the faces of children and/or smoothing through the impact on a mask which covered the or stopping just prior to impact What makes this an interesting forehead and provided the reference and extrapolating are the most paper from a motion capture frame (the mask had four markers common approaches. They tried technology point of view is to define the coordinate system). extrapolation using equations of that they needed to measure Kinematic measurements were 2nd order and 5th order combined movement inside the prosthetic then made of the movement of with smoothing using either a socket. They start with a clear the face but focused on the plane Woltring quintic spline (QSF) or experimental socket. What is really of the mouth. a Butterworth digital filter. It is unique about this is that they then gratifying to see that the work put thin flat markers on the liner Children pronounced various of Hermann Woltring, who was inside the socket and image sounds which were judged to be a key collaborator for the early the markers through the clear “correct” or “incorrect” by a speech development of Vicon before his socket. The Vicon system was pathologist. These could then be untimely death, is still very much able to image flat markers on the matched with the facial kinematics in use. inside of the socket and on the as represented by measured outside and measure their relative displacements and velocities. The tests suggest that the optimal motion. The advantage of doing low pass cut off is only 17 Hz, it this way rather then measuring The authors were able to detect which seems quite low for such a relative to points on the skin difficulty in the coupling dynamic situation, although it is surface above the socket is that movements as the children with substantially higher than typical the socket extends up to knee cerebral palsy were speaking gait measures. level and this method means there compared to controls. Using is minimal effect of knee flexion. a Vicon system allowed The authors found that a measurement of both temporal combination of extrapolation and The authors were able to measure and spatial coupling. They found digital filtering didn’t give as good sub-millimeter changes in position that the problems which the a prediction as the QSF combined of the markers relative to one children experienced were primarily with the 2nd order extrapolation. another. The results show the temporal and that their facial Their results do suggest that earlier capability to measure in-socket velocity components were higher work probably underestimates motion and they did confirm their than the control group. velocity. They also find that there hypothesis that the system being are very large differences in tested reduced pistoning. In choosing papers for this review acceleration estimates. I was intrigued at the diversity of What I find amazing about this measurement which can be done This one might expect since a 2nd is imaging through the socket with movement analysis. The field order fit will probably not give a material, which I would not have grows by the day as people find good estimate of acceleration as thought possible. new things they can measure. the 2nd derivative. 13 The Standard 2012

Dr. Caroline Stewart is a Bioengineer Info in ORLAU, a clinical department of the Robert Jones and Agnes Hunt Orthopaedic Hospital in the UK.

Vicon Life Science LITERATURE REVIEW THE STANDARD Caroline Stewart, Ph.D.

In clinical gait analysis each patient poses a particular kind of challenge. Sometimes the challenges are technical, where careful thought is needed when positioning markers in the presence of pathological morphology, orthoses, prostheses, or adipose tissue.

On other occasions the focus of Physical Anthropology 143: secured through a tight glove, of the team is on the patient, 134-145 (2010). showed a pattern of movement who may be self-conscious, progressing down the upper limb determined to remove the When studying the lower limb, the joints from proximal to distal, a markers, or desperate to be analysis of walking has been the sequence also required for throwing. elsewhere. Working with human predominant focus of researchers. If you wish to walk on the knuckles subjects I am always full of The upper limb does not appear to of the upper limb then a stable admiration for those who attempt have an equivalent fundamental wrist is needed. When weight to perform movement analysis activity which dictates bearing is no longer required, new on animals. Perhaps the greatest development, function, and possibilities open up. This paper challenge of all, however, is to engagement in society. Stone tool shows the first step, which led understand the movement of production, however, had a major in time to the screw driver, the subjects who no longer exist. influence on human development hedge trimmer, and the laptop. This is the concern of researchers and this study seeks to link the with an interest in archaeology. morphology of the upper limb Raichlen DA, Armstrong H & with the ability to knap flint, Lieberman DE. Calcaneus length Archaeology is a particular interest fundamental to the production determines running economy: of mine, so writing this review of early tools. Flint knapping is the Implications for endurance has given me the opportunity to process by which a hammer stone running performance in modern bring two of my worlds together. is gripped in one hand and humans and Neanderthals. Saying that, I am very much an brought down hard on a flint Journal of Human Evolution. amateur digger, so I apologize nodule, breaking off a flake. 60:299-308 (2011). Also featured for any inadvertent archaeological in New Scientist ‘You’d beat a heresies. Kinematic analysis of the flint Neanderthal in a race’ Issue 2798 knapping process highlighted (Feb 2011). Williams EM, Gordon AD & the importance of wrist mobility, Richmond BG. Upper limb especially wrist extension, in In order to hunt prey in a hot kinematics and the role of generating sufficient force to climate, endurance running is the wrist during stone tool break off a flint flake. Modern important. Human beings sweat production. American Journal flint knappers, with markers and so are able to keep cool 14 The Standard vicon.com/standard

during sustained running. The cost of Neanderthals would be recreate a scene in the Termopolium same is not true of potential significantly higher than that of (tavern) in Pompei using a Mixed quadripedal prey which depend modern man. It should be a relief Reality method. In order to be on panting to maintain their body to know that if you ever meet a effective, skin, clothing, faces, and temperature. Being unable Neanderthal on a dark night at a movements had to be credible and to and pant concurrently, biomechanics conference, you authentic. Characters needed to animals which are pursued for should be able to run away. be able to move and interact. The a long period collapse with heat authors drew on architectural exhaustion. In this fascinating Magnenat-Thalmann N, information, social customs, study the endurance running Papagiannakis G. Recreating dress, and hairstyles and used a capacity of Neaderthals is Daily life in Pompeii. Virtual Vicon system to capture motion compared with that of Archaeology Review 1:16-20 (2010). sequences using actors. A number contemporaneous modern humans. of technical challenges had to This paper comes from what may be overcome. During running, energy is stored be referred to as ‘the other side in the Achilles tendon. Having a of Vicon’s world’. For those of us As well as informing visitors to short moment arm about the ankle working in biomechanics, the historic sites, simulations can increases the potential for elastic applications of animation and contribute to the understanding energy storage, so having a short virtual reality rarely cross our path. of how buildings and structures calcaneal tuber should correlate were used, bringing the past with greater running efficiency. Understanding historic cultures back to life. The authors of this paper and civilizations involves a leap were able to demonstrate this of the imagination. This will be I hope the papers above have relationship in an analysis of eight apparent to anyone who has been of interest. The desire to distance runners. The Achilles visited an archaeological site and understand the links between tendon moment arm explained has walked around a town, structure, function, and 64% of the variation in mass- a castle, or a temple in ruins. environment are common to specific energy cost. Trying to recreate the vibrant many researchers using Vicon world which existed centuries systems. I have certainly enjoyed Fortunately Neanderthal remains before can be a challenge, the excuse to read articles in a include calcanei, which could be helped only in part by display completely different area of measured. It turns out that these boards and museum exhibits. research from my own. were relative long. The authors therefore predict that the energy This paper describes a project to

15 The Standard 2012

Vicon Engineering GETTING CREATIVE WITH FLEXIBLE VIRTUAL REALITY

University of California, San to upgrade our motion capture and works with their Vicon Diego (UCSD) started their technology for something that motion capture system. Vicon partnership with Vicon in is easy to deploy and flexible contributes real-time head and 2006 with the purchase of a enough to use anywhere on hand tracking for multiple 25-camera high-end motion campus or on location.” virtual reality installations using the framework. capture system. The system Experience from more than is currently installed in the six years of campus-wide Margolis said, “For example, a university’s 20,000 sq. ft. collaborations and many CalVR plug-in called ArtifactVis research facility, but is publications reporting on those merges archaeology with interactive often used on location for projects both in the virtual 3D VR. The head position is used university projects. reality (VR) community and so we can properly render a left also the domain sciences is eye and right eye image from UCSD houses an organized flowing into the design and the user’s perspective. The hand research unit, The Center for development of the new tracking provides us with the Research in Computing and the CalVR software framework. capability to interact with the Arts (CRCA). As UCSD’s oldest arts virtual world on many levels. We can research center, CRCA has a long CalVR is a virtual reality simply navigate through spaces as history of facilitating immersive framework that develops numerous well as significantly alter the form and interactive artworks, and VR projects, most of which and content of virtual objects. pursues speculative cultural are classified as scientific activities that draw upon visualization, cultural heritage “So far, the research is going humanistic analysis, engineering or pre-visualization. It supports great! Vicon Tracker provides us innovation, and the insights of nonstandard VR systems like with low latency and accurate artistic expression. autostereoscopic displays, as data to enable rich interactive well as multi-user support for environments. Using an extremely Todd Margolis, Technical Director viewing and interaction. CalVR high quality and reliable system for CRCA at UCSD said, “Historically, has built-in navigation algorithms, that is easy to deploy in research we used various forms of custom a 3D menu system, support for labs as well as public venues like and professional tracking systems, collaborative work at different museums and galleries, gives us the but six years ago we decided sites, and a variety of 3D displays flexibility we need to be creative.”

Every issue is Credit available online at Courtesy of UCSD vicon.com/standard

The Standard www.vicon.com/standard

2012 The Standard

University of Southampton USING HOLLYWOOD TECHNOLOGY academics are pioneering a new way of using motion TO UNLOCK THE SECRET OF capture technology to examine the way pianists PIANIST’S SOUNDS play the piano. By using a unique kinematic measurement technique, known as HAWK (Hand And Wrist Kinematics), researchers will be able to look at individual pianists’ playing technique - giving an insight into the posture of their hands on the keys and the movements they use - hopefully showing how this translates into the unique sound they create.

The research will also provide new information on musicians’ hand health, to combat wrist injury (for example, repetitive strain injury - a common problem for pianists).

The project is being led by world- renowned pianist and University of Southampton Music Professor David Owen Norris and Health Sciences academic Dr. Cheryl Metcalf. Professor Norris can track the hand movements of pianists by using a 12 camera T-Series system and Nexus software from Vicon

Dr. Cheryl Metcalf, who designed, developed and validated the

Continued

Mo Cap in Education Serkis picks Vicon Quantic Dream Standing on two University of Bradford Vicon + The Imaginarium Powered by Vicon Human Bipedalism 04 10 17 18

16 The Standard vicon.com/standard

Vicon Entertainment QUANTIC DREAM ‘KARA’ TECH DEMO POWERED BY VICON

After the phenomenal to play seated, allowing only a The Kara project took very narrow field of movements. approximately seven months to Credit success of Heavy Rain, Courtesy of developer Quantic Dream This brought numerous issues, complete from casting to final Quantic Dream in particular the need for the delivery. This included R&D on wanted to push the boundaries actor to perform the same thing Quantic Dream’s new PS3 game of motion capture even twice and for the animators to engine, setting up the new further. Investing in 36 render the facial and body motion capture studio, and all new T-Series cameras was movements coherently.” the preparation work for the just the first step. shoot day. As an exclusive Sony PlayStation(TM) The motion capture for Heavy developer, Quantic Dream “Kara was our very first attempt Rain was done using a Vicon wanted to provide Sony with at realizing a full performance F-Series system back in 2007. a demo that showcased what capture session. It enabled Guillaume de Fondaumière, the new Vicon technology was us to better understand and Discover more. Co-CEO and Executive Producer capable of. streamline the possibilities of youtube.com/ watch?v= at Quantic Dream explains, this technique and its processes,” mSnFN8Ja58s “With our F-Series system, we “When we were developing the said Fondaumière. had to split the performance in Kara tech demo, the high precision two: the body was shot on our of the T160 cameras made it large stage, but the facial possible for us to capture the Quantic Dream’s next PS3 title, capture had to be shot in our entire performance of our actors Info Beyond: Two Souls, is due to sound booth, forcing the actor at once, and on a large stage.” be released Q1, 2013. 17 The Standard 2012

Vicon Life Sciences STANDING ON TWO FEET Researchers at George Washington University are collecting data on fossilized human footprints to discover the evolutionary secret behind human bipedalism

Dr. Brian Richmond and Kevin Hatala said, “Our research focuses grow up habitually unshod (not on understanding the evolution wearing shoes). As such, the Credit Hatala at George Washington Courtesy ofof University are studying how of human bipedal locomotion. In development of their foot George WashingtonWashington particular anatomical and order to address questions about anatomy and function has not University functional variables influence how human locomotion has been influenced by modern our locomotion. They hope to evolved, we need to quantify the footwear. This condition likely develop a hypothesis about kinematics of human bipedalism.” provides the best approximation how our ancestors, whose of foot anatomy and function in Richmond and Hatala conduct our evolutionary ancestors, who anatomies were slightly many of their biomechanical most likely did not wear footwear different than our own, may experiments in the field, near until recently (the past 50,000 have moved in a similar or Lake Turkana in northern Kenya, years or so). different manner. gathering data on people who

18 The Standard vicon.com/standard

Hatala continues, “Field conditions and functional variables, such as We still have much more to learn, are not conducive to the setup joint postures and the distribution however, about the interactions that one would prefer for a of peak pressures, are recorded between variables and how typical biomechanics laboratory. in footprint topography,” substrate properties influence However, we’ve been able to use explained Hatala. footprint morphology. a combination of video cameras and Vicon Motus to digitize By developing a thorough We hope to use the Vicon joint markers in order to understanding of how these system to analyze the effects capture kinematic data from variables are recorded in of substrate properties on gait. our experimental subjects. footprints, they hope to infer With some more work, we can from human fossil footprints how apply our results to the human “The Vicon system enables us these variables have changed fossil record to address some to easily capture kinematic data through human evolution. of the important hypotheses in a field setting, which would about the evolution of human otherwise be very difficult. We “We are finding that particular anatomy and locomotion.” are able to travel to a very remote anatomical and functional concluded Hatala. part of the world, and collect variables do leave detectable sophisticated data that can signatures in footprint topography. typically only be collected in a laboratory setting.”

Fossilized footprints are being “The Vicon system allows us to discovered with increasing frequency in the human fossil easily capture kinematic data in a record. Researchers know of fossil footprints that sample at field setting, which would otherwise least three different species of be very difficult. We are able to human ancestors, across a time range from 3.7 million years travel to a very remote part of the ago to the very recent past. world, and collect sophisticated Credit “Our research is aimed at Courtesy of understanding how particular data that can typically only be George Washington University anatomical and functional variables are recorded in collected in a laboratory setting.” footprints. By quantifying the influence of specific variables, we hope that these new discoveries can be used as informative tools that will provide new insight on long-standing questions about the timing and nature of the evolution of human bipedalism,” said Hatala.

The unshod volunteers provide data on their foot anatomies and foot function, which helps the researchers understand how it is represented in footprints. After collecting basic metric data on each subject’s foot anatomy, the volunteer walks across a pad that measures the distribution of foot pressure, and then through a patch of wet sediment to produce a footprint.

“We analyze the data to look at how anatomical variables, such as arch height and toe length, 19 The Standard vicon.com/standard

Stay up to date on the with us on Facebook Always Online. latest Vicon news, software social media. facebook.com/vicon releases, new products and Twitter celebrate the brilliant work twitter.com/_vicon YouTube of our customers. youtube.com/vicon100

Vicon Events

ESMAC Entertainment 2012 Stockholm, Sweden CONFERENCES September 12 - 15, 2012 SIGGRAPH SfN Los Angeles, CA Events throughout the world allow New Orleans, LA August 7 - 9, 2012 you to visit with colleagues and November 13 - 17, 2012 meet up with your friends at Vicon. They are great opportunities to discover what’s new, get answers Vicon Sudoku to support questions and to let us know what you are working on. EXERCISE YOUR NOGGIN Please check the website ISBS for complete up-to-date Melbourne, Australia 5 2 8 1 4 listings vicon.com/ July 2 - 6, 2012 companyevents.html 8 3 7 9 ECSS 5 4 9 Life Science Bruges, Belgium July 4 - 7, 2012 9 8 4 2 3 2 7 9 ISPGR 3DHMA Trondheim, Norway Bologna, Italy 6 5 4 3 June 24 - 28, 2012 July 18 - 20, 2012 4 3 8 ESB ASB 9 5 2 7 Lisbon, Portugal Gainsville, FL July 1 - 4, 2012 August 15 - 19, 2012 2 5 7 8 1

QR Codes are a quick and smart phone. Once installed, download a Reader, QR Codes. easy way to share video, take a picture of the code type ‘QR Code’ into your pictures and websites on and the Reader will take search engine. your smart phone. you directly to the video.

Wondering vicon.com/ To use QR Codes, download For more information on what these are? standard a QR Code Reader from your QR codes and how to

Sign up to receive The Standard vicon.com/standard designbyz3.com