A MOTION CAPTURE FRAMEWORK TO ENCOURAGE CORRECT EXECUTION OF SPORT EXERCISES by Suraj Ho - 1504223 [email protected] Master thesis presented to the Faculty of Sciences at the VU University Amsterdam Supervisor Anton Eliens Second reader Natalia Silvis - Cividjian Abstract This thesis will describe the design and development of an exercise monitoring system framework using the Microsoft Kinect v1 and v2. The purpose of this framework was to make it easier to create reference models, especially for domain experts such as trainers and coaches. These models could then be used to monitor users whether they use the proper technique during exercising and help them improve those techniques. This in contrast to similar systems that focus on increasing adherence to exercising. To be able to monitor users, the system should be able to determine when the user does something wrong and what he or she did wrong. During the design and development process I have also compared the accuracy between the Kinect v1 and the v2. Based on those results I have described whether the accuracy is sufficient to determine the technique used during an exercise. Preface i Table of Contents Preface ................................................................................................................................................... iii 1 Introduction .................................................................................................................................... 1 1.1 Problem statement ................................................................................................................. 1 1.2 Motivation ............................................................................................................................... 1 1.3 Agenda .................................................................................................................................... 1 2 Motion tracking ............................................................................................................................... 3 2.1 Systems ................................................................................................................................... 3 2.1.1 Optical systems ............................................................................................................... 3 2.1.2 Non-optical systems ........................................................................................................ 4 3 Related work ................................................................................................................................... 7 3.1 Healthcare ............................................................................................................................... 7 3.1.1 Jintronix ........................................................................................................................... 7 3.1.2 Doctor Kinetic .................................................................................................................. 8 3.1.3 VirtualRehab ................................................................................................................... 8 3.1.4 Reflexion Health .............................................................................................................. 8 3.2 Sports ...................................................................................................................................... 8 3.2.1 Your Shape: Fitness Evolved ........................................................................................... 8 3.2.2 Nike+ Kinect Training ...................................................................................................... 9 3.3 Summary ................................................................................................................................. 9 4 An overview of the Kinect ............................................................................................................. 10 4.1 The Kinect v1 ......................................................................................................................... 10 4.1.1 The hardware ................................................................................................................ 11 4.1.2 The software – The Kinect for Windows SDK................................................................ 15 4.2 The Kinect v2 ......................................................................................................................... 30 4.2.1 The hardware ................................................................................................................ 30 4.2.2 The software ................................................................................................................. 32 5 Developing the prototype ............................................................................................................. 33 5.1 CrossFit .................................................................................................................................. 33 5.1.1 Why CrossFit ................................................................................................................. 34 5.2 Design .................................................................................................................................... 34 5.2.1 The hardware setup ...................................................................................................... 35 5.2.2 The application .............................................................................................................. 36 i | P a g e ii A motion capture framework to Encourage correct execution of sport exercises 5.3 Analyzing movements ........................................................................................................... 40 5.3.1 Gestures ........................................................................................................................ 40 5.3.2 The three movements ................................................................................................... 43 5.3.3 Recording the movements ............................................................................................ 44 5.3.4 Breaking down the movements .................................................................................... 45 5.4 Implementing the movements ............................................................................................. 47 5.4.1 Kinect v1 ........................................................................................................................ 47 5.4.2 Kinect v2 ........................................................................................................................ 51 5.5 Results ................................................................................................................................... 55 6 Evaluation and discussion ............................................................................................................. 57 6.1 Inaccurate data ..................................................................................................................... 57 6.2 The difficulty of creating gestures ........................................................................................ 58 6.3 Future work ........................................................................................................................... 59 7 Conclusion ..................................................................................................................................... 61 7.1 Research questions answered .............................................................................................. 61 7.2 Reflection .............................................................................................................................. 62 8 Acknowledgement ........................................................................................................................ 64 Bibliography .......................................................................................................................................... 65 Appendix A - SkeletonRecorder2 .......................................................................................................... 69 MainWindow.xaml ............................................................................................................................ 69 MainWindow.xaml.cs........................................................................................................................ 72 Appendix B - BodyBasics-WPF .............................................................................................................. 81 MainWindow.xaml ............................................................................................................................ 81 MainWindow.xaml.cs........................................................................................................................ 83 Appendix C - MyOwnVGBTest2 ............................................................................................................ 88 MainWindow.xaml ............................................................................................................................ 88 MainWindow.xaml.cs........................................................................................................................ 90 KinectBodyView.cs ...........................................................................................................................