Handling Qualities Criteria for Training Effectiveness Assessment of the BS115 Aircraft B. van Lierop Technische Universiteit Delft HANDLING QUALITIES CRITERIAFOR TRAINING EFFECTIVENESS ASSESSMENT OFTHE BS115 AIRCRAFT by B. van Lierop in partial fulfillment of the requirements for the degree of Master of Science in Aerospace Engineering at the Delft University of Technology, to be defended publicly on Wednesday August 23, 2017 at 9:30 AM. Supervisor: Ir. J. A. Melkert TU Delft Thesis committee: Dr. Ir. M. F.M. Hoogreef TU Delft Ir. T. J. Mulder TU Delft An electronic version of this thesis is available at http://repository.tudelft.nl/. Thesis Registration Number: 147#17#MT#FPP PREFACE "Man’s flight through life is sustained by the power of his knowledge" Austin Dusty Miller I am proud to present this master thesis, which marks the end of my time as an aerospace engineer- ing student at Delft University of Technology. It would not have been possible to complete this thesis without the support of all the people around me, for which I would like to express my gratitude. First of all I would like to thank Blackshape SpA, and in particular Giuseppe Verde, for providing me with the opportunity to do my thesis work at this wonderful company. Secondly I would like to thank my supervisor Joris Melkert for his guidance, support, and feedback throughout this project. I would also like to thank Maurice Hoogreef and Hans Mulder for being a part of my thesis committee. Special thanks to Paolo Mezzanotte for his never-ending enthusiasm and support throughout both my master thesis and internship. I have thoroughly enjoyed our conversations and discussions over the past years. I would also like to thank Balázs Fehér, Agostino De Giuseppe and all other colleagues from Blackshape for their involvement, enthusiasm and inspiring conversations. Finally I would like to thank my family and friends, for all the support and love they have given me over the years. B. van Lierop Delft, August 2017 iii SUMMARY With the introduction of the BS115, successor of the Blackshape Prime, a new opportunity for military training is presented. In this thesis the training effectiveness of the BS115 was investigated to identify how the training potential could be increased. During the investigation of the available training effectiveness evaluation methods in literature it was found that the effect of handling qualities on the training effectiveness is one of the most impor- tant criteria. However, none of the available methods covered this topic to a satisfactory extend. As a result, the objective of this thesis has been to find what handling qualities should be improved to maxi- mize the training effectiveness of the BS115 with respect to developing flying skills. The first task towards this objective was to establish proper evaluation criteria. Based on the aircraft characteristics and United States Air Force training program the BS115 was identified to be suitable for the introductory and primary phases of training. The evaluation criteria were then determined based on the stability and control requirements from the military standard, as well as by using some typical training missions. To test the criteria established, data from a series of CS-VLA certification test flights for the BS115 was available. Additionally, stability and control derivatives of the aircraft, established using DATCOM, were used to compute the aircraft characteristics that could not be determined from the flight test data. The method was validated using the Cessna Citation as a reference. It was found that derivatives could be obtained quickly, but accuracy was limited. Based on the training effectiveness evaluation performed on the BS115, stability characteristics were found to be adequate. Additionally, roll response and roll performance met the requirements posed. Both longitudinal control and aileron control forces were found to be too low to achieve satisfactory handling qualities. Finally, the training tasks showed that the avionics system needs some improvement for optimum ground reference manoeuvring and that steep turn performance is reduced in turbulent air. To perform a complete training effectiveness evaluation, it is important to cover the entire spec- trum of pilot skills and not only handling qualities. Therefore it is recommended for future research to integrate the method presented here into a complete training effectiveness evaluation method. v CONTENTS Summary v List of Figures xi List of Tables xiii Nomenclature xvi List of Abbreviations....................................... xvi List of Symbols.......................................... xvi 1 Introduction 1 1.1 Motivation.........................................1 1.2 Literature Review......................................2 1.2.1 Training Effectiveness: The Bazzocchi Method....................2 1.2.2 Effectiveness of Military Training Aircraft......................4 1.2.3 Multi-Criteria Decision Making Processes and Fuzzy Logic.............4 1.3 Objective and Research Question..............................5 1.4 Range and Scope......................................6 1.5 Project Outline.......................................7 2 Training Effectiveness Evaluation Criteria9 2.1 Training Program......................................9 2.1.1 Joint Specialized Undergraduate Pilot Training...................9 2.1.2 Next Generation Fighter Pilot Training........................ 11 2.1.3 Training Role of the BS115.............................. 12 2.2 Military Standard Criteria.................................. 12 2.2.1 MIL-F-8785C..................................... 13 2.2.2 Longitudinal Handling Qualities Criteria....................... 13 2.2.3 Lateral-Directional Handling Qualities Criteria................... 14 2.2.4 Maximum Roll Control Force............................ 15 2.3 Closed-loop Handling Quality Criteria........................... 15 2.3.1 Cooper-Harper Rating................................ 15 2.3.2 BS115 Training Missions............................... 15 2.4 Conclusion......................................... 17 3 Flight Testing 19 3.1 Flight Test Instrumentation................................. 19 3.2 Flight Test Procedure.................................... 21 3.2.1 Configuration Requirements............................. 21 3.2.2 Longitudinal Stability With Respect to Speed.................... 22 3.2.3 Phugoid Stability................................... 22 3.2.4 Short-period Oscillation............................... 23 3.2.5 Pitch Manoeuvring Force.............................. 24 3.2.6 Dutch Roll...................................... 24 3.2.7 Roll Mode...................................... 24 vii viii CONTENTS 4 BS115 DATCOM Model 27 4.1 BS115 DATCOM Input................................... 27 4.1.1 Flight Conditions.................................. 27 4.1.2 Reference Points................................... 27 4.1.3 Fuselage....................................... 28 4.1.4 Wing......................................... 28 4.1.5 Empennage..................................... 28 4.1.6 Power Plant..................................... 28 4.2 Code Verification...................................... 28 4.3 Calculation Verification................................... 30 4.3.1 Longitudinal Stability Derivatives Verification.................... 31 4.3.2 Lateral-Directional Stability Derivatives Verification................. 33 4.4 Model Validation...................................... 34 4.4.1 Longitudinal Stability Derivatives Validation..................... 34 4.4.2 Lateral-Directional Stability Derivatives Validation................. 35 4.5 BS115 Stability Derivatives................................. 35 5 BS115 Handling Quality Evaluation 37 5.1 Longitudinal Stability With Respect to Speed........................ 38 5.1.1 Longitudinal Stability at Test Point 1......................... 39 5.1.2 Longitudinal Stability at Test Point 2......................... 40 5.1.3 Longitudinal Stability - Summary.......................... 41 5.2 Phugoid Motion....................................... 42 5.2.1 Phugoid Motion at Test Point 1............................ 43 5.2.2 Phugoid Motion at Test Point 2............................ 44 5.2.3 Phugoid Motion - Summary of Results........................ 44 5.3 Short Period......................................... 45 5.3.1 Short Period Motion at Test Point 1......................... 46 5.3.2 Short Period Motion at Test point 2......................... 46 5.4 BS115 Longitudinal Control Characteristics......................... 47 5.4.1 Control Forces at Test Point 3............................ 47 5.4.2 Control Forces at Test Point 2............................ 49 5.4.3 Control Forces - Summary of Results......................... 50 5.5 BS115 Dutch Roll Characteristics.............................. 51 5.5.1 Dutch Roll at Test Point 2.............................. 51 5.5.2 Dutch Roll Motion - Summary of Results....................... 52 5.5.3 Dutch Roll Evaluation Criteria............................ 53 5.6 BS115 Roll Mode...................................... 54 5.6.1 Roll-mode Time Constant.............................. 54 5.6.2 Roll Performance.................................. 55 5.6.3 Roll Control Force.................................. 57 5.7 Spiral Mode......................................... 59 5.8 BS115 Pilot Feedback.................................... 61 5.9 Discussion of Results.................................... 64 6 Conclusions 67 7 Recommendations 69 A BS115 Aircraft Data 71 A.1