Old Dominion University ODU Digital Commons Computer Science Theses & Dissertations Computer Science Winter 2000 An Architectural Framework for Performance Analysis: Supporting the Design, Configuration, and Control of DIS /HLA Simulations David B. Cavitt Old Dominion University Follow this and additional works at: https://digitalcommons.odu.edu/computerscience_etds Part of the Computer Sciences Commons Recommended Citation Cavitt, David B.. "An Architectural Framework for Performance Analysis: Supporting the Design, Configuration, and Control of DIS /HLA Simulations" (2000). Doctor of Philosophy (PhD), dissertation, Computer Science, Old Dominion University, DOI: 10.25777/pt3w-4242 https://digitalcommons.odu.edu/computerscience_etds/72 This Dissertation is brought to you for free and open access by the Computer Science at ODU Digital Commons. It has been accepted for inclusion in Computer Science Theses & Dissertations by an authorized administrator of ODU Digital Commons. For more information, please contact [email protected]. AN ARCHITECTURAL FRAMEWORK FOR PERFORMANCE ANALYSIS: SUPPORTING THE DESIGN, CONFIGURATION, AND CONTROL OF DIS/HLA SIMULATIONS by David B. Cavitt B.S. June 1989, Old Dominion University A Dissertation Submitted to the Faculty of Old Dominion University in Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY COMPUTER SCIENCE OLD DOMINION UNIVERSITY December 2000 Approved by: f C. Michael GverstreqL(Director) Kurt J. Maly (Co-Director) Richard E. Nance (Member) mber) R. Bowen Loftin (Member) Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. ABSTRACT AN ARCHITECTURAL FRAMEWORK FOR PERFORMANCE ANALYSIS: SUPPORTING THE DESIGN, CONFIGURATION, AND CONTROL OF DIS/HLA SIMULATIONS David B. Cavitt Old Dominion University, 2000 Director: Dr. C. Michael Overstreet Technology advances are providing greater capabilities for most distributed computing environments. However, the advances in capabilities are paralleled by progressively increasing amounts of system complexity. In many instances, this complexity can lead to a lack of understanding regarding bottlenecks in run-time performance of distributed applications. This is especially true in the domain of distributed simulations where a myriad of enabling technologies are used as building blocks to provide large-scale, geographically disperse, dynamic virtual worlds. Persons responsible for the design, configuration, and control of distributed simulations need to understand the impact of decisions made regarding the allocation and use of the logical and physical resources that comprise a distributed simulation environment and how they effect run-time performance. Distributed Interactive Simulation (DIS) and High Level Architecture (HLA) simulation applications historically provide some of the most demanding distributed computing environments in terms of performance, and as such have a justified need for performance information sufficient to support decision-makers trying to improve system behavior. This research addresses two fundamental questions: 1) Is there an analysis framework suitable for characterizing DIS and HLA simulation performance? and 2) what kind of mechanism can be used to adequately monitor, measure, and collect performance data to support different performance analysis objectives for DIS and HLA simulations? This thesis presents a unified, architectural framework for DIS and HLA simulations, provides details on a performance monitoring system, and shows its effectiveness through a series of use cases that include Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. practical applications of the framework to support real-world U.S. Department of Defense (DoD) programs. The thesis also discusses the robustness of the constructed framework and its applicability to performance analysis of more general distributed computing applications. Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. Student is copyright owner: © 2000 David B. Cavitt. All Rights Reserved. Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. This thesis is dedicated to Ellen; my wife, partner, and best friend. Her constant and tireless intention makes this thesis as much hers, as it is mine. XOXOXO Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. vi ACKNOWLEDGEMENTS First and foremost, I must thank my principal advisor, Mike Overstreet. During this work, he kept me pointed in the right direction, patiently stood by when productivity waned, and helped to see this dissertation was brought to fruition. The value of his experience and guidance to me has been immeasurable. Similar thanks go to Kurt Maly, my co­ advisor, whose experience and insight have always been right on the mark. Additional thanks go to Dick Nance, Ravi Mukkamula, and Bowen Loftin for their outstanding guidance and critical reviews during my research. Their clear and concise viewpoints, and experience significantly enhanced the quality of this effectuation. Thanks also go to Ed Harvey and Jack McGinn, for their continual encouragement throughout my research and writing. Ed’s practical and candid editorial contributed significantly to the text. Jack’s quite reserve and gentle prods were always welcome reminders to “make it happen.” Thanks also need to be expressed to the rest of my compatriots at BMH who willingly and admirably filled the voids while I was working on this thesis. As for family and friends, I am especially indebted to Lloyd and Barbara Schnuck. Their vision, kindness, and support provided the impetus for me to take the “first step.” My gratitude to them is only surpassed by what I owe to my mother and father, whose encouragement and support has been constant in all that I’ve ever done. What they taught, has served me well in education, my profession, and my personal life. I love them dearly. Similar sentiments go to the rest of my family: my sister Cherie, two brothers Bill and Robert, Mac and Virginia Coupland, the Mundens, and the Petersons. I’m extremely fortunate to be surrounded by such caring family whose interest and encouragement supported me during the completion of this work. Finally, I must thank my wife Ellen, and children David and Anne, who have patiently waited for me to persevere. They have been, and always will be my beacons. “Hey kids, looks like Dad finished first after all. Yeehaa!” Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. TABLE OF CONTENTS Page LIST OF TABLES............................................................................................... x LIST OF FIGURES............................................................................................. xi LIST OF ACRONYMS...................................................................................... xiii Section 1. INTRODUCTION................................................................................. 1 Problem Definition .................................................................................. 3 Application Domains .............................................................................. 3 DoD Modeling Issues ....................................................................... 6 DoD Distributed Simulation Architectures ................................... 10 Simulation Network (SIMNET) ............................................... 10 Distributed Interactive Simulation, Semi-Automated Forces, and Intelligent Agents ................................................. 12 Aggregate Level Simulation Protocol (ALSP)...................... 15 High Level Architecture (HLA)............................................... 17 Thesis Objectives.................................................................................... 19 Thesis Approach..................................................................................... 22 Thesis Organization ................................................................................ 25 A Framework for Characterizing DIS and HLA Simulation Performance ...................................................................................... 25 Performance Monitoring.................................................................. 26 Performance Monitoring Use Cases and Conclusions ................. 26 2. RELATED RESEARCH........................................................................ 27 Performance Analysis of Distributed Systems and Other Distributed Simulations .......................................................................... 27 Performance Analysis of DIS and HLA Simulations ........................ 31 Summary of Related Research .............................................................. 36 3. A FRAMEWORK FOR CHARACTERIZING DIS AND HLA SIMULATION PERFORMANCE....................................................... 38 A DIS and HLA Performance Abstraction .......................................... 38 Network Performance Factors ........................................................ 41 Simulation Infrastructure Performance Factors ........................... 43 Modeling Performance Factors ....................................................... 45 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. viii TABLE OF CONTENTS Page Scenario Factors