Adaptive and Secured Resource Management in Distributed and Internet Systems
Total Page:16
File Type:pdf, Size:1020Kb
W&M ScholarWorks Dissertations, Theses, and Masters Projects Theses, Dissertations, & Master Projects 2002 Adaptive and secured resource management in distributed and Internet systems Li Xiao College of William & Mary - Arts & Sciences Follow this and additional works at: https://scholarworks.wm.edu/etd Part of the Computer Sciences Commons Recommended Citation Xiao, Li, "Adaptive and secured resource management in distributed and Internet systems" (2002). Dissertations, Theses, and Masters Projects. Paper 1539623406. https://dx.doi.org/doi:10.21220/s2-deqc-ew25 This Dissertation is brought to you for free and open access by the Theses, Dissertations, & Master Projects at W&M ScholarWorks. It has been accepted for inclusion in Dissertations, Theses, and Masters Projects by an authorized administrator of W&M ScholarWorks. For more information, please contact [email protected]. Reproduced with with permission permission of the of copyright the copyright owner. owner.Further reproductionFurther reproduction prohibited without prohibited permission. without permission. Adaptive and Secured Resource Management in Distributed and Internet Systems A Dissertation Presented to The Faculty of the Department of Computer Science The College of William & Mary in Virginia In Partial Fulfillment Of the Requirements for the Degree of Doctor of Philosophy by Li Xiao 2002 Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. APPROVAL SHEET Tliis dissertation is submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy .JU Li Xiao Approved. July 2002 Thesis Advisor V)JjU^ 'I William L. Bvmun ' Phil Kearns c/C'-vX ^ A^ Robert E. Noonan Marc Slier Department of Physics Reproduced with permission of the copyright owner. Further reproduction prohibited without permission To my parents iii Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. Table of Contents Acknowledgments xi List of Tables xiv List of Figures xxii Abstract xxiii 1 Introduction 2 1.1 Background ....................................................................................................................... 2 1.2 Problems .......................................................................................................................... 4 1.3 Statements of Contributions ........................................................................................ 5 1.4 Organization of the Dissertation .............................................................................. 7 2 Application level resource management of memory systems 8 2.1 Literature overview on memory utilization in centralized servers .................... 8 2.2 Improving Memory Performance of Sorting Algorithms ..................................... 10 2.3 Architectural and Algorithmic Parameters and Evaluation Methodology . 13 2.3.1 Architectural and algorithmic param eters ................................................ 13 iv Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. 2.3.2 Performance evaluation methodology ........................................................... 13 2.3.3 Data se ts .............................................................................................................. 15 2.4 Cache-Effective Mergesort Algorithms .................................................... 16 2.4.1 Tiled mergesort and multiinergesort ........................................................... 16 2.4.2 New mergesort alternatives ............................................................................ 17 2.4.2.1 Tiled mergesort with padding .................................................... 17 2.4.2.2 Multiinergesort with TLB padding ............................................. 21 2.4.3 Trade-offs relating to an instruction count increase and the perfor mance g a i n ......................................................................................................... 24 2.5................................Cache-Effective Q uicksort ................................................................ 25 2.5.1 Memory-tuned quicksort and multiquicksort ............................................. 26 2.5.2 New quicksort alternatives ............................................................................... 26 2.5.2.1 Flash Quicksort............................................................................... 27 2.5.2.2 Inplaced flash quicksort .................................................................. 27 2.5.3 Simulation results ............................................................................................ 28 2.6 Measurement Results and Performance Evaluation ........................................ 29 2.6.1 Mergesort performance comparisons ........................................................... 31 2.6.2 Quicksort performance comparisons ........................................................... 34 2.7 A Prediction Model of Performance Trade-Offs ........................................... 36 2.8 Chapter Conclusion ..................................................................... 41 3 Load Sharing for Global Memory System Management 43 3.1 Literature overview on load sharing for global memory in distributed systems 43 v Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. 3.2 CPU-memory-bascd Load Sharing 47 3.2.1 CPU-Memory-Based Load Sharing Policies ............................................. 49 3.2.2 Performance Evaluation M ethodology ....................................................... 53 3.2.2.1 A simulated cluster ........................................................................ 54 3.2.2.2 Workload Traces ............................................................................... 55 3.2.2.3 System conditions ............................................................................ 56 3.2.3 Performance Results and A nalysis .............................................................. 57 3.2.3.1 Overall Performance Comparisons ............................................. 57 3.2.3.2 Paging and Queuing ........................................................................ 59 3.2.3.3 High Performance and High Throughput ................................ 61 3.2.4 Summary ............................................................................................................. 62 3.2.5 Brief description of our study on heterogeneous system s ...................... 62 3.2.5.1 CPU/Memory Weights and Heterogeneity ............................... 63 3.2.5.2 Summary of Our Heterogeneous Study ................................... 65 3.3 Incorporation job migration and network RAM to share memory resource . 66 3.3.1 Objectives of the study .................................................................................. 66 3.3.2 Job-migration-based load sharing vs. network R A M ............................ 68 3.3.2.1 Network RAM organizations ....................................................... 68 3.3.2.2 CPU-Memory-basod load sharing ................................................ 69 3.3.3 Performance Evaluation M ethodology ....................................................... 70 3.3.3.1 Performance m e tric s ........................................................................ 70 3.3.3.2 A simulated workstation clu ster ................................................ 71 3.3.3.3 W orkloads ......................................................................................... 72 vi Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. 3.3.4 Simulation Results and A nalysis .................................................................. 73 3.3.4.1 Impact of limited network bandwidths ..................................... 73 3.3.4.2 Trade-offs between page fault reductions and load sharing . 77 3.3.5 An improved load sharing scheme .................................................................. 79 3.3.6 Summary ............................................................................................................. 80 4 Resource Management in Internet Caching Systems 84 4.1 Overview of existing caching system structures .................................................. 84 4.2 Changes in Both Workload and Internet Technologies .................................... 86 4.2.1 W orkload Changes ......................................................................................... 86 4.2.1.1 Trend in NLANR Workload ......................................................... 86 4.2.1.2 Trend in BU Workload ................................................................ 88 4.2.2 Technology Changes ......................................................................................... 91 4.3 Overview of the Limits on Existing Caching System Structures ...................... 92 5 Locality and Information Sharing among Browsers 95 5.1 Browsers-Aware Proxy Server 96 5.2 Simulation Environment .............................................................................................. 97 5.2.1 Traces .................................................................................................................... 98 5.2.2 A browsers-proxy caching environment ....................................................... 100 5.3 Performance Evaluation .............................................................................................