View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Etheses - A Saurashtra University Library Service Saurashtra University Re – Accredited Grade ‘B’ by NAAC (CGPA 2.93) Mehta, Mihir J., 2006, “Performance measurement and analysis of PC based cluster server using SET of Architecture and modeling a scalable High performance cluster”, thesis PhD, Saurashtra University http://etheses.saurashtrauniversity.edu/id/eprint/339 Copyright and moral rights for this thesis are retained by the author A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This thesis cannot be reproduced or quoted extensively from without first obtaining permission in writing from the Author. The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the Author When referring to this work, full bibliographic details including the author, title, awarding institution and date of the thesis must be given. Saurashtra University Theses Service http://etheses.saurashtrauniversity.edu [email protected] © The Author “PERFORMANCE MEASUREMENT AND ANALYSIS OF PC BASED CLUSTER SERVER USING SET OF ARCHITECTURE AND MODELING A SCALABLE HIGH PERFORMANCE CLUSTER” A Thesis Submitted to SAURASHTRA UNIVERSITY, RAJKOT For the degree of Doctor of Philosophy In Computer Science and Application By MIHIR JITUBHAI MEHTA Under the Guidance of DR. N. N. JANI Professor and Head, Department of Computer Science, Saurashtra University, Rajkot. April 2006 CERTIFICATE This is to certify that the contents of this Ph.D. thesis entitled ³High Performance Computing Server and Network, Study and Analysis of Performance and Performance Tuning´ are the original research work of Mr. Mihir Jitubhai Mehta and leads to the advancement in the knowledge of High Performance Computing. The Thesis has been prepared under my supervision. I further certify that the work has not been submitted either partly or fully to any other university or institution for the award of any degree. Date: Dr. N. N. Jani Place: Professor and Head, Dept. of Computer Science, Saurashtra University, Rajkot. STATEMENT I hereby declare that on the work incorporated in the present thesis is the original and has not been submitted to any other university or institution for the award of Diploma or degree. I further declare that the results presented in the thesis, consideration made therein, contribute in general to the advancement of knowledge in Computer Science and in particular to ³PERFORMANCE MEASUREMENT AND ANALYSIS OF PC BASED CLUSTER SERVER USING SET OF ARCHITECTURE AND MODELING A SCALABLE HIGH PERFORMANCE CLUSTER´ in context of High Performance Computing and Cluster Servers. Date: Mr. Mihir Jitubhai Mehta DEDICATED TO MY BROTHER, SISTER & PARENTS MY WIFE ACKNOWLEDGEMENT It is a matter of immense pleasure for me to express my thankful gratitude to all those who have helped me in different ways. I am at a loss to find words to express my deepest gratitude to my honorable and learned guide Dr. N. N. Jani for his invaluable guidance, constructive criticism and encouragement throughout the course of my study despite he being unsparingly preoccupied with his own research work and guidance. I acknowledge that he kept me on track gently but firmly. I am thankful to all staff of the Department of Computer Science, Saurashtra University, constantly took interest in my pursuit and facilitated it in every possible way. Their genuine interest in my career and warm wishes constitute a great part my efforts. I Specially thankful to my co-research scholars for their kind co-operation. I shall be ever grateful to the Research Scholar - Dr. Bhavna Sohan Thakkar, and staff of MVM Computer Education Centre, Rajkot for their co-operation and goodwill. I am also thankful to Mr. Mayur Raval, Mr. Apurva Pandya, Shri K. H. Atkotia, Dhaval Kathriya for their moral support in my work. No words would ever be able to express my feelings for my wife, parents, my wife my brother and sister, all my relatives and friends who constantly inspired me. Without their constant concern for my career advancement it would have been nearly impossible for me to complete the stupendous task. Finally I wish to make devout supplication to the Divine Spirit without whose blessings this task would not have been accomplished. Mr. Mihir J. Mehta. CONTENTS ACKNOWLEDGEMENT I LIST OF FIGURES, TABLE & GRAPH II 1 Introduction to High Performance Computing 001 1.1 Research Objective 1.2 Statement of Title 1.3 Supercomputers – Current state of the art 1.4 HPC – Indian Contribution 1.5 Future scope for development 2 Parallelisation Technology 028 2.1 Introduction to Parallel computing 2.2 Parallel Computer System 2.3 Parallel Programming Paradigms 2.4 Parallel Programming Languages 2.5 Performance Issues 2.6 Clusters – An Economic approach to High Performance System 3 Cluster Computing Technology 110 3.1 Introduction 3.2 Cluster Technology 3.3 Cluster Classifications 3.4 Study of Commercial High Performance Systems 3.5 Cluster Features 4 Modelling a Scalable and Low cost Parallel architecture 180 4.1 OpenMosix – Technology 4.2 Cluster O. S. 4.3 High Performance Network Technology 4.4 Cluster Management Software – Integration of Cluster O.S. and Cluster applications 4.5 Modelling a Cluster Architecture 5 Implementation of Designed cluster architecture, Performance measurement and analysis 242 5.1 Network Connectivity overview 5.2 Cluster Installation 5.3 Resource Sharing Algorithms 5.4 Process Migration 5.5 Workload Management 5.6 Implementation of the developed application on Cluster System 5.7 Performance measurement & Analysis 5.8 Conclusion LIST OF FIGURES Chapter 1 1. Potential of HPC Chapter 2 2. Potential of Parallel Machine 3. UMA Model 4. NUMA Model 5. COMA Model 6. Messaging Passing Multicomputer 7. Vector Processor Model 8. PRAM Model 9. Shared data approach 10. Message passing approach 11. Architecture of PVM 12. A cluster configuration Chapter 3 13. Throughput Cluster 14. Capability Cluster 15. JeevaHA system configuration 16. JeevaHA Architectures 17. Architecture of Beo-wulf cluster 18. Windows cluster server block diagram 19. Ethernet Cluster 20. SCI Topology 21. KVM Switch Chapter 4 22. openMosixView main window 23. Process Monitor 24. Migration Monitor 25. openMosix analyzer Chapter 5 26. Proposed Model for open-Mosix cluster LIST OF TABLES Chapter 1 1. HPC applications 2. HPC Users in India Chapter 2 3. Memory Classification 4. HPC Users in India 5. Comparison of various Multiprocessor Architectures Chapter 5 6. mosctl – detail options 7. mosrun – detail options 8. mpstat – output 9. iostat – output 10. sar – output 11. top - output 12. netstat – output 13. Performance measurement of 1 server node 14. Performance measurement of 1 + 1 server node 15. Performance measurement of 1 + 2 server node 16. Performance measurement of 1 + 3 server node LIST OF GRAPHS Chapter 5 1. Performance measurement of 1 server node 2. Performance measurement of 1 + 1 server node 3. Performance measurement of 1 + 2 server node 4. Performance measurement of 1 + 3 server node 5. Performance analysis of suggested cluster setup Chapter: 1 IInnttrroodduuccttiioonn ttoo HHiigghh PPeerrffoorrmmaannccee CCoommppuuttiinngg 1 TABLE OF CONTENTS 1.1 Research Objective 1.2 Statement of Title 1.3 Supercomputers ± Current state of the art 1.4 HPC ± Indian Contribution 1.5 Future scope for development 2 1.1 RESEARCH OBJECTIVE The purpose of this thesis is to report on the work carried out by the researcher over the period of his doctoral study. The subject of supercomputing and its subset parallel computing has been researched extensively and is a well- established field. Methodology aside, there will always be an upper limit to how much computation a single processor- computing device can perform in a µreasonable¶ time. In the simple Neumann model, limits are imposed by processor clock rate, memory size and the storage capacity. The main objectives of my study are: · Present an overview of parallel computing and review the various strategies for parallelism. · Study the high performance computing technology in depth. · Study the Detailed information regarding Parallelisation technologies and architecture etc. · Understanding the functionality of cluster system and analysis of cluster, current scenario of the domain, detailed information and practical experience regarding cluster computing, its architecture, its installation procedures, how to build clusters, its performance evaluation etc« 3 · A project study of various clustering project like Beowulf, Jeehva Cluster, Microsoft Cluster Server, Sun Cluster etc« · Study the concepts of the OpenMosix Cluster architecture; suggest the model of cluster hardware. · Investigate its performance characteristics of the parallel application, principally to evaluate the designed model, its scalability and cost. · Describe further research activities that can expand, utilize and benefit from this work. 4 1.2 STATEMENT OF THE TITLE ³Performance measurement and analysis of PC based Cluster Server using set of architecture and modeling a Scalable High Performance Cluster´ The demand for parallel processing is high. Application areas with computational needs that require parallel processing include biomedical research, fluid dynamics, global climate modeling, molecular modeling, nuclear test simulations, astronomic simulations, and many others. Among them the interesting and challenging field for me is