Group-Based Parallel Multi-scheduling Methods for Grid Computing Abraham, G. T. Submitted version deposited in Coventry University’s Institutional Repository Original citation: Abraham, G. T. (2016) Group-Based Parallel Multi-scheduling Methods for Grid Computing. Unpublished PhD Thesis. Coventry: Coventry University Copyright © and Moral Rights are retained by the author. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This item cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder(s). The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders. Some materials have been removed from this thesis due to third party. Pages where material has been removed are clearly marked in the electronic version. The unabridged version of the thesis can be viewed at the Lanchester Library, Coventry University. Group-Based Parallel Multi-scheduling Methods for Grid Computing Goodhead Tomvie Abraham June 2016 A thesis submitted in partial fulfilment of the University’s requirements for the degree of Doctor of Philosophy Faculty of Engineering and Computing Coventry University Group-Based Parallel Multi-scheduling Methods for Grid Computing Abstract With the advent in multicore computers, the scheduling of Grid jobs can be made more effective if scaled to fully utilize the underlying hardware and parallelized to benefit from the exploitation of multicores. The fact that sequential algorithms do not scale with multicore systems nor benefit from parallelism remains a major challenge to scheduling in the Grid. As multicore systems become ever more pervasive in our computing lives, over reliance on such systems for passive parallelism does not offer the best option in harnessing the benefits of their multiprocessors for Grid scheduling. An explicit means of exploiting parallelism for Grid scheduling is required. The Group-based Parallel Multi-scheduler for Grid introduced in this work is aimed at effectively exploiting the benefits of multicore systems for Grid job scheduling by splitting jobs and machines into paired groups and independently multi-scheduling jobs in parallel from the groups. The Priority method splits jobs into four priority groups based on job attributes and uses two methods (SimTog and EvenDist) methods to group machines. Then the scheduling is carried out using the MinMin algorithm within the discrete group pairs. The Priority method was implemented and compared with the MinMin scheduling algorithm without grouping (named ordinary MinMin in this research). The analysis of results compared against the ordinary MinMin shows substantial improvement in speedup and gains in scheduling efficiency. In addition, the Execution Time Balanced (ETB) and Execution Time Sorted then Balanced (ETSB) methods were also implemented to group jobs in order to improve on some deficiencies found with the Priority method. The two methods used the same machine grouping methods as used with the Priority method, but were able to vary the number of groups and equally exploited different means of grouping jobs to ensure equitability of jobs in groups. The MinMin Grid scheduling algorithm was then executed independently within the discrete group pairs. Results and analysis shows that the ETB and ETSB methods gain still further improvement over MinMin compared to the Priority method. The conclusion is reached that grouping jobs and machines before scheduling improves the scheduling efficiency significantly. i Acknowledgement My deepest and sincere appreciation goes to my Director of Studies Professor Anne James whose tremendous support, commitments, suggestions, ideas, encouragement and mentorship helped shaped this work and moulded me. She contributed immensely to bring this work this far. I will forever remain grateful as I keep thanking my stars for having you with so much wealth of knowledge and experience as my Director of Studies. My special thanks and appreciation also go to my project supervisor Dr.NorlailyYaacob who inspired me and this work in many ways. I am grateful for all your support, suggestions, brilliant criticisms and corrections and for keeping me focused on the work.. I also wish to thank and appreciate my third supervisor Dr. Saad Amin and Dr. Reda Albodour whose early contributions helped point out a direction for the research. I also wish to extend my gratitude to Prof. Kuo-Ming Chao whose contributions and observations especially during the PRPs contributed greatly to shape this work. I owe a depth of gratitude to all the staff and research colleagues in Coventry University, words cannot express my gratitude for the role you all played at different stages of this work, I am deeply grateful. My gratitude also goes to the management of the National Information Technology Development Agency (NITDA) (who in their quest to bridge the information technology gap between Nigeria and the Western world and place Nigeria on the IT map) granted me scholarship and availed me the opportunity to undertake this research. My most profound appreciation goes to the Niger Delta University management and the government of Bayelsa State of Nigeria for approving my study leave to enable me embark on this dream journey. Most importantly, I would extend my special thanks and appreciation to my family for all the sacrifices they made on my behalf during this period. To my wife Mrs Goodhead Enimokie, thank you for all your prayers which strengthened me. Also, thank you for playing both the role of a father and mother for our children while I was away. To my very young children: Rodney, Jahsmine, Wyse, Richarmah, Anne-Okievei and King- Giasue. I owe you all so much for the vacuum my absence created in your young and formative lives. I know how much you all miss me. I am also grateful to my brothers: Millionaire, Marshal, and Benjamin and sisters Census, Edith and Izibelogo for their persistent prayers and unflinching support at every point of my trying time. To my friends, I say a big thank you for your various support and encouragement during this period. I owe a dept of gratitude to the following persons: HRH King Godwin Gurosi Igodo (The Obene-Ibe of Atissa Kingdom), Dr. and Mrs. Godwin T. Igodo, Bar. Esueme Dan Kikile, Mr. Enime Godwin Yakiah, Mr. Kemi Ungbuku, Dr. Augustin Timbiri and Dr. Ovienadu Torutein. ii Group-Based Parallel Multi-scheduling Methods for Grid Computing And finally, to all the members of Bayelsa Focus Group (BFG), I say a big thank you for remaining behind the scene to provide me with virtual company at those lonely periods during this sojourn. iii Dedication To the memory of my mother Mrs. Balafakuma Abraham (nee Reuben) who despite all odds ensured that academic pursuit remains one and only option for me, dedicated her life towards achieving that cause but died at the brinks of the goal becoming a reality. iv Group-Based Parallel Multi-scheduling Methods for Grid Computing Published Articles Journal Contributions 1. Abraham, G. T., James, A., and Yaacob, N. (2015a) ‘Priority-Grouping Method for Parallel Multi-Scheduling in Grid’. Journal of Computer and System Sciences, (81)6, 943-57 DOI: http://dx.doi.org/10.1016/j.jcss.2014.12.009 2. Abraham, G. T., James, A., and Yaacob, N. (2015b) ‘Group-based Parallel Multi- scheduler for Grid Computing’ Future Generation Computer Systems, 50, 140- 153 DOI: http://dx.doi.org/10.1016/j.future.2015.01.012 Conference Contributions 1. Abraham G. T., James, A., and Yaacob, N (2014) Group-Based Parallel Multi- scheduler for Grid Computing [Poster presentation] ‘Coventry University and University of Warwick Branch BCS Event’. Warwick: Computer Science Department University of Warwick, 19th Feb 2014 2. Abraham G. T., James, A., and Yaacob, N (2014) Group-Based Parallel Multi- scheduler for Grid Computing (revised) [Poster presentation] ‘Coventry University Annual Faculty Research Symposium’. Coventry: Faculty of Engineering and Computing, Coventry University, 26th Feb 2014 v Table of Contents Table of Contents Abstract .................................................................................................................................................... i Acknowledgement .................................................................................................................................. ii Dedication .............................................................................................................................................. iv Published Articles .................................................................................................................................... v Table of Contents ................................................................................................................................... vi List of Equations ..................................................................................................................................... xi List of Tables ......................................................................................................................................... xii List of Figures ....................................................................................................................................... xiii Acronyms .............................................................................................................................................. xv CHAPTER ONE