On the Design, Performance, and Management of Virtual Networks for Grid Computing
Total Page:16
File Type:pdf, Size:1020Kb
ON THE DESIGN, PERFORMANCE, AND MANAGEMENT OF VIRTUAL NETWORKS FOR GRID COMPUTING By MAURÍCIO TSUGAWA A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2009 1 © 2009 Maurício Tsugawa 2 To all who, directly or indirectly, contributed to make this milestone possible 3 ACKNOWLEDGMENTS I would like to express my sincere gratitude to my advisor, Prof. José Fortes, for his invaluable guidance and support throughout my many years as graduate student. Prof. Fortes presented me with opportunities to pursue challenging research problems; always made time to work with me through his busy schedule; and shared his experience, helping me become a better researcher. I would like to thank Prof. Alan George, Prof. Renato Figueiredo, and Prof. Shigang Chen for serving on my supervisory committee. I would like to thank Tim Freeman and Dr. Kate Keahey for their support with Nimbus clouds, and for the opportunity to work in a "flash" internship at the Argonne National Laboratory. I would like to thank Dr. Ananth Sundararaj, Dr. Peter Dinda, Dr. Sebastien Goasguen, Dr. Sumalatha Adabala and Rick Kennel for the help in setting up the test environment at Northwestern University and Purdue University. I am thankful to Andréa Matsunaga for all her help. Special thanks to my sister, Dr. Márcia Rupnow, who always supported me. This work was funded in part by the National Science Foundation under Grants No. EIA- 9975275, EIA-0224442, ACI-0219925, EEC-0228390, EIA-0107686, EIA-0131886, OCI- 0721867 and CNS-0821622; NSF Middleware Initiative (NMI) collaborative grants ANI- 0301108/ANI-0222828, SCI-0438246. I would also like to acknowledge the BellSouth Foundation, SUR grants from IBM and gifts from VMware Corporation and Cyberguard. 4 TABLE OF CONTENTS page ACKNOWLEDGMENTS.................................................................................................................... 4 LIST OF TABLES................................................................................................................................ 8 LIST OF FIGURES ............................................................................................................................ 10 ABSTRACT ........................................................................................................................................ 13 CHAPTER 1 INTRODUCTION....................................................................................................................... 15 Grid Computing ........................................................................................................................... 15 Grid Networking Problem .......................................................................................................... 16 Solution Overview ...................................................................................................................... 19 Contributions ............................................................................................................................... 21 Organization ................................................................................................................................ 22 2 BACKGROUND ......................................................................................................................... 23 Network Infrastructure for Grid Computing - Problem Description ....................................... 23 Grid Deployment Difficulties in the Internet ............................................................................ 24 Virtual Network Approaches ...................................................................................................... 26 Virtual LAN (VLAN) .......................................................................................................... 27 Virtual Private Network (VPN) .......................................................................................... 29 VNET – Northwestern University ...................................................................................... 31 SoftUDC vnet – HP Labs. ................................................................................................... 33 VIOLIN – Purdue University.............................................................................................. 35 X-Bone – University of Southern California ..................................................................... 37 RON - Massachusetts Institute of Technology .................................................................. 38 Peer-to-peer (P2P) overlay networks.................................................................................. 39 OCALA – University of California Berkeley ............................................................ 41 IPOP – University of Florida ....................................................................................... 43 LogMeIn Hamachi ....................................................................................................... 44 Summary ...................................................................................................................................... 44 3 ON THE DESIGN OF VIRTUAL NETWORKS ..................................................................... 46 Virtual Networks for Grid Computing ....................................................................................... 46 Network Address Space ...................................................................................................... 46 Network Interface ................................................................................................................ 48 Routing ................................................................................................................................. 49 Firewall traversal ................................................................................................................. 53 5 Design of a Virtual Network (ViNe) Architecture for Grid Computing ................................. 54 ViNe Address Space and ViNe addresses .......................................................................... 57 ViNe Node Configuration ................................................................................................... 57 ViNe Infrastructure .............................................................................................................. 59 Firewall traversal .......................................................................................................... 60 ViNe routing ................................................................................................................. 62 Multiple Isolated Virtual Networks ............................................................................ 63 Putting it all together .................................................................................................... 64 Discussion ..................................................................................................................... 65 Security Considerations ............................................................................................... 68 ViNe Prototype Implementation ................................................................................................ 69 VR-software components .................................................................................................... 69 Configuration Module ......................................................................................................... 70 Packet Interception Module ................................................................................................ 72 Packet Injection Module...................................................................................................... 74 Routing Module ................................................................................................................... 74 ViNe Prototype ............................................................................................................................ 77 VR performance ................................................................................................................... 77 ViNe performance ............................................................................................................... 79 4 ON THE PERFORMANCE OF VIRTUAL NETWORKS ..................................................... 82 Characterizing Network Virtualization ...................................................................................... 82 Experimental Setup ..................................................................................................................... 83 Virtual Network Processing........................................................................................................ 84 Encapsulation Overhead ...................................................................................................... 86 Packet Interception .............................................................................................................. 88 Packet Injection.................................................................................................................... 90 Routing ................................................................................................................................. 91 Virtual Links .......................................................................................................................