A SOFTWARE-DEFINED OVERLAY VIRTUAL NETWORK WITH SELF-ORGANIZING SMALL-WORLD TOPOLOGY AND FORWARDING FOR FOG COMPUTING By KENSWORTH C. SUBRATIE A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2019 © 2019 Kensworth C. Subratie This dissertation enshrines the memories of your love, aspirations, and selfless sacrifices. Dedicated to Myrtle Doocran. ACKNOWLEDGMENTS I acknowledge and thank the many people who have influenced and contributed to my progress throughout my doctoral studies. Foremost, I thank my advisor Dr. Renato Figueiredo for his ongoing guidance through this journey. Next, I thank Dr. Jose Fortes for presenting the opportunities that have challenged me to grow as a researcher. I also thank the rest of my PhD committee for their valuable comments, feedback and time. To my peers in the ACIS Lab, both its current and graduated members, with whom I worked alongside over the years, I thank you for making my time at UF a very enjoyable experience. I would like to thank Dr. Paul Hansen, Dr. Cayelan Carey and the members of the PRAGMA and CENTRA groups whose collaborations and support have broadened my insight. Additionally, the experience I garnered from internships with the IBM, Intel and NICT research groups has been invaluable and is sincerely appreciated. Finally, I must express my heartfelt gratitude to my family and loved ones for their ongoing patience, encouragement, support and willingness to attempt to understand what I do and why I chose to do it. This material is based upon work supported in part by the National Science Foundation under Grants No. 1527415, 1339737, 1234983 and 1550126. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. 4 TABLE OF CONTENTS page ACKNOWLEDGMENTS................................................................................................. 4 LIST OF TABLES........................................................................................................... 8 LIST OF FIGURES ........................................................................................................ 9 LIST OF ABBREVIATIONS .......................................................................................... 11 ABSTRACT.................................................................................................................. 13 CHAPTER 1 INTRODUCTION ................................................................................................... 15 Motivation .............................................................................................................. 15 Contribution ........................................................................................................... 17 2 OVERVIEW ........................................................................................................... 20 Terminology ........................................................................................................... 20 Virtual Networks .................................................................................................... 21 P2P Overlay Networks .......................................................................................... 22 Software Defined Networks ................................................................................... 23 Internet of Things................................................................................................... 24 Fog Computing ...................................................................................................... 24 Cloud Native Applications - Micro-services ............................................................ 25 Related Works ....................................................................................................... 26 3 ON THE DESIGN AND IMPLEMENTATION OF IP-OVER-P2P OVERLAY VIRTUAL PRIVATE NETWORKS .......................................................................... 30 Background ........................................................................................................... 30 Core Abstractions and Architecture ....................................................................... 31 Decoupling Endpoint Discovery from Overlay ........................................................ 34 Decoupling Control from Datapath ......................................................................... 35 Software-Defined Switching ................................................................................... 38 Concluding Remarks ............................................................................................. 41 4 TOWARDS DYNAMIC, ISOLATED WORK-GROUPS FOR DISTRIBUTED IOT AND CLOUD SYSTEMS ....................................................................................... 45 Background ........................................................................................................... 46 Architecture ........................................................................................................... 50 The Control Plane - IPOP Controller ............................................................... 51 5 The Data Plane - Tincan ................................................................................. 55 Case Study ............................................................................................................ 57 GroupVPN ....................................................................................................... 57 SocialVPN ....................................................................................................... 60 Discussion ....................................................................................................... 61 Concluding Remarks ............................................................................................. 62 5 TOWARDS ISLAND NETWORKS: SDN-ENABLED VIRTUAL PRIVATE NETWORKS WITH PEER-TO-PEER OVERLAY LINKS FOR EDGE COMPUTING ........................................................................................................ 65 Background ........................................................................................................... 67 IoT Application Characteristics ........................................................................ 68 Model Characteristics ...................................................................................... 68 Networking Implications .................................................................................. 69 Overlay and Island Networks Concepts ........................................................... 70 An Architecture for Overlay Networks .................................................................... 71 Controller ........................................................................................................ 72 Data Plane ...................................................................................................... 73 Experimental Evaluation ........................................................................................ 74 Experimental Testbed ..................................................................................... 74 Scenarios and Results .................................................................................... 75 Results and Analysis ............................................................................................. 76 Concluding Remarks ............................................................................................. 77 6 BOUNDED FLOOD: SCALABLE LAYER 2 FORWARDING FOR DYNAMIC CLOUD TO EDGE NETWORK ENVIRONMENTS ................................................ 80 Background ........................................................................................................... 82 Design ................................................................................................................... 85 IPOP Controller ............................................................................................... 86 SDN Controller ................................................................................................ 88 Learning Table .......................................................................................... 89 Flood Route and Bound ............................................................................ 89 Flooding Bound Algorithm ......................................................................... 90 Overlay Churn........................................................................................... 92 Evaluation.............................................................................................................. 92 Experiment Test Cases ................................................................................... 93 Testbed ........................................................................................................... 95 Results and Analysis ............................................................................................. 96 Cost of soft state ............................................................................................. 96 Join or Departure Cost .................................................................................... 97 Route Discovery Cost.....................................................................................