Media Distribution Using Overlay Multicast and Peer-To-Peer Technologies
Total Page：16
File Type：pdf, Size：1020Kb
Media Distribution using Overlay Multicast and Peer-to-Peer Technologies Dissertation zur Erlangung des Doktorgrades der Mathematisch-Naturwissenschaftlichen Fakultäten der Georg-August-Universität zu Göttingen vorgelegt von Jun Lei aus Huzhou, China Göttingen 2008 D7 Referent: Professor Dr. Xiaoming Fu. Korreferent: Professor Dr. Dieter Hogrefe Tag der mündlichen Prüfung: 17 Juli, 2008 Abstract The explosive growth of multimedia services and applications (e.g. media streaming) demands an efficient, deployable media distribution system on the Internet. Although native IP multicast is regarded as an efficient way of delivering media streams to a group of receivers, it faces a number of technical and operational issues which have eventually prevented its widespread usage. The aim of this work is therefore to build a scalable, efficient, reliable and incrementally deployable infrastructure for supporting media distribution services. In this thesis, a new framework named Dynamic Mesh-based overlay Multicast Protocol (DMMP) framework, and two important extensions to the basic DMMP protocol, namely Self-improved DMMP protocol (DMMP+) and Interest-shared Group Management (IGMT) protocol for DMMP, are developed to efficiently serve a large number of concurrent clients with relatively high inbound bandwidth and low start-up delay. The DMMP framework dynamically manages a two-tier hierarchy, i.e., an overlay core so-called dynamic mesh, and clusters without relying on classic IP multicast. The key idea is to let a number of end hosts get selected and self-organized into the overlay hierarchy, and dynamically maintain such a hierarchy. In comparison to prior application layer multicast protocols, DMMP is more adaptive to group size changes, and provides efficient and reliable media delivery with less control overhead and less packet loss. DMMP+ extends the basic protocol in the DMMP framework to optimize the data delivery hierar- chy. Two self-improvement techniques are designed to gradually optimize the established overlay mesh and clusters. The analysis identifies that the DMMP+ protocol can assist the DMMP frame- work to be more scalable, reliable and efficient in the sense of providing better data path quality but less control overhead and packet loss. The IGMT protocol further extends DMMP+ to help the transient or partitioned nodes quickly join/rejoin the group in a highly dynamic environment. Motivated by an experimental investigation on Joost’s peer-to-peer management, IGMT allows nodes to maintain interest-shared groups and to establish shortcuts in addition to relying on centralized servers to join the group. The simulation results have demonstrated that IGMT is efficient and resilient to highly dynamic membership changes. The combination of these new approaches constitutes a coherent and effective media distribution i Abstract i architecture, which provides a great potential to support large-scale media distribution services. Noticeably, while the key techniques may be jointly used for providing efficient media distribution services, they can be used independently to effectively address scalability, efficiency and resilience issues in peer-to-peer overlay networks. Zusammenfassung Der explosionsartige Zuwachs von Multimediadiensten und Applikationen (wie z.B. Media Stream- ing) erfordert ein effizientes und einsetzbares Mediendistributionssystem im Internet. Obwohl IP Multicast ein effizienter Weg ist Medienstr¨ome zu einer Gruppe von Empf¨angen zu bef¨ordern, besitzt es technische und operative Probleme, die letztendlich eine weite Verbreitung verhindert haben. Das Ziel dieser Arbeit ist es darum, eine skalierbare, effiziente, verl¨assliche und schrit- tweise einsetzbare Infrastruktur f¨ur Mediendistributionsdienste zu entwickeln. In dieser Arbeit werden ein neues Framework, genannt Dynamic Mesh-based Overlay Multicast Protocol (DMMP) Framework, und zwei wesentliche Erweiterungen zum grundlegenden DMMP Protokoll, und zwar Self-improved DMMP (DMMP+) und das Interest-shared Group Manage- ment (IGMT) Protokoll, entwickelt, um eine große Anzahl von Clients gleichzeitig mit relativ hoher Eingangsdatenrate zu versorgen und eine geringe Start-Up Verz¨ogerung der Clients zu erre- ichen. Das DMMP Framework verwaltet dynamisch eine Zwei-Stufen-Hierarchie, d.h. einen Overlay Kern, sog. Dynamisches Mesh, und Cluster, ohne das klassische IP Multicast zu verwenden. Die Hauptidee ist es, einige End-Hosts auszuw¨ahlen, welche die Overlay-Hierarchie bilden und dynamisch verwalten. Im Vergleich zu fr¨uheren Applikations-Layer-Multicast-Protokollen, ist DMMP besser anpassungsf¨ahig an Anderungen¨ der Gruppengr¨oße und bietet eine effiziente und verl¨assliche Medienverteilung bei geringeren Kontrolloverhead und geringeren Paketverlusten. DMMP+ optimiert die Datendistributionshierarchie durch Erweiterung des Protokolls im DMMP Framework. Zwei selbst verbessernde Techniken werden entworfen, um das gebildete Overlay- Mesh und die Cluster zu optimieren. Die Analyse zeigt, dass das DMMP+ Protokoll das DMMP Framework skalierbarer, verl¨asslicher und effizienter macht, in dem Sinne das es einen besseren Datenpfad und weniger Kontrolloverhead und Paketverluste erzielt. Das IGMT Protokoll erweitert weiterhin DMMP+ dahingehend, dass kurzlebige oder abgetrennte Knoten in hoch dynamisch wechselnden Umgebungen schnell der Gruppe beitreten bzw. erneut beitreten k¨onnen. Motiviert durch eine experimentelle Untersuchung des Joost Peer-to-Peer- Managements, erm¨oglicht IGMT den Knoten interessenbasierte Gruppen zu bilden und Shortcuts zu etablieren in Erg¨anzung zur Nutzung der zentralisierten Server. Die Simulationsergebnisse zeigen, dass IGMT effizient und robust gegen¨uber sehr dynamischen Wechseln in den Mitglied- ii Zusammenfassung iii schaften ist. Die Kombination dieser Methoden erm¨oglicht eine einheitliche und effektive Architektur, die ein großes Potential zur Unterst¨utzung von umfangreichen Medienverteilungsdiensten bietet. W¨ahrend die einzelnen Techniken gemeinsam genutzt werden k¨onnen, um effiziente Medienverteilungsdi- enste anzubieten, k¨onnen die Techniken unabh¨angig von einander genutzt werden, um Skalier- barkeit, Effizienz und Robustheit in Peer-to-Peer Overlay Netzwerken zu erreichen. Acknowledgements With respect and gratitude, I express my warm and sincere thanks to Professor Dr. Xiaoming Fu and Professor Dr. Dieter Hogrefe, whose expertise, guidance, support, encouragement, and pa- tience has made this dissertation possible. Their suggestions and comments on my thesis research have vastly improved the quality of this dissertation and provided an enthralling educational expe- rience. The office staff members of the Institute of Computer Science (Institut f¨ur Informatik) have been wonderful. Also, I must admit that I truely enjoyed working with the research group of our entire Institute during the past three and half years. I am grateful to David Weiss for his assistance with prototyping the components of my thesis. Based on the basic simulation analysis, I am able to specifically improve the performance in re- gards to efficiency, reliability and scalability of the framework. I must also acknowledge my committee members: Professor Dr. Dieter Hogrefe, Professor Dr. Xiaoming Fu, Professor Dr. Stephan Waack, Professor Dr. Wolfgang May, Professor Dr. Bernhard Neumair and PD Dr. Hartje Kriete. Their comments and suggestions have improved the thesis. I am deeply grateful to our NET group members, Ralf L¨ubben, Niklas Neumann, Niklas Steinleit- ner, Mayutan Arumaithurai, Lei Shi, John-Parick Wowra, Vicky Kuo, Ingo Juchem and Filippo Ammazzalorso for providing instant feedback on my research and the assistance with writing pa- pers for publication in the past years. I would also thank our Telematik group members, especially, Patryk Chamuczynski, Omar Alfandi, for friendly cooperations and insightful discussions. Spending three and a half years as a graduate student can be profitable. Several fellow gradu- ate students and friends, Nikunj Modi, Christian Dickmann, Jan Demter, Jan Engelhardt, Lars Reimann, Swen Weiland have made my life colorful and as pleasant as it could possibly be. I really enjoyed the living and studies at the University of G¨ottingen. I owe my most sincere gratitude to our colleagues and partners, Carmen Scherbaum de Huaman, Annette Kadziora, Udo Burghardt for the cooperation and support in the last few years. Very special thanks to my friends, Dr. Jiong Yan, Dai Chen, Dr. Ralf Brauchler, Dr. Xiaoqin Zhang and Rui Zhang for inviting me to join several parties and special events in G¨ottingen. Their kindness and help make my life fruitful. iv Acknowledgments i Finally and most importantly, I have to make a special mention of my entire family, my father Dr. Sheng Lei, my mother Hongying Zhuang, my grandmotherLihua Wei, and especially my husband Dr. Tianhui Chen for making a wonderful difference to my life. I would not be able to complete the PhD study if they didn’t give the full support and understanding. Table of Contents List of Acronyms xiii 1 Introduction 1 1.1 Background..................................... 1 1.2 Terminologies................................... 3 1.3 Contributions ................................... 5 1.4 ThesisRoadmap................................... 6 2 Related Work 8 2.1 Introduction.................................... 8 2.2 Video Distribution Requirements . ....... 9 2.3 Media Related Considerations . ..... 10 2.3.1 VideoCompression............................. 10 2.3.2 MediaServer ................................ 11 2.3.3 Video synchronization