A Framework for Pervasive Web Content Delivery
Total Page:16
File Type:pdf, Size:1020Kb
A FRAMEWORK FOR PERVASIVE WEB CONTENT DELIVERY HENRY NOVIANUS PALIT (S. Kom., ITS, Surabaya; M. Kom., UI, Jakarta) A THESIS SUBMITTED FOR THE DEGREE OF DOCTOR OF PHILOSOPHY DEPARTMENT OF COMPUTER SCIENCE SCHOOL OF COMPUTING NATIONAL UNIVERSITY OF SINGAPORE 2006 Acknowledgements Praise and glory be to the Lord, who has given me strength to pursue my purposes in life, courage to confront any challenge, perseverance to carry on in the midst of turbulence, and wisdom to keep me humble. He is my shepherd and my comfort; I shall not be in want. I would like to take this opportunity to express my utmost gratitude to Prof. Chi Chi Hung for his inspiration, encouragement, and invaluable advice throughout the course of my research. Not only is he the best supervisor to guide me in this research field, but outside of the research work he is also a great mentor, from whom I learn a lot about important things in life. For the time he made available for research discussions, the effort he spent on reading and revising my research papers and thesis, the help he offered when I was in trouble, and the patience he showed against my late progress, I am always thankful. I would also like to thank my replacement supervisor, Asst. Prof. Ken Sung Wing Kin, for allowing me to stay in his laboratory and for assisting me with all the administrative matters. I am sincerely grateful for his tremendous effort to help my research keep on as smoothly as possible. This study would not have been possible without the Research Scholarship I received from the National University of Singapore. Therefore, I thank the University – and the School of Computing, in particular – for giving me the opportunity to pursue my postgraduate study. ii Through my many years in Multimedia Information Laboratory, I had worked with not just colleagues but caring and hospitable friends. I have benefited from many research discussions with Hongguang, William, Junli, Li Xiang, Su Mu, and Choon Keng as much as I have enjoyed their warm and sincere friendship. My interaction with other friends like Meng, Rain Zhang, Akanksha, Wenjie, and Xiao Yan has made my stay there pleasant and lively. Moreover, I am indebted to my brothers and sisters in Christ for their support, prayers, and companionship. In particular, I would like to thank – among others – Eni and Martin, Henny and Karim, Evelyne and Didi, Aini, and my Cell Group’s and Prayer Group’s friends. I thank Heng Thong, my flatmate, for the same support, prayers, and companionship he has given me. An abundance of appreciation and gratitude also goes to Dina, who kept “jia you”-ing me all the way till the completion of this thesis. I really hope one day I can repay you the same favor. Above all, I would like to express my highest appreciation to my parents, sister, and brother for their endless love, compassion, encouragement, and persistent prayers. Forever, I owe them an immense debt of gratitude. To them, I dedicate this thesis. iii Table of Contents Acknowledgements ii Summary x List of Tables xii List of Figures xiv Publications xvii Chapter 1 Introduction 1 1.1 Overview of Web Content Delivery 2 1.2 Challenges in Web Content Delivery 4 1.3 Efforts to Address the Challenges 6 1.3.1 Content Caching and Replication 6 1.3.2 Intelligent Network 9 1.3.3 Multimedia Standard 11 1.4 Motivation: What Will Be the Future Web Content Delivery? 13 1.4.1 Pervasive or Ubiquitous Service 13 1.4.2 Fine-Grained Entities with Heterogeneous Properties 14 1.4.3 On-Demand Delivery with Efficient Data Reuse 14 1.4.4 Rich Meta-data 15 1.5 Objectives and Contributions 16 1.5.1 Objectives 16 1.5.2 Contributions 17 1.6 Scope and Organization of the Thesis 18 iv Chapter 2 Literature Review 20 2.1 Content Caching and Replication 21 2.1.1 HTTP and Web Caching 21 2.1.2 Content Distribution Network 24 2.1.3 Techniques for Reducing Latency 27 2.1.4 Techniques for Handling Dynamic Contents 29 2.2 Intelligent Network 33 2.2.1 Web Protocol’s Support 34 2.2.2 Transcoding Systems 36 2.2.3 ICAP and OPES 47 2.2.4 Semantic Web 52 2.3 Multimedia Standards 55 2.3.1 JPEG 2000 57 2.3.2 MPEG-4 60 2.4 Concluding Remarks 67 Chapter 3 A Fine-Grained, Scalable Data Model 70 3.1 Background 71 3.2 Concept of Object Decomposition and Construction 73 3.3 Specifications of Data Model 77 3.3.1 Definition 1: Object 77 3.3.2 Definition 2: Segment and Atom 79 3.3.3 Definition 3: Representation 80 3.3.4 Definition 4: Supplement 81 3.3.5 Operation 1: Selection 83 v 3.3.6 Operation 2: Inverse-Selection 83 3.3.7 Operation 3: Join 84 3.3.8 Operation 4: Translation 85 3.3.9 How Is It Useful? 86 3.4 Modulation – A Scalable Adaptation 87 3.5 Related Work 93 Chapter 4 Modulation in JPEG 2000 96 4.1 Why Use JPEG 2000? 97 4.2 JPEG 2000 Modulators 98 4.2.1 General Issues 99 4.2.2 Modulator 1: JP2Selector 106 4.2.3 Modulator 2: JP2Joiner 115 4.2.4 Modulator 3: JP2Converter 116 4.3 Related Work 119 Chapter 5 Evaluation: Modulation vs. Transcoding 122 5.1 Rationale of Using Two Different Image Standards 123 5.2 Experimental Setup 124 5.2.1 Experimented Adaptors 124 5.2.2 Image Test Data 126 5.3 Generating Image Representations 129 5.3.1 Bit-Rate Performance 131 5.3.2 Visual Comparison 135 5.4 Processing Time 137 vi 5.4.1 Adaptation in Quality Aspect 137 5.4.2 Adaptation in Resolution Aspect 144 5.4.3 Adaptation in Component Aspect 149 5.5 Concluding Remarks 153 Chapter 6 Framework for Pervasive Web Content Delivery 155 6.1 Proxy- vs. Server-Based Adaptation 156 6.2 Evaluation of Adapting Approaches 158 6.2.1 Scenario 1: First-Time Delivery 161 6.2.2 Scenario 2: Subsequent Delivery 165 6.3 Prediction of Adaptation Delay 170 6.3.1 Adaptation Delay in a Downscaling Operation 172 6.3.2 Adaptation Delay in a Upscaling Operation 178 6.4 Proposed Framework 180 6.4.1 System Architecture 180 6.4.2 Adapting Modules 183 6.4.3 Supporting Meta-Data 184 6.5 Related Work 186 Chapter 7 Model Prototype of Pervasive Web Content Delivery 191 7.1 What Do We Have So Far? 192 7.2 Meta-Data Specifications 193 7.2.1 Client Meta-Data 199 7.2.2 Server Meta-Data 202 7.3 Modifications in Server Application 205 vii 7.4 Modifications in Proxy Application 209 7.4.1 Modified Workflow 211 7.4.2 External Modules 217 7.4.3 Rule-Based Decision Maker 220 7.4.4 Adapting Proxy Commands 225 7.5 Implemented Architecture 228 7.6 Related Work 231 Chapter 8 Performance Evaluation on Proposed Pervasive Web Content 235 Delivery 8.1 Experimental Setup 236 8.1.1 Experimented Adaptors 236 8.1.2 Image Test Data 236 8.1.3 Server Meta-Data Documents 240 8.1.4 Client Meta-Data Documents 242 8.2 Evaluating Adaptation at Web Server 243 8.2.1 Experimental Objectives 244 8.2.2 Response Time Analyses 245 8.2.3 Stress Test 250 8.3 Evaluating Adaptation at Web Server and Proxy 260 8.3.1 Experimental Objectives 262 8.3.2 Response Time Analyses 262 8.3.3 Stress Test 274 8.3.4 Exploration of Data Reuse 282 8.4 Concluding Remarks 287 viii Chapter 9 Conclusions and Future Work 289 9.1 Conclusions 290 9.1.1 Fine-Grained, Scalable Web Data Model 290 9.1.2 Modulation in JPEG 2000 291 9.1.3 Framework for Pervasive Web Content Delivery 292 9.1.4 Model Prototype of Pervasive Web Content Delivery 293 9.2 Future Work 296 9.2.1 Wide Implementation of Modulation 296 9.2.2 Enhanced Adapting Proxy 297 9.2.3 Resource-Friendly Adaptor 297 9.2.4 High Data Reuse vs. Data Replication 298 Bibliography 299 Appendix A: ADP Schema 315 Appendix B: Experimental Server Meta-Data 319 Appendix C: Experimental Client Meta-Data 332 ix Summary The integration of the Internet and the wireless network is inevitable. Consequently, Web clients become more heterogeneous, and therefore, pervasive services are required. This is one major challenge that the Web content providers face nowadays. Other challenges are, among others, increased multimedia data traffic, personalized content, and demand for efficient Web content delivery. Learning from the past researches, this thesis tries to address the challenges as a whole. In doing so, two objectives have been set out. The first objective is to devise a fine-grained, scalable Web data model. The data model is the key factor to attain efficiency, in addition to adaptability, in Web content delivery. According to the data model, an object is heterogeneous as a whole but can be divided into homogeneous “atoms”. The object can be represented by composing some of its atoms; the greater the number of atoms, the better is the object’s presentation. Thus, a variety of representations – along different types of scalability, perhaps – can be generated from the object with less, or even, no complex computations. Modulation , a novel adaptation, was proposed to exploit the data model. Modulation is characterized as fast, exclusive, and reversible.