A Comprehensive Survey on Machine Learning for Networking: Evolution, Applications and Research Opportunities Raouf Boutaba1*, Mohammad A

Total Page:16

File Type:pdf, Size:1020Kb

A Comprehensive Survey on Machine Learning for Networking: Evolution, Applications and Research Opportunities Raouf Boutaba1*, Mohammad A Boutaba et al. Journal of Internet Services and Applications (2018) 9:16 Journal of Internet Services https://doi.org/10.1186/s13174-018-0087-2 and Applications RESEARCH Open Access A comprehensive survey on machine learning for networking: evolution, applications and research opportunities Raouf Boutaba1*, Mohammad A. Salahuddin1, Noura Limam1, Sara Ayoubi1, Nashid Shahriar1, Felipe Estrada-Solano1,2 and Oscar M. Caicedo2 Abstract Machine Learning (ML) has been enjoying an unprecedented surge in applications that solve problems and enable automation in diverse domains. Primarily, this is due to the explosion in the availability of data, significant improvements in ML techniques, and advancement in computing capabilities. Undoubtedly, ML has been applied to various mundane and complex problems arising in network operation and management. There are various surveys on ML for specific areas in networking or for specific network technologies. This survey is original, since it jointly presents the application of diverse ML techniques in various key areas of networking across different network technologies. In this way, readers will benefit from a comprehensive discussion on the different learning paradigms and ML techniques applied to fundamental problems in networking, including traffic prediction, routing and classification, congestion control, resource and fault management, QoS and QoE management, and network security. Furthermore, this survey delineates the limitations, give insights, research challenges and future opportunities to advance ML in networking. Therefore, this is a timely contribution of the implications of ML for networking, that is pushing the barriers of autonomic network operation and management. Keywords: Machine learning, Traffic prediction, Traffic classification, Traffic routing, Congestion control, Resource management, Fault management, QoS and QoE management, Network security 1 Introduction Recent advances in ML have made these techniques Machine learning (ML) enables a system to scrutinize data flexible and resilient in their applicability to various real- and deduce knowledge. It goes beyond simply learning or world scenarios, ranging from extraordinary to mundane. extracting knowledge, to utilizing and improving knowl- For instance, ML in health care has greatly improved edge over time and with experience. In essence, the goal of the areas of medical imaging and computer-aided diag- ML is to identify and exploit hidden patterns in “training” nosis. Ordinarily, we often use technological tools that data. The patterns learnt are used to analyze unknown are founded upon ML. For example, search engines data, such that it can be grouped together or mapped to extensively use ML for non-trivial tasks, such as query the known groups. This instigates a shift in the traditional suggestions, spell correction, web indexing and page rank- programming paradigm, where programs are written to ing. Evidently, as we look forward to automating more automate tasks. ML creates the program (i.e. model)that aspects of our lives, ranging from home automation to fits the data. Recently, ML is enjoying renewed interest. autonomous vehicles, ML techniques will become an Early ML techniques were rigid and incapable of tolerating increasingly important facet in various systems that aid in any variations from the training data [134]. decision making, analysis, and automation. Apart from the advances in ML techniques, various *Correspondence: [email protected] other factors contribute to its revival. Most importantly, 1David R. Cheriton School of Computer Science, University of Waterloo, the success of ML techniques relies heavily on data [77]. Waterloo, Canada Undoubtedly, there is a colossal amount of data in todays’ Full list of author information is available at the end of the article networks, which is bound to grow further with emerging © The Author(s). 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Boutaba et al. Journal of Internet Services and Applications (2018) 9:16 Page 2 of 99 networks, such as the Internet of Things (IoT) and its In this paper, we discuss the advances made in the billionsofconnecteddevices[162]. This encourages the application of ML in networking. We focus on traffic engi- application of ML that not only identifies hidden and neering, performance optimization and network security. unexpected patterns, but can also be applied to learn and In traffic engineering, we discuss traffic prediction, clas- understand the processes that generate the data. sification and routing that are fundamental in providing Recent advances in computing offer storage and pro- differentiated and prioritized services. In performance cessing capabilities required for training and testing ML optimization, we discuss application of ML techniques in models for the voluminous data. For instance, Cloud the context of congestion control, QoS/QoE correlation, Computing offers seemingly infinite compute and storage and resource and fault management. Undoubtedly, secu- resources, while Graphics Processing Units [342] (GPUs) rity is a cornerstone in networking and in this regard, and Tensor Processing Units [170](TPUs)provideaccel- we highlight existing efforts that use ML techniques for erated training and inference for voluminous data. It network security. is important to note that a trained ML model can The primary objective of this survey is to provide a be deployed for inference on less capable devices e.g. comprehensive body of knowledge on ML techniques smartphones. Despite these advances, network opera- in support of networking. Furthermore, we complement tions and management still remains cumbersome, and the discussion with key insights into the techniques network faults are prevalent primarily due to human employed, their benefits, limitations and their feasibility error [291]. Network faults lead to financial liability and to real-world networking scenarios. Our contributions are defamation in reputation of network providers. There- summarized as follows: fore, there is immense interest in building autonomic (i.e. self-configuring, self-healing, self-optimizing and self- – A comprehensive view of ML techniques in network- protecting) networks [28] that are highly resilient. ing. We review literature published in peer-reviewed Though, there is a dire need for cognitive control in net- venues over the past two decades that have high work operation and management [28], it poses a unique impact and have been well received by peers. The set of challenges for ML. First, each network is unique works selected and discussed in this survey are com- and there is a lack of enforcement of standards to attain prehensive in the advances made for networking. The uniformity across networks. For instance, the enterprise key criteria used in the selection is a combination of network from one organization is diverse and disparate the year of publication, citation count and merit. For from another. Therefore, the patterns proven to work in example, consider two papers A and B published in one network may not be feasible for another network of the same year with citation counts x and y, respec- the same kind. Second, the network is continually evolving tively. If x is significantly larger than y, A would be and the dynamics inhibit the application of a fixed set of selected for discussion. However, upon evaluating B, patterns that aid in network operation and management. if it is evidenced that it presents original ideas, criti- It is almost impossible to manually keep up with network cal insights or lessons learnt, then it is also selected for administration, due to the continuous growth in the num- discussion due to its merit, despite the lower citation ber of applications running in the network and the kinds count. of devices connected to the network. – A purposeful discussion on the feasibility of the ML Key technological advances in networking, such as net- techniques for networking. We explore ML tech- work programmability via Software-Defined Networking niques in networking, including their benefits and (SDN), promote the applicability of ML in networking. limitations. It is important to realize that our coverage Though, ML has been extensively applied to problems in of networking aspects are not limited to a specific net- pattern recognition, speech synthesis, and outlier detec- work technology (e.g. cellular network, wireless sensor tion, its successful deployment for network operations and network (WSN), mobile ad hoc network (MANET), management has been limited. The main obstacles include cognitive radio network (CRN)). This gives readers what data can be collected from and what control actions a broad view of the possible solutions to networking can be exercised on legacy network devices. The ability to problems across network technologies. program the network by leveraging SDN alleviates these – Identification of key challenges and future research obstacles. The cognition from ML can be used to aid in opportunities. The presented discussion on ML- the automation of network operation and management based techniques in networking uncovers fundamen- tasks. Therefore, it
Recommended publications
  • Internet2: a Comparative Study and Technological Solution to Achieve High Speed Networks
    Himanshu Agarwal / Indian Journal of Computer Science and Engineering Vol 1 No 3, 157-160 INTERNET2: A COMPARATIVE STUDY AND TECHNOLOGICAL SOLUTION TO ACHIEVE HIGH SPEED NETWORKS HIMANSHU AGARWAL Department of Computer Science & Information Technology, Moradabad Institute of Technology, Moradabad-244001 (Uttar Pradesh), India Email: [email protected] Abstract In current Indian scenario whenever it is required to access very large amount of data such as games or some commercial applications through commodity internet (internet1), speed becomes hurdle. It becomes tolerable for some applications but no one wants to bother in case of education and research. Now the world becomes commercialized and don’t want to bother with speed. Therefore the next generation of Internet infrastructure known as Internet2 or UCAID (University Corporation for Advance Internet Development) for 21st century comes in the focus of scientists, to improve quality of life through research and education. In this paper thorough analysis and comparative study of various educational networks, market scenario and Internet2 has been done, so all pros and cons become visualized to get the effect of internet2 in industries, research and development. Keywords: Internet2; Abilene network; gigapops; high speed networks. 1. Introduction Internet2 is a second generation network serving universities and research institutes by moving the data at a rate of 10 gigabits per second and more ,compared with 5.1 or so megabits old fashioned commodity internet. Internet2 moves data 100 to 1,000 times faster than internet1. Its GigaPoPs (points of presence) provide regional high-performance aggregation points; for member institutions, typically local campus networks provide no less than 100 Mbps to the desktop.
    [Show full text]
  • Ipv6 in Esnet
    SLAC-PUB-8902 IPv6 in ESnet Warren Matthews, Principal Network Specialist, Stanford Linear Accelerator Center (SLAC) Bob Fink, Energy Sciences Network (ESnet) Research Staff, Co-chair NGtrans WG, IETF and Project Lead for the 6bone Project, IETF. Susan Hicks, Oak Ridge National Laboratory (ORNL) Vyto Grigaliunas, Network Analyst, Fermi National Accelerator Laboratory (FNAL) Abstract The importance of the Internet to modern High Energy Physics collaborators is clearly immense, and understanding how new developments in network technology impact net- works is critical to the future design of experiments. The next generation Internet Protocol (IPv6) is being deployed on testbeds and pro- duction networks throughout the world. The protocol has been designed to solve todays internet problems, and many of the features will be core Internet services in the future. In this talk the features of the protocol will be described. Details will be given on the deployment at sites important to High Energy Physics Research and the network services operating at these sites. In particular IPv6 deployment on the U.S. Energy Sciences Network (ESnet) will be reviewed. The connectivity and performance between High Energy Physics Laboratories, Universities and Institutes will be discussed. Keywords: Network, Technology, Internet, Protocol, IP, IPv6 1 Introduction High Energy and Nuclear Physics (HENP) experiments around the world generate huge amounts of data, much of which is transferred across networks to collaborators for analysis. Network technology has become critical to the success of experiments. The requirements of HENP researchers often means the networks they use become early implementors of new network technology. In this paper the next generation of the Internet Protocol (IP) is reviewed.
    [Show full text]
  • Internet Routing Policies and Round-Trip-Times
    Internet Routing Policies and Round-Trip-Times Han Zheng, Eng Keong Lua, Marcelo Pias, and Timothy G. Griffin University of Cambridge Computer Laboratory {han.zheng, eng.lua, marcelo.pias, timothy.griffin}@cl.cam.ac.uk Abstract. Round trip times (RTTs) play an important role in Internet measure- ments. In this paper, we explore some of the ways in which routing policies impact RTTs. In particular, we investigate how routing policies for both intra- and inter- domain routing can naturally give rise to violations of the triangle inequality with respect to RTTs. Triangle Inequality Violations (TIVs) might be exploited by overlay routing if an end-to-end forwarding path can be stitched together with paths routed at layer 3. However, TIVs pose a problem for Internet Coordinate Systems that attempt to associate Internet hosts with points in Euclidean space so that RTTs between hosts are accurately captured by distances between their associated points. Three points having RTTs that violate the triangle inequality cannot be embedded into Euclidean space without some level of inaccuracy. We argue that TIVs should not be treated as measurement artifacts, but rather as nat- ural features of the Internet’s structure. In addition to explaining routing policies that give rise to TIVs, we present illustrating examples from the current Internet. 1 Motivation Since round trip times (RTTs) play an important role in Internet measurements, it is important to have a good understanding of the underlying mechanisms that give rise to observed values. Measured RTTs are the result of many factors — “physical wire” distance, traffic load, link layer technologies, and so on.
    [Show full text]
  • National Lambdarail (NLR) and Potential Merger with Internet2/Abilene Unidata Seminar Marla Meehl 24 August 2005 Outline
    National LambdaRail (NLR) and Potential Merger with Internet2/Abilene Unidata Seminar Marla Meehl 24 August 2005 Outline • Overview of NLR and capabilities • Potential NLR/I2 Merge – Context • Group A • Group B – Merger process • Steps to date • Discussion National LambdaRail Update • Layer 1 update – 50% of resources dedicated to research • Layer1 Phase II Deployment Schedule • Layer 2 design • Layer 3 design National LambdaRail Update Phase I Layer 1 Deployment SEA 8 8 POR 8 8 BOI 8 4 STA 4 8 OGD 8 8 PIT 8 DEN 8 8 8 KAN CLE 8 SVL 8 8 8 CHI 8 8 8 8 WDC RAL 8 LAX 8 8 8 ATL 8 JAC Level3 fiber Other fiber 8 Cisco 15808 terminal 8 Cisco 15808 OADM 4 Cisco 15454 terminal 4 Cisco 15454 OADM National LambdaRail Update Phase II Layer I Deployment SYR 4 4 4 4 NYC OGD 4 4 DEN CLE KAN SLC 4 4 4 4 WDC LAX 4 RAT 4 4 TUL PHO 4 ALB 4 4 4 4 4 DAL ELP 4 4 4 PEN JAC 4 4 4 4 4 4 4 4 Level3 fiber SAA 4 4 BAT WilTel fiber HOU 8 Cisco 15808 terminal 8 Cisco 15808 OADM 4 Cisco 15454 terminal 4 Cisco 15454 OADM NATIONAL LAMBDARAIL - PHASE 2 DEPLOYMENT FINALIZED SCHEDULE as of 2005-03-16 OADM / Pa ss Install Test OLA Regen Terminal Thru Install Completio Test Completion Provider Segment Sites Sites Sites Sites Start Date n Date Start Date Date Level 3 & ? WilTel Ogden to Salt Lake City 1 1 * * ** ** a1 WilTel Houston to San Antonio 5 2 06/23/05 06/30/05 a2 WilTel San Antonio to El Paso 14 1 07/05/05 07/20/05 08/09/05 08/17/05 a5 WilTel El Paso to Phoenix 10 1 07/19/05 07/30/05 a6 WilTel Phoenix to LA 11 1 1 07/29/05 08/12/05 10/07/05 10/15/05 a3 Level 3 El Paso
    [Show full text]
  • The HOPI Project
    The HOPI Project Rick Summerhill Associate Director, Backbone Network Infrastructure, Internet2 JET Roadmap Workshop Jefferson Lab Newport News, VA April 13, 2004 Outline Resources • Abilene • NLR • Experimental MAN LAN Facility • RONs The HOPI Project – Hybrid Optical and Packet Infrastructure • Architectures based on availability of optical infrastructure –Based on dark fiber acquisitions at the national, regional, local level 4/16/2004 2 Abilene Particulars Performance • 6.2 gpbs single flows across Abilene • Consistent 9.5 gbps traffic patterns during SC2003 from Phoenix • The performance is good, but we need to look to the future Agreement with Qwest ends in 2.5 years • How should we go forward? 4/16/2004 3 NLR Summary Largest higher-ed owned/managed optical networking & research facility in the world • ~10,000 route-miles of dark fiber • Four 10-Gbps λ’s provisioned at outset – One allocated to Internet2 – One an experimental IP network – One a national scale Ethernet – One a spare and quick start An experimental platform for research • Research committee integral in NLR governance • Advance reservation of λ capacity for research • Experimental support center 4/16/2004 4 NLR footprint and physical layer topology – Phase 1 SEA 4 1/0 POR BOI 4 4/0 /03 OGD CHI 11 4 /04 CLE 3/0 SVL 7 DEN 4 PIT 8/0 4 WDC 2/0 KAN RAL LAX 4 6/0 ATL 4 SAN 8/0 15808 Terminal JAC 15808 OADM 15808 Regen Fiber route Leased waves Note: California (SAN-LAX-SVL) routes shown are part of CalREN; NLR is adding waves to CalREN systems.
    [Show full text]
  • Integrating Latin American and European Research and Education Networks Through the ALICE Project
    AL-03-063 16.09.03 Integrating Latin American and European Research and Education Networks through the ALICE project. Cathrin Stöver DANTE Francis House, 112 Hills Road, Cambridge CB2 1PQ, United Kingdom [email protected] Michael Stanton RNP - Rede Nacional de Ensino e Pesquisa Estrada Dona Castorina, 110, 22460-320 Rio de Janeiro RJ, Brazil [email protected] Abstract The ALICE (América Latina Interconectada Con Europa) project is being jointly funded by the European Union and the national research and education networks (NRENs) of 18 Latin American countries. It has as an objective the interconnection of the Latin American NRENs by means of a regional backbone network and the establishment of a direct Internet connection between this backbone and the pan-European backbone network, GÉANT. The talk describes the previous experiences of providing international research and education networking connectivity both in Europe and Latin America, and presents key characteristics of the future network and of the CLARA (Cooperación Latino Americana de Redes Avanzadas) organisation, the recently created association of Latin American NRENs. Keywords: Internet, International connectivity, Latin America, ALICE project, CLARA, DANTE, GÉANT 1 Introduction Until the middle of the 1980s, because of the relatively high cost of telecommunications services, computer networking carried out by the research and education (R&E) community was usually geographically confined to metropolitan distances, or, at a pinch, within the limits of a single national state. International networking was extremely expensive and thought to be difficult to justify. Then, within the space of a very few years, not only has international networking become extremely common, but it has come to be recognised as an essential part of the infrastructure required to support everyday activities within this community, easily supplanting all competing forms of communication, due to its speed, flexibility and low cost.
    [Show full text]
  • The People Who Invented the Internet Source: Wikipedia's History of the Internet
    The People Who Invented the Internet Source: Wikipedia's History of the Internet PDF generated using the open source mwlib toolkit. See http://code.pediapress.com/ for more information. PDF generated at: Sat, 22 Sep 2012 02:49:54 UTC Contents Articles History of the Internet 1 Barry Appelman 26 Paul Baran 28 Vint Cerf 33 Danny Cohen (engineer) 41 David D. Clark 44 Steve Crocker 45 Donald Davies 47 Douglas Engelbart 49 Charles M. Herzfeld 56 Internet Engineering Task Force 58 Bob Kahn 61 Peter T. Kirstein 65 Leonard Kleinrock 66 John Klensin 70 J. C. R. Licklider 71 Jon Postel 77 Louis Pouzin 80 Lawrence Roberts (scientist) 81 John Romkey 84 Ivan Sutherland 85 Robert Taylor (computer scientist) 89 Ray Tomlinson 92 Oleg Vishnepolsky 94 Phil Zimmermann 96 References Article Sources and Contributors 99 Image Sources, Licenses and Contributors 102 Article Licenses License 103 History of the Internet 1 History of the Internet The history of the Internet began with the development of electronic computers in the 1950s. This began with point-to-point communication between mainframe computers and terminals, expanded to point-to-point connections between computers and then early research into packet switching. Packet switched networks such as ARPANET, Mark I at NPL in the UK, CYCLADES, Merit Network, Tymnet, and Telenet, were developed in the late 1960s and early 1970s using a variety of protocols. The ARPANET in particular led to the development of protocols for internetworking, where multiple separate networks could be joined together into a network of networks. In 1982 the Internet Protocol Suite (TCP/IP) was standardized and the concept of a world-wide network of fully interconnected TCP/IP networks called the Internet was introduced.
    [Show full text]
  • Trends on Network Testbeds in the World
    2-3 Trends on Network Testbeds in the World MURASE Ichiro becoming to the infrastructure of any kinds of R&D. Internet2 in U.S. includes various strate- gic networks and projects. And in Europe there are collaboration among many network testbeds leaded by EU. Regarding characteristics on network testbeds, we have three issues. One is an adoption of photonic technology. Two is a focus on middle ware technology. Three is an attention on applica- tion technology. In the future, each network testbeds will have an originality, and they have many collaboration each other over the border. Keywords JGNⅡ, Internet, Network testbed, Next generation network, Photonic network 1 Introduction the network. (3) New network technologies are implement- The Japan Gigabit Network (JGN) began ed on the network. operations in 1999, and was hailed at the time However, the above three conditions are as the fastest network testbed in the world. Its not necessarily absolute; a network may be successor, the JGNⅡ, has been in operation regarded as a network testbed even if it fails to since 2004. Network testbeds are now operat- meet one of the conditions. It is widely known ing in North America, Europe, Asia, and else- that the JGNⅡ network is currently hosting a where, with the incorporation of photonic wide range of R&D, with numerous associated technology, middleware research and develop- research institutes linked to this network. The ment, and the investigation of a range of appli- network also incorporates the latest photonic cations. This paper provides an introduction to technology. these current trends in R&D of network test- Network testbeds are designed to provide beds.
    [Show full text]
  • Yasuichi Kitamura ([email protected]) APAN Tokyo XP Object of This Session
    APAN 101 Yasuichi Kitamura ([email protected]) APAN Tokyo XP Object of this session Introduction of the organization of this meeting Explanation of some terminologies Encourage of joining some unknown sessions APAN 101 24th APAN Meeting in Xi’An August 27th, 2007 Agenda APAN Research and Education Network Snapshot of this meeting APAN 101 24th APAN Meeting in Xi’An August 27th, 2007 Asia-Pacific Advanced Network APAN Organization History APAN APAN meeting APAN 101 24th APAN Meeting in Xi’An August 27th, 2007 APAN Organization Coordinating Committee Secretariat Committees Working Groups Regional Net Groups http://www.apan.net/home/aboutapan/organization.html APAN 101 24th APAN Meeting in Xi’An August 27th, 2007 Coordinating Committee Chair: Shigeki Goto Vice Chairs: Jianping Wu, George McLaughlin, Lawrence Wong Treasurer: DaeYoung Kim Secretariat Managing Director: Vimolrat Ngamaramvaranggul Committees and Adhoc Committees Committees Adhoc Committees NOC Kazunori Konishi Strategy Lawrence Wong Backbone George McLaughlin Fellowship Rahmat Budhiarto Event Akira Mizushima Program Jacqueline Brown Election George McLaughlin CCIRN Li Xing Training Kanchana Kanchanasut Grid Kento Aida Working Groups Application Network Sures Network Research Natural Resource Koji Okamura Yusheng Ji Suhaimi Napis Technology Area Technology Area Ramadaswaran Group Area Medical WG Shuji Shimizu IPv6 WG Yan Ma Agriculture WG Masayuki Hirafuji Earth Monitoring HDTV WG Jongwon Kim Measurement WG Yasuichi Kitamura Pakorn Apaphant WG Jai-Ho Oh, eScience WG HingYan Lee
    [Show full text]
  • National Lambdarail : Press Releases
    7/15/2010 National LambdaRail : Press Releases RSS The Network for Advanced Research and Innovation Owned by the U.S. research and education community, NLR is the ultra high-performance, 12,000-mile innovation platform for a wide range of academic disciplines and public-private Search partnerships. Learn more... HOME ABOUT US MEMBERS SERVICES RESEARCH SUPPORT PRESS ROOM CONTACT US PRESS ROOM Press Room Press Releases Press Resources National Research and Education Partnership Awarded $62.5 Million Recovery Act Grant for 100 NLR and National Broadband Gigabit Community Anchor Backbone Network NLR in the New s Featured Research New U.S. Unified Community Anchor Network will connect community anchor institutions across the U.S. with advanced broadband capabilities Ann Arbor, MI, July 2, 2010 -- The National Telecommunications and Information Administration (NTIA) today awarded more than $62.5 million in federal stimulus funding through its Broadband Technology Opportunities Program (BTOP) to a group of national research and education networking organizations including Internet2 (also known as University Corporation for Advanced Internet Development), National LambdaRail (NLR), Indiana University, the Northern Tier Network Consortium. In collaboration with technology companies Ciena, Cisco, Infinera, and Juniper Networks, the group proposes the construction of the United States Unified Community Anchor Network (U.S. UCAN), an advanced 100 Gigabit per second network backbone that will link regional networks across the nation, including other
    [Show full text]
  • Internet2 Implications for Libraries
    Internet2 Implications for Libraries Thomas J. Lynch III, Ph.D. Vice President for Information Technology and CIO Worcester Polytechnic Institute [email protected] http://www.WPI.edu Technology for the Rest of Us: What Every Librarian Should Understand About the Technologies that Affect Us The Blackwell, Ohio State University, Columbus OH 1 May 25, 2004 Outline Context: environment today, 2009, 2019, 2029, 2049 • Libraries of the “near” future Internet History • Problems with the “commodity” internet • Advanced networking landscape I2 capabilities, applications, WPI Goddard GigaPoP • K-20 role: SEGP, Sponsored Participants • Connections and projects Goddard Collaborative • Solving the last mile and costs issues • Sharing infrastructure Educational technology and the library Digital libraries and the future • Is it worth the trip? • Do we have a choice? 2 What’s going on?…. WWavesaves ofof PowPowerer Mid 1800’s Electric Power • Key enabling technology • 1st Industrial Rev => Physical Abilities Mainframe “System” Era • Limited users; focus on scientific and business computation Personal Computers • Computers for the masses; focus on personal productivity, entertainment • Merging computing & communications Networking • Mission: connect the world • Focus on collaborative workgroups The Next Thing: media-rich “CONTENT” for the “information society” • Requires a new generation of software/hardware applications • 2nd Industrial Revolution—about knowledge, value, mental abilities • Universities—knowledge creation, dissemination, learning businesses • Libraries—knowledge repository, dissemination, learning Source: Waves of Power, David Moschella, AMACOM American Management Association, NY, NY, 1997, pg. 98. 3 Source: The Age of Intelligent Machines, Ray Kurzweil, MIT Press, Cambridge MA. People on the Internet 350.0 300.0 250.0 Millions of 200.0 People 150.0 100.0 50.0 1 e a A r - D - 3 00 4 Source: 1995 1996 1997 1998 1999 20 2005 Nua Internet Surveys The Day the Computers Died ..
    [Show full text]
  • Designing a New Networking Environment for U.S. Research & Education
    Designing a New Networking Environment for U.S. Research & Education Steve Corbató [email protected] Director, Network Initiatives CANS 2004 Florida International University Miami 30 November 2004 I come to Miami from a slightly different part of the country (Utah) 2 One view of the U.S. landscape §The packet network won, but now can it keep up? • Grid computing: a distinct view of the network as a schedulable resource §The telecom/IP bust has created a ‘once-in-a- lifetime’ opportunity for previous non-players in facilities-based telecommunications • New R&E optical networking facilities are emerging on the regional and national scales §Active investigation of new hybrid architectures is underway 3 Topics for today §High performance packet infrastructure • Abilene Network §Regional Optical Networks (RONs) • FiberCo case study §Future architectures • New York City exchange point – MAN LAN • Hybrid Optical & Packet Infrastructure – HOPI 4 Abilene Network 30 November 2004 Abilene Network – second generation 6 Abilene timeline §Apr 1998 Network announced • Cisco Systems, Indiana Univ., Nortel Networks, and Qwest Communications initial partnership led by Internet2 • 2.5-Gbps national backbone (OC-48c SONET) §Jan 1999 Network went into production §Second generation network upgrade • Oct 2001 Qwest MoU (DWDM+SONET) extension (5 years) • Apr 2002 Routers from Juniper Networks added • Dec 2003 10-Gbps upgrade complete • Oct 2004 Transport agreement extended by one year §Oct 2007 Transport MoU with Qwest ends • The time frame for both next
    [Show full text]