CS555: Distributed Systems [Fall 2019] Dept
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Book of Abstracts Ii Contents
CHEP 2016 Conference, San Francisco, October 8-14, 2016 Monday, 10 October 2016 - Friday, 14 October 2016 San Francisco Marriott Marquis Book of Abstracts ii Contents Experiment Management System for the SND Detector 0 .................. 1 Reconstruction software of the silicon tracker of DAMPE mission 2 ............ 1 HEPData - a repository for high energy physics data exploration 3 ............. 2 Reconstruction of Micropattern Detector Signals using Convolutional Neural Networks 4 3 Federated data storage system prototype for LHC experiments and data intensive science 6 ................................................ 3 BelleII@home: Integrate volunteer computing resources into DIRAC in a secure way 7 . 4 Reconstruction and calibration of MRPC endcap TOF of BESIII 8 .............. 5 RootJS: Node.js Bindings for ROOT 6 9 ............................ 6 C++ Software Quality in the ATLAS experiment: Tools and Experience 10 . 6 An automated meta-monitoring mobile application and frontend interface for the WLCG computing model 11 ..................................... 7 Experience of Google’s latest Deep Learning library, TensorFlow, with Docker in a WLCG cluster 12 ........................................... 8 Flexible online monitoring for high-energy physics with Pyrame 13 ............ 8 Simulation of orientational coherent effects via Geant4 14 .................. 9 Detector control system for the AFP detector in ATLAS experiment at CERN 15 . 10 The InfiniBand based Event Builder implementation for the LHCb upgrade16 . 11 JavaScript ROOT v4 17 ..................................... 12 The evolution of monitoring system: the INFN-CNAF case study18 . 13 Statistical and Data Analysis Package in SWIFT 19 ...................... 13 Analysis Tools in Geant4 10.2 20 ................................ 14 Online & Offline Storage and Processing for the upcoming European XFEL Experiments 21 15 Future approach to tier-0 extension 22 ............................. 15 iii Internal security consulting, reviews and penetration testing at CERN 23 . -
Emerging Cyber Threats to the United States Hearing
EMERGING CYBER THREATS TO THE UNITED STATES HEARING BEFORE THE SUBCOMMITTEE ON CYBERSECURITY, INFRASTRUCTURE PROTECTION, AND SECURITY TECHNOLOGIES OF THE COMMITTEE ON HOMELAND SECURITY HOUSE OF REPRESENTATIVES ONE HUNDRED FOURTEENTH CONGRESS SECOND SESSION FEBRUARY 25, 2016 Serial No. 114–55 Printed for the use of the Committee on Homeland Security Available via the World Wide Web: http://www.gpo.gov/fdsys/ U.S. GOVERNMENT PUBLISHING OFFICE 21–527 PDF WASHINGTON : 2016 For sale by the Superintendent of Documents, U.S. Government Publishing Office Internet: bookstore.gpo.gov Phone: toll free (866) 512–1800; DC area (202) 512–1800 Fax: (202) 512–2104 Mail: Stop IDCC, Washington, DC 20402–0001 COMMITTEE ON HOMELAND SECURITY MICHAEL T. MCCAUL, Texas, Chairman LAMAR SMITH, Texas BENNIE G. THOMPSON, Mississippi PETER T. KING, New York LORETTA SANCHEZ, California MIKE ROGERS, Alabama SHEILA JACKSON LEE, Texas CANDICE S. MILLER, Michigan, Vice Chair JAMES R. LANGEVIN, Rhode Island JEFF DUNCAN, South Carolina BRIAN HIGGINS, New York TOM MARINO, Pennsylvania CEDRIC L. RICHMOND, Louisiana LOU BARLETTA, Pennsylvania WILLIAM R. KEATING, Massachusetts SCOTT PERRY, Pennsylvania DONALD M. PAYNE, JR., New Jersey CURT CLAWSON, Florida FILEMON VELA, Texas JOHN KATKO, New York BONNIE WATSON COLEMAN, New Jersey WILL HURD, Texas KATHLEEN M. RICE, New York EARL L. ‘‘BUDDY’’ CARTER, Georgia NORMA J. TORRES, California MARK WALKER, North Carolina BARRY LOUDERMILK, Georgia MARTHA MCSALLY, Arizona JOHN RATCLIFFE, Texas DANIEL M. DONOVAN, JR., New York BRENDAN P. SHIELDS, Staff Director JOAN V. O’HARA, General Counsel MICHAEL S. TWINCHEK, Chief Clerk I. LANIER AVANT, Minority Staff Director SUBCOMMITTEE ON CYBERSECURITY, INFRASTRUCTURE PROTECTION, AND SECURITY TECHNOLOGIES JOHN RATCLIFFE, Texas, Chairman PETER T. -
The Linux Command Line
The Linux Command Line Fifth Internet Edition William Shotts A LinuxCommand.org Book Copyright ©2008-2019, William E. Shotts, Jr. This work is licensed under the Creative Commons Attribution-Noncommercial-No De- rivative Works 3.0 United States License. To view a copy of this license, visit the link above or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042. A version of this book is also available in printed form, published by No Starch Press. Copies may be purchased wherever fine books are sold. No Starch Press also offers elec- tronic formats for popular e-readers. They can be reached at: https://www.nostarch.com. Linux® is the registered trademark of Linus Torvalds. All other trademarks belong to their respective owners. This book is part of the LinuxCommand.org project, a site for Linux education and advo- cacy devoted to helping users of legacy operating systems migrate into the future. You may contact the LinuxCommand.org project at http://linuxcommand.org. Release History Version Date Description 19.01A January 28, 2019 Fifth Internet Edition (Corrected TOC) 19.01 January 17, 2019 Fifth Internet Edition. 17.10 October 19, 2017 Fourth Internet Edition. 16.07 July 28, 2016 Third Internet Edition. 13.07 July 6, 2013 Second Internet Edition. 09.12 December 14, 2009 First Internet Edition. Table of Contents Introduction....................................................................................................xvi Why Use the Command Line?......................................................................................xvi -
Machine-To-Machine Communication in Rural Conditions: Realizing Kasadakanet
Machine-to-machine communication in rural conditions: Realizing KasadakaNet Fahad Ali VU Amsterdam [email protected] Supervised by Victor de Boer ABSTRACT the explored concepts is using Semantic Web technologies Contextual constraints play an important role in ICT for De- to facilitate knowledge sharing in rural areas (Gu´eret et al., velopment (ICT4D) projects. These ICT4D projects include 2011). those whose goal is to enable information and knowledge sharing in rural areas while keeping constraints such as lack One of the resulting products that came out of this research of electricity and technological infrastructure or (technical) is the Kasadaka2, a low-resource Raspberry Pi-based device illiteracy of end-users in mind. The Kasadaka project offers that provides an infrastructure on which voice-based appli- a solution for locals in rural areas in Sub-Saharan Africa to cations can be built and deployed locally. These applica- share knowledge. Due to a lack of technological infrastruc- tions for the Kasadaka are usually custom-built for specific ture, networks and internet connections are often not avail- needs and use cases. New applications can also be created able. Therefore, many ICT implementations in those areas fairly easily, making the platform ideal for rapid prototyping are not able to share data among each other. This paper (Baart, 2016). Essentially, these Kasadaka's are deployed on explores the possibilities of a machine to machine communi- a one-per-village basis, giving each village access to its own cation method to enable information sharing between geo- little piece of technology that facilitates local information graphically distributed devices. -
38 Bittorrent Software and Usage Justin Mckinney
ARTICLE BITTORRENT SOFTwaRE AND USAGE Justin McKinney Mark Simon Haydn 1. Abstract: While the circulation of cultural material outside of official channels is not new, the scale and infrastructure afforded by digital networks and peer-to-peer protocols has drastically changed its dynamics. Focusing on private trackers and online, members-only communities dedicated to sharing difficult to find and “gray-area” cinema content, our paper discusses new digital re- positories and their connection to the traditional film archive. With discussion of the types of materials held, user participation, and custodial efforts to restore or improve cultural material, we will discuss the activities of a contemporary private tracker community. Additionally, the paper will interrogate the legality and copyright issues surrounding these activities and ex- plore recent, licit adoption of the infrastructure that has been developed for online circulation. Discussion will conclude with attention to cases in which pirated material has resurfaced in a rights-holding context, and an assessment of what these developments mean for custodians of film material working in a traditional film archive context. As a combination of discussion, case study, and argument, the paper will serve as a topical primer on a pressing and under- researched area of interest in this field, building on a panel presented at last year’s Association of Moving Image Archivists conference in Georgia. 2. BitTorrent Software and Usage BitTorrent is a software protocol developed in 2001 and designed to aid the practice of peer- to-peer file sharing on the Internet. The primary advantage of BitTorrent is that it allows for segmented downloading, which is the coordinated transmission of a file sourced from multiple servers to a single destination.81 This protocol allows for the rapid sharing of large amounts of data by allowing a user to download a file from multiple sources that are uploading the file at the same time.82 This allows for more efficient and faster downloading than the traditional client-server model. -
Networks & Communications
PowerPoint Presentation to Accompany Chapter 9 Networks & Communications Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. Publishing as Pren=ce Hall Objectives 1. Discuss the importance of computer networks. 2. Compare different types of LANs and WANs. 3. List and describe the hardware used in both wired and wireless networks. 4. List and describe the software and protocols used in both wired and wireless networks. 5. Explain how to protect a network. Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. Publishing as Pren=ce Hall Objective 1: Overview From Sneakernet to Hotspots 1. Define computer network and network resources 2. Discuss the importance of computer networks 3. Differentiate between peer-to-peer networks and client-server networks Key Terms § Client § Peer-to-peer network § Client-server network § Server § Computer network § Workgroup § Homegroup § Network resource Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. Publishing as Pren=ce Hall Computer Networks § Computer network § Network resources § Two or more § Software computers § Hardware § Share resources § Files § Save time § Save money § Increase productivity § Homegroup § Simple networking feature § Used to network a group of Windows computers Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. Publishing as Pren=ce Hall Computer Network Types § Peer-to-peer (P2P) § Each computer is equal § Client-server network § At least one central server Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. Publishing as Pren=ce Hall Computer Network Types Peer-to-Peer (P2P) § Each device can share resources § No centralized authority § Each computer belongs to workgroup § Do not need to connect to the Internet § Most found in homes and small businesses § Simplest type of network § Do not need network operating system § All computers must be on to access resources Visualizing Technology Copyright © 2014 Pearson Educaon, Inc. -
Pirate Philosophy Leonardo Roger F
Pirate Philosophy Leonardo Roger F. Malina, Executive Editor Sean Cubitt, Editor-in-Chief Closer: Performance, Technologies, Phenomenology , Susan Kozel, 2007 Video: The Reflexive Medium , Yvonne Spielmann, 2007 Software Studies: A Lexicon , Matthew Fuller, 2008 Tactical Biopolitics: Art, Activism, and Technoscience , edited by Beatriz da Costa and Kavita Philip, 2008 White Heat and Cold Logic: British Computer Art 1960–1980 , edited by Paul Brown, Charlie Gere, Nicholas Lambert, and Catherine Mason, 2008 Rethinking Curating: Art after New Media , Beryl Graham and Sarah Cook, 2010 Green Light: Toward an Art of Evolution , George Gessert, 2010 Enfoldment and Infinity: An Islamic Genealogy of New Media Art , Laura U. Marks, 2010 Synthetics: Aspects of Art & Technology in Australia, 1956–1975 , Stephen Jones, 2011 Hybrid Cultures: Japanese Media Arts in Dialogue with the West , Yvonne Spielmann, 2012 Walking and Mapping: Artists as Cartographers , Karen O’Rourke, 2013 The Fourth Dimension and Non-Euclidean Geometry in Modern Art, revised edition , Linda Dalrymple Henderson, 2013 Illusions in Motion: Media Archaeology of the Moving Panorama and Related Spectacles , Erkki Huhtamo, 2013 Relive: Media Art Histories , edited by Sean Cubitt and Paul Thomas, 2013 Re-collection: Art, New Media, and Social Memory , Richard Rinehart and Jon Ippolito, 2014 Biopolitical Screens: Image, Power, and the Neoliberal Brain , Pasi Väliaho, 2014 The Practice of Light: A Genealogy of Visual Technologies from Prints to Pixels , Sean Cubitt, 2014 The Tone of Our Times: Sound, Sense, Economy, and Ecology , Frances Dyson, 2014 The Experience Machine: Stan VanDerBeek’s Movie-Drome and Expanded Cinema , Gloria Sutton, 2014 Hanan al-Cinema: Affections for the Moving Image , Laura U. -
Sneakernet on Wheels: Trustworthy NFC-Based Robot to Machine Communication
Sneakernet on Wheels: Trustworthy NFC-based Robot to Machine Communication Thomas Ulz, Thomas Pieber, Christian Steger Sarah Haas, Rainer Matischek Institute for Technical Informatics Development Center Graz Graz University of Technology Infineon Technologies Austria AG Graz, Austria Graz, Austria fthomas.ulz, thomas.pieber, [email protected] fsarah.haas, rainer.matischekg@infineon.com Abstract—Wireless communication technologies such as WiFi, controlled accessories could potentially operate in the ZigBee, or Bluetooth often suffer from interference due to many 2:4 GHz range [3]. The alternative 5 GHz range for WiFi devices using the same, unregulated frequency spectrum. Also, is also already used by other devices such as cordless wireless coverage can be insufficient in certain areas of a building. At the same time, eavesdropping a wireless communication out- phones, radar, and digital satellites [4]. Due to many de- side a building might be easy due to the extended communication vices operating in the same frequency range, interference range of particular technologies. These issues affect mobile robots will occur and affect wireless communication. and especially industrial mobile robots since the production 2) Insufficient Coverage: Due to certain objects in build- process relies on dependable and trustworthy communication. ings that dampen or even shield wireless communication Therefore, we present an alternative communication approach that uses Near Field Communication (NFC) to transfer confiden- (e.g. walls or large production machines) it is costly tial data such as production-relevant information or configuration to provide good wireless coverage for every part of updates. Due to NFC lacking security mechanisms, we propose a certain area. For IAMRs this is a problem due to a secured communication framework that is supported by dedi- the non-deterministic behavior when navigating on a cated hardware-based secure elements. -
Bitcoin 2: Freedom of Transaction
Bitcoin 2: Freedom of Transaction Sid Angeles and Eric Gonzalez [email protected] AF76 05E5 EB15 2B00 AB18 204C 11C9 1C8B EA6C 7389 [email protected] 3A85 7ABC 9453 96E4 B9DB 2A11 7370 E15E 8F60 2788 Donations: 1btctwojvohHSLaXaJAHWebZF2RS8n1NB Revision 2 July 23, 2013 Abstract We propose a set of changes to the original Bitcoin protocol (called Bitcoin 2) that allows Bitcoin to evolve into a system that is future-proof against developing threats to its original vision – an alternative, decentralized payment system which allows censorship-resistant, irreversible transac- tions. Bitcoin 2 strives to be a minimal set that lays the foundations for a long-lived system capable of delivering the original Bitcoin vision, with enough room for growth to layer additional im- provements on top of it. These changes include a sliding blockchain with fixed block sizes, the redistribution of dead coins with an unforgeable lottery, enforced mixing, and miner ostracism. The proposed changes require a proactive fork of the original Bitcoin block chain, but they allow final transfers of existing coins into Bitcoin 2 and a reuse of the existing Bitcoin infrastruc- ture. 1 Introduction The Bitcoin peer-to-peer electronic cash system [11] was introduced in 2009 and it proved to be a remarkable piece of work which found widespread adoption. The system was started with the explicit goal of providing a completely alternative payment system without a single point of failure that allows anonymous, but not untraceable, transactions. However, certain shortcomings in the original protocol and unforeseen developments inside and outside of the growing Bitcoin ecosystem threaten these very goals and there is good reason to believe that Bitcoin could develop into a system that is a complete perversion of the original vision – a com- pletely transparent payment system with very few points of control which has been totally absorbed by the established financial and regulatory environment. -
Terabyte Sneakernet: the Carry-On Data Center by Drew Hamre
December 2007 Terabyte SneakerNet: The Carry-on Data Center By Drew Hamre I recently helped relocate a data center for a US government agency, moving system images from Virginia to a consolidated facility in Minnesota. During ‘cutover’ weekend, production systems in Virginia were dropped and remained unavailable until data could be refreshed at the Minnesota data center and the new systems could be brought online. To minimize downtime, the time allotted for refreshing data across locations was extremely brief. email This data transfer was daunting for two reasons: the amount of data being moved was large (as much as two-terabytes would be moved during cutover weekend), and the network between the two sites was slow. Portable media were the only viable alternative, but these devices would need to meet extremely difficult requirements. They would need to be fast (due to the brief transfer window), inexpensive (no hardware funds were budgeted) and portable (devices needed to be hand-carried by agents to meet security mandates). Ideally, the team needed to find fast, cheap transfer devices that could be stowed in an airliner’s overhead bin. This paper reviews alternatives for the transfer, focusing on the latest generation of commodity Network Attached Storage (NAS) devices that allowed agents to transfer as much as 12-terabytes in a single carry-on duffle bag. Background: Transitioning Data Centers At the time of the transition, both data centers were fully functional: Virginia supported production, while Minnesota (a parallel environment running pre-staged system images on new hardware) supported acceptance testing. Minnesota’s parallel environment included a full snapshot of Virginia’s file system and databases (roughly 10-terabytes in total). -
Crowd Powered Media Delivery: Facilitating Ubiquitous Device-To-Device File Transfers
Crowd Powered Media Delivery: Facilitating Ubiquitous Device-To-Device File Transfers Colin Scott Microsoft Research India ABSTRACT latent desire for content that is not available from immedi- Device-to-device file transfers are pervasive in many emerg- ate friend groups: users would like to discover and transfer ing markets, but users typically only share content with close content within their geographic vicinity, and may even be friends or informal media vendors. We seek to facilitate willing to pay others to transport content to them. We seek ubiquitous device-to-device file transfers beyond one's im- to facilitate this `crowd powered' delivery of media, by pro- mediate social network. This extended abstract outlines the viding services such as a geo-tagged content directory and a research challenges we need to address and our initial plans remuneration system for transportation of content. for addressing them. Realizing our goal requires us to address several research challenges. Are users willing to travel physical distances to share content, and if so, what is the most appropriate re- 1. INTRODUCTION muneration model? How should metadata be distributed to It is widely acknowledged that demand for Internet con- devices in offline and poorly connected areas? What is the tent exceeds the available supply of bandwidth in emerging most understandable interface for naming and authenticat- markets. Internet companies have launched numerous ven- ing content? Can we devise a sustainable business model? tures to address this shortage, ranging from fiber installa- Can we arrange an agreeable relationship between copyright tions [9] to low Earth orbiting satellites [13], solar powered holders and consumers of (often pirated) content? drones [8], and high altitude balloons [10]. -
Terascale Sneakernet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange
TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange. Jim Gray, Wyman Chong, Tom Barclay, Alex Szalay, Jan Vandenberg May 2002 Technical Report MS-TR-02-54 Microsoft Research Advanced Technology Division Microsoft Corporation One Microsoft Way Redmond, WA 98052 TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange. Jim Gray, Wyman Chong, Tom Barclay, Alex Szalay, Jan Vandenberg May 2002 The Problem: How do we exchange Terabyte datasets? We want to send 10TB (terabytes, which is ten million megabytes) to many of our colleagues so that they can have a Table 1. Time to send a TB private copy of the Sloan Digital Sky Survey 1 Gbps 3 hours (http://skyserver.sdss.org/) or of the TerraServer data 100 Mbps 1 day (http://TerraServer.net/). 1 Mbps 3 months The data interchange problem is the extreme form of backup and archiving. In backup or archiving you are mailing the data to yourself in the future (for restore). So, a data interchange solution is likely a good solution for backup/restore and for archival storage. What is the best way to Table 2: The raw price of bandwidth, the true price is more move a terabyte from place than twice this when staff, router, and support costs are to place? The Next included. Raw prices are higher in some parts of the world. Raw Generation Internet (NGI) Speed Rent Raw $/TB Time/TB promised gigabit per Context Mbps $/month $/Mbps sent days second bandwidth desktop- home phone 0.04 40 1,000 3,086 6 years to-desktop by the year home DSL 0.6 70 117 360 5 months 2000.