Estimating Internet Address Space Usage Through Passive Measurements

Total Page:16

File Type:pdf, Size:1020Kb

Estimating Internet Address Space Usage Through Passive Measurements Estimating Internet Address Space Usage through Passive Measurements Alberto Dainotti, Michael Kallitsis Eduard Glatz, Karyn Benson, Xenofontas Alistair King, Merit Network, Inc. Dimitropoulos kc claffy Ann Arbor, Michigan, USA ETH Zurich CAIDA, UC San Diego [email protected] Zurich, Switzerland La Jolla, California, USA {eglatz,fontas}@tik.ee.ethz.ch {alberto,karyn,alistair,kc}@caida.org ABSTRACT Internet growth, including to what extent NAT and IPv6 One challenge in understanding the evolution of Internet in- deployment are reducing the pressure on (and demand for) frastructure is the lack of systematic mechanisms for moni- IPv4 address space. toring the extent to which allocated IP addresses are actu- To our knowledge, the only previous scientific work map- ally used. Address utilization has been monitored via ac- ping actual utilization of IPv4 addresses is ISI’s Internet tively scanning the entire IPv4 address space. We evaluate Census project [10] (ISI Census, in the following), which the potential to leverage passive network traffic measure- periodically sends ICMP echo requests to every single IPv4 ments in addition to or instead of active probing. Passive address (excluding private and multicast addresses) to track traffic measurements introduce no network traffic overhead, the active IP address population. This approach has four do not rely on unfiltered responses to probing, and could primary limitations: significant probing overhead; potential potentially apply to IPv6 as well. We investigate two chal- to offend probing targets (i.e., the entire Internet) who may lenges in using passive traffic for address utilization infer- request not to be probed or even blacklist probing addresses; ence: the limited visibility of a single observation point; inaccuracies due to the fact that many networks either filter and the presence of spoofed IP addresses in packets that out ICMP echo requests or respond to them on behalf of can distort results by implying faked addresses are active. other IP addresses, and inability to scale for use in a future We propose a methodology for removing such spoofed traf- IPv6 census. fic on both darknets and live networks, which yields results We investigate the potential for passive network traffic comparable to inferences made from active probing. Our measurements to inform or even substitute for active meth- preliminary analysis reveals a number of promising findings, ods of measuring address space utilization. Passive measure- including novel insight into the usage of the IPv4 address ments introduce no network traffic overhead, do not rely on space that would expand with additional vantage points. unfiltered responses to probing, and could potentially apply to IPv6 as well. On the other hand, a passive-measurement approach to address utilization inference has two daunting Categories and Subject Descriptors challenges which we explore in this paper: the limited visibil- C.2.3 [Network Operations]: Network monitoring; ity of any single vantage point of traffic; and the presence of C.2.5 [Local and Wide-Area Networks]: Internet spoofed IP addresses in packets that can significantly distort results by implying faked addresses are active. We analyze two types of passive traffic data: (i) Internet Background Keywords Radiation (IBR) packet traffic1 [25] captured by darknets Passive measurements; IPv4 address space; Internet address (also known as network telescopes); (ii) traffic (net)flow space; Darknet; Network telescope; Spoofed traffic; Internet summaries in operational networks. We develop and evalu- census ate techniques to identify and remove likely spoofed packets from both darknet (unidirectional) and two-way traffic data. 1. INTRODUCTION AND MOTIVATION Our contributions include: On February 3, 2011, the Internet Assigned Numbers Au- thority (IANA) allocated its last set of available IPv4 ad- • We demonstrate that, surprisingly, passive traffic mea- dresses to Regional Internet Registries (RIR), a historic turn- surements, including both packet-level captures from ing point for the Internet. The address pools of the Euro- darknets and two-way network flow summary records pean and Asian-Pacific RIRs were exhausted in 2012; the from operational networks, can reveal substantial in- other RIRs will likely run out within the next few years. Al- sight into Internet address utilization. though IPv4 address scarcity is now a reality, so is the fact that allocated addresses are often heavily under-utilized. • We introduce and validate heuristics for detecting IP One challenge in managing Internet address space (both address spoofing in captured network traffic data, thus IPv4 and IPv6) is the lack of reliable mechanisms to monitor mitigating their impact on our inferences. actual utilization of addresses. Macroscopic measurement of patterns in IPv4 address utilization also reveals insights into 1IBR is generated primarily by malware. ACM SIGCOMM Computer Communication Review 43 Volume 44, Number 1, January 2014 • We use our traffic data sets to show that combining negatives (tn) and false negatives (fn). We evaluate their passive with active measurements can reduce probing performance using four standard metrics: (by 37.9%) and find an additional ≈ 450K active /24s tp • Precision = tp+fp : fraction of positives that are true not detected as active by ICMP-based Internet census positives. measurement. tp • Recall = tp+fn : fraction of “active”-labeled networks • Our initial results reveal new macroscopic insights into correctly reported as active. Internet address space utilization, such as increasing tn activity within large legacy address blocks; additional • True negative rate = tn+fp : fraction of “inactive”- vantage points would likely illuminate activity in other labeled networks correctly reported as inactive.3 regions of Internet address space. tp+tn • Accuracy = tp+tn+fp+fn : fraction of correctly classi- • We publish comprehensive maps of IPv4 address space fied positives and negatives. utilization, at a /24 granularity, for 2012 [7]. 3. DATASETS 2. FRAMING THE PROBLEM Our passive measurement data include: (i) full packet traces collected from a /8 network telescope operated by To investigate the potential of passive measurements to the University of California San Diego (UCSD) [24]; (ii) provide a census-like snapshot of IP address space usage, we full packet traces collected from a ≈/8 network telescope consider four factors: finding appropriate traffic measure- (space covering 14M different addresses) operated by Merit ment locations; selecting an observation granularity; identi- Network (MERIT) [17]; and (iii) unsampled NetFlow traces fying and removing traffic with spoofed IP source addresses; collected at SWITCH, a regional academic backbone net- and quantitatively evaluating our algorithm including vali- work that serves 46 single-homed universities and research dating against what ground truth data we can gather. institutes in Switzerland [22]; the monitored address range Observation granularity. We analyze the usage of the of SWITCH contains 2.2 million IP addresses, which corre- IPv4 address space with /24 address-block granularity (/24 spond to a continuous block slightly larger than a /11. All blocks, in the following), i.e., we consider a /24 block as ei- datasets are from the same collection period, between July ther active (or inactive) if we observe traffic from at least one 31 and September 2, 2012. (or exactly zero) IP address from that address block. There For comparison, we use the ISI Internet Census dataset is no universal IP address segment boundary space (due to it49c-20120731, obtained by probing the entire IPv4 address sub-netting and varying size of administrative domains), but space [12] during this same time window. Based on the using a /24 granularity mitigates the effects of dynamic but suggestions by the data collector [13], we filtered this dataset temporary IP address assignment (e.g., DHCP), as well as to only those probes that received an ICMP echo reply, and having an intuitive relationship with both routing operations where the source address in the reply matched the target and address allocation policy. address of the original probe. We do not consider negative Measurement location. We devise techniques for two replies (e.g. ICMP time exceeded) since we assume they types of passive measurement data: bidirectional netflow are not reaching the target. In addition, we filtered out data from all nodes in a large live research network (SWITCH, all probes sent to IP addresses with a least significant byte in Switzerland), and raw unidirectional packet traffic data of 0 or 255, which are typically reserved for network and from two large darknets. Section 3 describes these data sets, broadcast addresses respectively [10] and third parties along and others we used to validate our inferences. the path may intercept and reply to such probes. Note that Identifying and removing spoofed traffic. Packets the ISI Census experiment was designed to report at a /32 with source IPs other than those assigned to the sending (host) rather than /24 (subnet) granularity, but we apply host, i.e., spoofed traffic, will skew our address utilization the resulting data set to a /24 granularity analysis. results. Source IP addresses may be spoofed for a variety To establish a set of unrouted IPv4 address blocks, we of reasons, typically to prevent attribution of an attack and 2 take a list of BGP prefixes announced and captured by avoid being caught [6] , but also due to transmission or pro- the route-views2.routeviews.org [3] collector
Recommended publications
  • Virtual Memory
    Chapter 4 Virtual Memory Linux processes execute in a virtual environment that makes it appear as if each process had the entire address space of the CPU available to itself. This virtual address space extends from address 0 all the way to the maximum address. On a 32-bit platform, such as IA-32, the maximum address is 232 − 1or0xffffffff. On a 64-bit platform, such as IA-64, this is 264 − 1or0xffffffffffffffff. While it is obviously convenient for a process to be able to access such a huge ad- dress space, there are really three distinct, but equally important, reasons for using virtual memory. 1. Resource virtualization. On a system with virtual memory, a process does not have to concern itself with the details of how much physical memory is available or which physical memory locations are already in use by some other process. In other words, virtual memory takes a limited physical resource (physical memory) and turns it into an infinite, or at least an abundant, resource (virtual memory). 2. Information isolation. Because each process runs in its own address space, it is not possible for one process to read data that belongs to another process. This improves security because it reduces the risk of one process being able to spy on another pro- cess and, e.g., steal a password. 3. Fault isolation. Processes with their own virtual address spaces cannot overwrite each other’s memory. This greatly reduces the risk of a failure in one process trig- gering a failure in another process. That is, when a process crashes, the problem is generally limited to that process alone and does not cause the entire machine to go down.
    [Show full text]
  • Virtual Memory - Paging
    Virtual memory - Paging Johan Montelius KTH 2020 1 / 32 The process code heap (.text) data stack kernel 0x00000000 0xC0000000 0xffffffff Memory layout for a 32-bit Linux process 2 / 32 Segments - a could be solution Processes in virtual space Address translation by MMU (base and bounds) Physical memory 3 / 32 one problem Physical memory External fragmentation: free areas of free space that is hard to utilize. Solution: allocate larger segments ... internal fragmentation. 4 / 32 another problem virtual space used code We’re reserving physical memory that is not used. physical memory not used? 5 / 32 Let’s try again It’s easier to handle fixed size memory blocks. Can we map a process virtual space to a set of equal size blocks? An address is interpreted as a virtual page number (VPN) and an offset. 6 / 32 Remember the segmented MMU MMU exception no virtual addr. offset yes // < within bounds index + physical address segment table 7 / 32 The paging MMU MMU exception virtual addr. offset // VPN available ? + physical address page table 8 / 32 the MMU exception exception virtual address within bounds page available Segmentation Paging linear address physical address 9 / 32 a note on the x86 architecture The x86-32 architecture supports both segmentation and paging. A virtual address is translated to a linear address using a segmentation table. The linear address is then translated to a physical address by paging. Linux and Windows do not use use segmentation to separate code, data nor stack. The x86-64 (the 64-bit version of the x86 architecture) has dropped many features for segmentation.
    [Show full text]
  • Advanced X86
    Advanced x86: BIOS and System Management Mode Internals Input/Output Xeno Kovah && Corey Kallenberg LegbaCore, LLC All materials are licensed under a Creative Commons “Share Alike” license. http://creativecommons.org/licenses/by-sa/3.0/ ABribuEon condiEon: You must indicate that derivave work "Is derived from John BuBerworth & Xeno Kovah’s ’Advanced Intel x86: BIOS and SMM’ class posted at hBp://opensecuritytraining.info/IntroBIOS.html” 2 Input/Output (I/O) I/O, I/O, it’s off to work we go… 2 Types of I/O 1. Memory-Mapped I/O (MMIO) 2. Port I/O (PIO) – Also called Isolated I/O or port-mapped IO (PMIO) • X86 systems employ both-types of I/O • Both methods map peripheral devices • Address space of each is accessed using instructions – typically requires Ring 0 privileges – Real-Addressing mode has no implementation of rings, so no privilege escalation needed • I/O ports can be mapped so that they appear in the I/O address space or the physical-memory address space (memory mapped I/O) or both – Example: PCI configuration space in a PCIe system – both memory-mapped and accessible via port I/O. We’ll learn about that in the next section • The I/O Controller Hub contains the registers that are located in both the I/O Address Space and the Memory-Mapped address space 4 Memory-Mapped I/O • Devices can also be mapped to the physical address space instead of (or in addition to) the I/O address space • Even though it is a hardware device on the other end of that access request, you can operate on it like it's memory: – Any of the processor’s instructions
    [Show full text]
  • Virtual Memory in X86
    Fall 2017 :: CSE 306 Virtual Memory in x86 Nima Honarmand Fall 2017 :: CSE 306 x86 Processor Modes • Real mode – walks and talks like a really old x86 chip • State at boot • 20-bit address space, direct physical memory access • 1 MB of usable memory • No paging • No user mode; processor has only one protection level • Protected mode – Standard 32-bit x86 mode • Combination of segmentation and paging • Privilege levels (separate user and kernel) • 32-bit virtual address • 32-bit physical address • 36-bit if Physical Address Extension (PAE) feature enabled Fall 2017 :: CSE 306 x86 Processor Modes • Long mode – 64-bit mode (aka amd64, x86_64, etc.) • Very similar to 32-bit mode (protected mode), but bigger address space • 48-bit virtual address space • 52-bit physical address space • Restricted segmentation use • Even more obscure modes we won’t discuss today xv6 uses protected mode w/o PAE (i.e., 32-bit virtual and physical addresses) Fall 2017 :: CSE 306 Virt. & Phys. Addr. Spaces in x86 Processor • Both RAM hand hardware devices (disk, Core NIC, etc.) connected to system bus • Mapped to different parts of the physical Virtual Addr address space by the BIOS MMU Data • You can talk to a device by performing Physical Addr read/write operations on its physical addresses Cache • Devices are free to interpret reads/writes in any way they want (driver knows) System Interconnect (Bus) : all addrs virtual DRAM Network … Disk (Memory) Card : all addrs physical Fall 2017 :: CSE 306 Virt-to-Phys Translation in x86 0xdeadbeef Segmentation 0x0eadbeef Paging 0x6eadbeef Virtual Address Linear Address Physical Address Protected/Long mode only • Segmentation cannot be disabled! • But can be made a no-op (a.k.a.
    [Show full text]
  • Virtual Memory
    CSE 410: Systems Programming Virtual Memory Ethan Blanton Department of Computer Science and Engineering University at Buffalo Introduction Address Spaces Paging Summary References Virtual Memory Virtual memory is a mechanism by which a system divorces the address space in programs from the physical layout of memory. Virtual addresses are locations in program address space. Physical addresses are locations in actual hardware RAM. With virtual memory, the two need not be equal. © 2018 Ethan Blanton / CSE 410: Systems Programming Introduction Address Spaces Paging Summary References Process Layout As previously discussed: Every process has unmapped memory near NULL Processes may have access to the entire address space Each process is denied access to the memory used by other processes Some of these statements seem contradictory. Virtual memory is the mechanism by which this is accomplished. Every address in a process’s address space is a virtual address. © 2018 Ethan Blanton / CSE 410: Systems Programming Introduction Address Spaces Paging Summary References Physical Layout The physical layout of hardware RAM may vary significantly from machine to machine or platform to platform. Sometimes certain locations are restricted Devices may appear in the memory address space Different amounts of RAM may be present Historically, programs were aware of these restrictions. Today, virtual memory hides these details. The kernel must still be aware of physical layout. © 2018 Ethan Blanton / CSE 410: Systems Programming Introduction Address Spaces Paging Summary References The Memory Management Unit The Memory Management Unit (MMU) translates addresses. It uses a per-process mapping structure to transform virtual addresses into physical addresses. The MMU is physical hardware between the CPU and the memory bus.
    [Show full text]
  • An Internet Protocol (IP) Address Is a Numerical Label That Is
    Computer Communication Networks Lecture No. 5 Computer Network Lectures IP address An Internet Protocol (IP) address is a numerical label that is assigned to devices participating in a computer network, that uses the Internet Protocol for communication between its nodes. An IP address serves two principal functions: 1- host or network interface identification 2- location addressing. Its role has been characterized as follows: "A name indicates what we seek. An address indicates where it is. A route indicates how to get there." The designers of TCP/IP defined an IP address as a 32-bit number and this system, known as Internet Protocol Version 4 or IPv4, is still in use today. However, due to the enormous growth of the Internet and the resulting depletion of available addresses, a new addressing system (IPv6), using 128 bits for the address, was developed in 1995. Although IP addresses are stored as binary numbers, they are usually displayed in human-readable notations, such as 208.77.188.166 (for IPv4), and 2001:db8:0:1234:0:567:1:1 (for IPv6). The Internet Protocol also routes data packets between networks; IP addresses specify the locations of the source and destination nodes in the topology of the routing system. For this purpose, some of the bits in an IP address are used to designate a sub network. As the development of private networks raised the threat of IPv4 address exhaustion, RFC 1918 set aside a group of private address spaces that may be used by anyone on private networks. They are often used with network address translators to connect to the global public Internet.
    [Show full text]
  • X86 Memory Protection and Translation
    x86 Memory Protection and Translation Don Porter CSE 506 Lecture Goal ò Understand the hardware tools available on a modern x86 processor for manipulating and protecting memory ò Lab 2: You will program this hardware ò Apologies: Material can be a bit dry, but important ò Plus, slides will be good reference ò But, cool tech tricks: ò How does thread-local storage (TLS) work? ò An actual (and tough) Microsoft interview question Undergrad Review ò What is: ò Virtual memory? ò Segmentation? ò Paging? Two System Goals 1) Provide an abstraction of contiguous, isolated virtual memory to a program 2) Prevent illegal operations ò Prevent access to other application or OS memory ò Detect failures early (e.g., segfault on address 0) ò More recently, prevent exploits that try to execute program data Outline ò x86 processor modes ò x86 segmentation ò x86 page tables ò Software vs. Hardware mechanisms ò Advanced Features ò Interesting applications/problems x86 Processor Modes ò Real mode – walks and talks like a really old x86 chip ò State at boot ò 20-bit address space, direct physical memory access ò Segmentation available (no paging) ò Protected mode – Standard 32-bit x86 mode ò Segmentation and paging ò Privilege levels (separate user and kernel) x86 Processor Modes ò Long mode – 64-bit mode (aka amd64, x86_64, etc.) ò Very similar to 32-bit mode (protected mode), but bigger ò Restrict segmentation use ò Garbage collect deprecated instructions ò Chips can still run in protected mode with old instructions Translation Overview 0xdeadbeef Segmentation 0x0eadbeef Paging 0x6eadbeef Virtual Address Linear Address Physical Address Protected/Long mode only ò Segmentation cannot be disabled! ò But can be a no-op (aka flat mode) x86 Segmentation ò A segment has: ò Base address (linear address) ò Length ò Type (code, data, etc).
    [Show full text]
  • Chapter 9: Memory Management
    Chapter 9: Memory Management I Background I Swapping I Contiguous Allocation I Paging I Segmentation I Segmentation with Paging Operating System Concepts 9.1 Silberschatz, Galvin and Gagne 2002 Background I Program must be brought into memory and placed within a process for it to be run. I Input queue – collection of processes on the disk that are waiting to be brought into memory to run the program. I User programs go through several steps before being run. Operating System Concepts 9.2 Silberschatz, Galvin and Gagne 2002 Binding of Instructions and Data to Memory Address binding of instructions and data to memory addresses can happen at three different stages. I Compile time: If memory location known a priori, absolute code can be generated; must recompile code if starting location changes. I Load time: Must generate relocatable code if memory location is not known at compile time. I Execution time: Binding delayed until run time if the process can be moved during its execution from one memory segment to another. Need hardware support for address maps (e.g., base and limit registers). Operating System Concepts 9.3 Silberschatz, Galvin and Gagne 2002 Multistep Processing of a User Program Operating System Concepts 9.4 Silberschatz, Galvin and Gagne 2002 Logical vs. Physical Address Space I The concept of a logical address space that is bound to a separate physical address space is central to proper memory management. ✦ Logical address – generated by the CPU; also referred to as virtual address. ✦ Physical address – address seen by the memory unit. I Logical and physical addresses are the same in compile- time and load-time address-binding schemes; logical (virtual) and physical addresses differ in execution-time address-binding scheme.
    [Show full text]
  • Internet Address Space: Economic Considerations in the Management of Ipv4”, OECD Digital Economy Papers, No
    Please cite this paper as: OECD (2008-06-18), “Internet Address Space: Economic Considerations in the Management of IPv4”, OECD Digital Economy Papers, No. 145, OECD Publishing, Paris. http://dx.doi.org/10.1787/230461618475 OECD Digital Economy Papers No. 145 Internet Address Space ECONOMIC CONSIDERATIONS IN THE MANAGEMENT OF IPV4 OECD DSTI/ICCP(2007)20/FINAL FOREWORD The report provides an analysis of economic considerations associated with the transition from IPv4 to IPv6. It provides background analysis supporting the forthcoming ICCP-organised Ministerial-level meeting on ―The Future of the Internet Economy‖, to take place in Seoul, Korea on 17-18 June 2008. This report was prepared by Ms. Karine Perset of the OECD‘s Directorate for Science Technology and Industry. It was declassified by the ICCP Committee at its 54th Session on 5-7 March 2008. It is published under the responsibility of the Secretary-General of the OECD. This paper has greatly benefited from the expert input of Geoff Huston from APNIC, David Conrad from the IANA, Patrick Grossetête from CISCO Systems, Bill Woodcock from Packet Clearing House, Marcelo Bagnulo Braun from the University of Madrid, Alain Durand from Comcast, and Vincent Bataille from Mulot Déclic, although interpretations, unless otherwise stated, are those of the author. 2 DSTI/ICCP(2007)20/FINAL TABLE OF CONTENTS FOREWORD ................................................................................................................................................... 2 MAIN POINTS ..............................................................................................................................................
    [Show full text]
  • Virtual Memory and Linux
    Virtual Memory and Linux Matt Porter Embedded Linux Conference Europe October 13, 2016 About the original author, Alan Ott ● Unfortunately, he is unable to be here at ELCE 2016. ● Veteran embedded systems and Linux developer ● Linux Architect at SoftIron – 64-bit ARM servers and data center appliances – Hardware company, strong on software – Overdrive 3000, more products in process Physical Memory Single Address Space ● Simple systems have a single address space ● Memory and peripherals share – Memory is mapped to one part – Peripherals are mapped to another ● All processes and OS share the same memory space – No memory protection! – Processes can stomp one another – User space can stomp kernel mem! Single Address Space ● CPUs with single address space ● 8086-80206 ● ARM Cortex-M ● 8- and 16-bit PIC ● AVR ● SH-1, SH-2 ● Most 8- and 16-bit systems x86 Physical Memory Map ● Lots of Legacy ● RAM is split (DOS Area and Extended) ● Hardware mapped between RAM areas. ● High and Extended accessed differently Limitations ● Portable C programs expect flat memory ● Multiple memory access methods limit portability ● Management is tricky ● Need to know or detect total RAM ● Need to keep processes separated ● No protection ● Rogue programs can corrupt the entire system Virtual Memory What is Virtual Memory? ● Virtual Memory is a system that uses an address mapping ● Maps virtual address space to physical address space – Maps virtual addresses to physical RAM – Maps virtual addresses to hardware devices ● PCI devices ● GPU RAM ● On-SoC IP blocks What is Virtual Memory? ● Advantages ● Each processes can have a different memory mapping – One process's RAM is inaccessible (and invisible) to other processes.
    [Show full text]
  • Virtual Memory and Caches
    CS 152 Computer Architecture and Engineering Lecture 11 - Virtual Memory and Caches Krste Asanovic Electrical Engineering and Computer Sciences University of California at Berkeley http://www.eecs.berkeley.edu/~krste! http://inst.eecs.berkeley.edu/~cs152! February 25, 2010 CS152, Spring 2010 Today is a review of last two lectures • Translation/Protection/Virtual Memory • This is complex material - often takes several passes before the concepts sink in • Try to take a different path through concepts today February 25, 2010 CS152, Spring 2010 2 VM features track historical uses: • Bare machine, only physical addresses – One program owned entire machine • Batch-style multiprogramming – Several programs sharing CPU while waiting for I/O – Base & bound: translation and protection between programs (not virtual memory) – Problem with external fragmentation (holes in memory), needed occasional memory defragmentation as new jobs arrived • Time sharing – More interactive programs, waiting for user. Also, more jobs/second. – Motivated move to fixed-size page translation and protection, no external fragmentation (but now internal fragmentation, wasted bytes in page) – Motivated adoption of virtual memory to allow more jobs to share limited physical memory resources while holding working set in memory • Virtual Machine Monitors – Run multiple operating systems on one machine – Idea from 1970s IBM mainframes, now common on laptops » e.g., run Windows on top of Mac OS X – Hardware support for two levels of translation/protection » Guest OS virtual -> Guest OS physical -> Host machine physical February 25, 2010 CS152, Spring 2010 3 Bare Machine Physical Physical Address Inst. Address Data Decode PC Cache D E + M Cache W Physical Physical Address Memory Controller Address Physical Address Main Memory (DRAM) • In a bare machine, the only kind of address is a physical address February 25, 2010 CS152, Spring 2010 4 Base and Bound Scheme Data Bound Bounds Register ≤ Violation? Mem.
    [Show full text]
  • CS5460: Operating Systems
    CS5460: Operating Systems Lecture 13: Memory Management (Chapter 8) CS 5460: Operating Systems Where are we? Basic OS structure,• HW/SW interface, interrupts, scheduling • •Concurrency • Memory management Storage management Other topics CS 5460: Operating Systems Example Virtual Address Space 0xFFFFFFFF Typical address space has 4 parts User stack segment SP – Code: binary image of program – Data: static variables (globals) HP – Heap : explicitly allocated data (malloc) User heap – Stack: implicitly allocated data User Kernel mapped into all processes User data segment MMU hardware: PC User code segment – Remaps virtual addresses to physical 0x80000000 – Supports read-only, supervisor-only Kernel heap – Detects accesses to unmapped regions How can we load two processes Kernel data segment into memory at same time? – Assume each has similar layout Kernel Kernel code segment 0x00000000 CS 5460: Operating Systems Mapping Addresses How can process (virtual) addresses be mapped to physical addresses? – Compile time: Compiler generates physical addresses directly » Advantages: No MMU hardware, no runtime translation overhead » Disadvantages: Inflexible, hard to multiprogram, inefficient use of DRAM – Load time: OS loader “fixes” addresses when it loads program » Advantages: Can support static multiprogramming » Disadvantages: MMU hardware, inflexible, hard to share data, … – Dynamic: Compiler generates address, but OS/HW reinterpret » Advantages: Very flexible, can use memory efficiently » Disadvantages: MMU hardware req’d, runtime
    [Show full text]