A Framework for Alternate Queueing: Towards Traffic Management by PC

Total Page:16

File Type:pdf, Size:1020Kb

A Framework for Alternate Queueing: Towards Traffic Management by PC A Framework for Alternate Queueing: Towards Traffic Management by PC-UNIX Based Routers Kenjiro Cho Sony Computer Science Laboratory, Inc. Tokyo, Japan 1410022 [email protected] Abstract method to implement an alternative queueing discipline, which is the main obstacle to incorporating alternative Queueing is an essential element of traffic manage- queueing disciplines. ment, but the only queueing discipline used in traditional UNIX systems is simple FIFO queueing. This paper de- On the other hand, the rapidly increasing power of scribes ALTQ, a queueing framework that allows the use PCs, emerging high-speed network cards, and their drop- of a set of queueing disciplines. We investigate the is- ping costs make it an attractive choice to implement an sues involved in designing a generic queueing framework intelligent queueing on PC-based routers. Another driv- as well as the issues involved in implementing various ing force behind PC-based routers is flexibility in soft- queueing disciplines. ALTQ is implemented as simple ware development as the requirements for a router are extension to the FreeBSD kernel including minor fixes growing. to the device drivers. Several queueing disciplines in- In view of this situation, we have designed and built cluding CBQ, RED, and WFQ are implemented onto ALTQ, a framework for alternate queueing. ALTQ al- the framework to demonstrate the design of ALTQ. The lows implementors to implement various queueing dis- traffic management performance of a PC is presented to ciplines on PC-based UNIX systems. A set of queue- show the feasibility of traffic management by PC-UNIX ing disciplines are implemented to demonstrate the traf- based routers. fic management abilities of PC-UNIX based routers. ALTQ is designed to support a variety of queue- ing disciplines with different components: scheduling 1 Introduction strategies, packet drop strategies, buffer allocation strate- Traffic management is of great importance to today’s gies, multiple priority levels, and non-work conserving packet networks. Traffic management consists of a di- queues. Different queueing disciplines can share many verse set of mechanisms and policies, but the heart of parts: flow classification, packet handling, and device the technology is a packet scheduling mechanism, also driver support. Therefore, researchers will be able to im- known as queueing. Sophisticated queueing can pro- plement a new queueing discipline without knowing the vide performance bounds of bandwidth, delay, jitter, and details of the kernel implementations. loss, and thus, can meet the requirements of real-time Our framework is designed to support both research services. Queueing is also vital to best-effort services to and operation. Once such a framework is widely de- avoid congestion and to provide fairness and protection, ployed, research output by simulation can be easily im- which leads to more stable and predictable network be- plemented and tested with real machines and networks. havior. There has been a considerableamount of research Then, if proved useful, the discipline can be brought into related to traffic management and queueing over the last routers in practical service. Availability of a set of queue- several years. ing disciplines will raise public awareness of traffic man- Many queueing disciplines have been proposed and agement issues, which in turn raises research incentives studied to date by the research community, mostly by to attack hard problems. analysis and simulation. Such disciplines are not, how- Another important issue to consider is deployment of ever, widely used because there is no easy way to im- the framework. To this end just a framework is not plement them into the existing network equipment. In enough. In order to make people want to use it, we BSD UNIX, the only queueing discipline implemented have to have concrete queueing disciplines which have is a simple tail-drop FIFO queue. There is no general specific applications. Therefore, we have implemented 1 s = splimp(); ip_output if (IF_QFULL(&ifp->if_snd)) { IF_DROP(&ifp->if_snd); splx(s); m_freem(m); if_output return(ENOBUFS); } altq_enqueue IF_ENQUEUE IF_ENQUEUE(&ifp->if_snd, m); if ((ifp->if_flags & IFF_OACTIVE) == 0) if_snd alternative alternative discipline 1 discipline 2 (*ifp->if_start)(ifp); splx(s); IF_DEQUEUE altq_dequeue Figure 2: Enqueue Operation in if output if_start for the output queue of a network interface. The input Figure 1: Alternate Queueing Architecture queue has less importance because traffic control func- tions only at the entrance to a bottleneck link. In BSD UNIX, an output queue is implemented in the abstract Class-BasedQueueing (CBQ) [6] and RandomEarly De- interface structure ifnet. The queue structure, if snd, tection (RED) [5] targeting two potential user groups. is manipulated by IF ENQUEUE() and IF DEQUEUE() CBQ can be used for integrated services. RSVP [22] is macros. These macros are used by two functions regis- a resource reservation protocol for integrated services; tered in struct ifnet, if output and if start; if output de- RSVP itself is a signaling protocol to set up the traffic fined for each link type performs the enqueue operation, control module of the routers along a path. The RSVP and if start defined as part of a network device driver release from ISI [9] does not have a traffic control mod- performs the dequeue operation [13]. ule so that there are great demands for a queueing im- One might think that just replacing IF ENQUEUE() plementation capable of traffic control. Although CBQ and IF DEQUEUE() will suffice, but, unfortunately, it was not originally designed for use with RSVP, CBQ has is not the case. The problem is that the queueing op- been used by Sun as a traffic control module for RSVP erations used inside the kernel are not only enqueueing on Solaris and the source code has been available [20]. and dequeueing. In addition, surprisingly many parts of RED is for active queue management of best-effort the kernel code assume FIFO queueing and the ifqueue services [2]. Active queue management has been exten- structure. sively discussed to avoid congestion in the Internet. Al- To illustrate the problem, let’s take a look at the en- though CBQ can be used for this purpose, RED seems queue operation in a typical if output in Figure 2. The more popular since RED does not require flow states code performs three operations related to queueing. or class states, and thus, is simpler and more scalable. Again, no implementation is available at hand. 1. checkif the queueis full by IF QFULL(), andif so, Another important factor for widespread acceptance drop the arriving packet. is simplicity and stability of the implementation, which 2. enqueue the packet by IF ENQUEUE(). caused us to emphasize practicality instead of elegance while designing ALTQ. 3. call the device driver to send out the packet unless In summary, the goals of our prototype are three-fold: the driver is already busy. provide a queueing research platform. The code assumes the tail-drop policy, that is, the arriv- ing packet is dropped. But the decision to drop and the provide a traffic control kernel for RSVP. selection of a victim packet should be up to a queue- make active queue management available. ing discipline. Moreover, in a random drop policy, the drop operation often comes after enqueueing an arriv- In this paper, we will show the design and implemen- ing packet. The order of the two operations also de- tation of ALTQ, and report the traffic management per- pends on a queueing discipline. Furthermore, in a non- formance of the prototype on FreeBSD [7]. work conserving queue, enqueueing a packet does not mean the packet is sent out immediately, but rather, the 2 ALTQ driver should be invoked later at some scheduled timing. Hence, in order to implement a generic queueing inter- 2.1 ALTQ Design face, we have no choice but to replace part of the code in The basic design of ALTQ is quite simple; the queue- if output routines. ing interface is a switch to a set of queueing disciplines There are also problems in if start routines. Some as shown in Figure 1. Alternate queueing is used only drivers peek at the head of the queue to see if the driver 2 has enough buffer space and/or DMA descriptors for the the hook. This method has other advantages; the system next packet. Those drivers directly access if snd using can fall back to the original queueing if something goes different methods since no procedure is defined for a wrong. As a result, the system becomes more reliable, peek operation. A queueing discipline could have multi- easier to use, and easier to debug. In addition, it is com- ple queues, or could be about to dequeue a packet other patible with the existing user programs that refer to struct than the one at the head of the queue. Therefore, the ifnet (e.g., ifconfig and netstat). peek operation should be part of the generic queueing Queueing disciplines are controlled by ioctl system interface. Although it is possible in theory to rewrite all calls via a queueing device (e.g., /dev/cbq). ALTQ is de- drivers not to use peek operations, it is wise to support fined as a character device and each queueing discipline a peek operation, considering the labor required to mod- is defined as a minor device of ALTQ. To activate an al- ify the existing drivers. A discipline must guarantee that ternative queueing discipline, a privileged user program the peeked packet will be returned by the next dequeue opens the queue device associated with the discipline, operation. then, attaches the discipline to an interface and enables IF PREPEND() is defined in BSD UNIX to add a it via the corresponding ioctl system calls. When the al- packet at the head of the queue, but the prepend oper- ternative queueing is disabled or closed, the system falls ation is intended for a FIFO queue and should not be back to the original FIFO queueing.
Recommended publications
  • Programmer's Guide
    Programmer’s Guide Release 2.2.0 January 16, 2016 CONTENTS 1 Introduction 1 1.1 Documentation Roadmap...............................1 1.2 Related Publications..................................2 2 Overview 3 2.1 Development Environment..............................3 2.2 Environment Abstraction Layer............................4 2.3 Core Components...................................4 2.4 Ethernet* Poll Mode Driver Architecture.......................6 2.5 Packet Forwarding Algorithm Support........................6 2.6 librte_net........................................6 3 Environment Abstraction Layer7 3.1 EAL in a Linux-userland Execution Environment..................7 3.2 Memory Segments and Memory Zones (memzone)................ 11 3.3 Multiple pthread.................................... 12 3.4 Malloc.......................................... 14 4 Ring Library 19 4.1 References for Ring Implementation in FreeBSD*................. 20 4.2 Lockless Ring Buffer in Linux*............................ 20 4.3 Additional Features.................................. 20 4.4 Use Cases....................................... 21 4.5 Anatomy of a Ring Buffer............................... 21 4.6 References....................................... 28 5 Mempool Library 31 5.1 Cookies......................................... 31 5.2 Stats.......................................... 31 5.3 Memory Alignment Constraints............................ 31 5.4 Local Cache...................................... 32 5.5 Use Cases....................................... 33 6
    [Show full text]
  • The Qosbox: Quantitative Service Differentiation in BSD Routers∗
    The QoSbox: Quantitative Service Differentiation in BSD Routers∗ Nicolas Christin Jorg¨ Liebeherr Information Networking Institute and The Edward S. Rogers Sr. Department of CyLab Japan Electrical and Computer Engineering Carnegie Mellon University University of Toronto 1-3-3-17 Higashikawasaki-cho 10 King’s College Road Chuo-ku, Kobe 650-0044, Japan Toronto, ON M5S 3G4, Canada [email protected] [email protected] Abstract We describe the design and implementation of the QoSbox, a configurable IP router that provides per-hop service differentiation on loss, delays and throughput to classes of traffic. The novel aspects of the QoSbox are that (1) the QoSbox does not rely on any external component (e.g., no traffic shaping and no admission control) to provide the desired service differentiation, but instead, (2) dynamically adapts packet forwarding and dropping decisions as a function of the instantaneous traffic arrivals and allows for temporary relaxation of some service objectives; also, (3) the QoSbox can enforce both absolute and proportional service differentiation on queuing delays, loss rates, and throughput at the same time. We focus on a publicly available implementation of the QoSbox in BSD-based PC-routers. We evaluate our implementation in a testbed of BSD routers over a FastEthernet network, and we sketch how the QoSbox can be implemented in high speed architectures. Keywords: Quality-of-Service Implementations, Service Differentiation, PC-Routers, BSD, High-Speed Networks. ∗Most of this work was done while both authors were with the University of Virginia. This work was supported in part by the National Science Foundation through grants ANI-9730103 and ANI-0085955.
    [Show full text]
  • Pf3e Index.Pdf
    INDEX Note: Pages numbers followed by f, n, priority-based queues, 136–145 or t indicate figures, notes, and tables, match rule for queue assignment, respectively. 137–138 overview, 134–135 Symbols performance improvement, 136–137 # (hash mark), 13, 15 queuing for servers in DMZ, ! (logical NOT) operator, 42 142–144 setting up, 135–136 A on FreeBSD, 135–136 on NetBSD, 136 Acar, Can Erkin, 173 on OpenBSD, 135 ACK (acknowledgment) packets transitioning to priority and class-based bandwidth allocation, queuing system, 131–133 139–140 anchors, 35–36 HFSC algorithm, 124, 126, 142 authpf program, 61, 63 priority queues, 132, 137–138 listing current contents of, 92 two-priority configuration, loading rules into, 92 120–121, 120n1 manipulating contents, 92 adaptive.end value, 188 relayd daemon, 74 adaptive firewalls, 97–99 restructuring rule set with, 91–94 adaptive.start value, 188 tagging to help policy routing, 93 advbase parameter, 153–154 ancontrol command, 46n1 advskew parameter, 153–154, 158–159 antispoof tool, 27, 193–195, 194f aggressive value, 192 ARP balancing, 151, 157–158 ALTQ (alternate queuing) framework, atomic rule set load, 21 9, 133–145, 133n2 authpf program, 59–63, 60 basic concepts, 134 basic authenticating gateways, class-based bandwidth allocation, 60–62 139–140 public networks, 62–63 overview, 135 queue definition, 139–140 tying queues into rule set, 140 B handling unwanted traffic, 144–145 bandwidth operating system-based queue actual available, 142–143 assignments, 145 class-based allocation of, 139–140 overloading to
    [Show full text]
  • Freebsd Handbook
    FreeBSD Handbook http://www.freebsd.org/doc/en_US.ISO8859-1/books/han... FreeBSD Handbook The FreeBSD Documentation Project Copyright © 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013 The FreeBSD Documentation Project Welcome to FreeBSD! This handbook covers the installation and day to day use of FreeBSD 8.3-RELEASE and FreeBSD 9.1-RELEASE. This manual is a work in progress and is the work of many individuals. As such, some sections may become dated and require updating. If you are interested in helping out with this project, send email to the FreeBSD documentation project mailing list. The latest version of this document is always available from the FreeBSD web site (previous versions of this handbook can be obtained from http://docs.FreeBSD.org/doc/). It may also be downloaded in a variety of formats and compression options from the FreeBSD FTP server or one of the numerous mirror sites. If you would prefer to have a hard copy of the handbook, you can purchase one at the FreeBSD Mall. You may also want to search the handbook. REDISTRIBUTION AND USE IN SOURCE (XML DOCBOOK) AND 'COMPILED' FORMS (XML, HTML, PDF, POSTSCRIPT, RTF AND SO FORTH) WITH OR WITHOUT MODIFICATION, ARE PERMITTED PROVIDED THAT THE FOLLOWING CONDITIONS ARE MET: 1. REDISTRIBUTIONS OF SOURCE CODE (XML DOCBOOK) MUST RETAIN THE ABOVE COPYRIGHT NOTICE, THIS LIST OF CONDITIONS AND THE FOLLOWING DISCLAIMER AS THE FIRST LINES OF THIS FILE UNMODIFIED. 2. REDISTRIBUTIONS IN COMPILED FORM (TRANSFORMED TO OTHER DTDS, CONVERTED TO PDF, POSTSCRIPT, RTF AND OTHER FORMATS) MUST REPRODUCE THE ABOVE COPYRIGHT NOTICE, THIS LIST OF CONDITIONS AND THE FOLLOWING DISCLAIMER IN THE DOCUMENTATION AND/OR OTHER MATERIALS PROVIDED WITH THE DISTRIBUTION.
    [Show full text]
  • An Overview of Security in the Freebsd Kernel 131 Dr
    AsiaBSDCon 2014 Proceedings March 13-16, 2014 Tokyo, Japan Copyright c 2014 BSD Research. All rights reserved. Unauthorized republication is prohibited. Published in Japan, March 2014 INDEX P1A: Bold, fast optimizing linker for BSD — Luba Tang P1B: Visualizing Unix: Graphing bhyve, ZFS and PF with Graphite 007 Michael Dexter P2A: LLVM in the FreeBSD Toolchain 013 David Chisnall P2B: NPF - progress and perspective 021 Mindaugas Rasiukevicius K1: OpenZFS: a Community of Open Source ZFS Developers 027 Matthew Ahrens K2: Bambi Meets Godzilla: They Elope 033 Eric Allman P3A: Snapshots, Replication, and Boot-Environments—How new ZFS utilities are changing FreeBSD & PC-BSD 045 Kris Moore P3B: Netmap as a core networking technology 055 Luigi Rizzo, Giuseppe Lettieri, and Michio Honda P4A: ZFS for the Masses: Management Tools Provided by the PC-BSD and FreeNAS Projects 065 Dru Lavigne P4B: OpenBGPD turns 10 years - Design, Implementation, Lessons learned 077 Henning Brauer P5A: Introduction to FreeNAS development 083 John Hixson P5B: VXLAN and Cloud-based networking with OpenBSD 091 Reyk Floeter INDEX P6A: Nested Paging in bhyve 097 Neel Natu and Peter Grehan P6B: Developing CPE Routers based on NetBSD: Fifteen Years of SEIL 107 Masanobu SAITOH and Hiroki SUENAGA P7A: Deploying FreeBSD systems with Foreman and mfsBSD 115 Martin Matuška P7B: Implementation and Modification for CPE Routers: Filter Rule Optimization, IPsec Interface and Ethernet Switch 119 Masanobu SAITOH and Hiroki SUENAGA K3: Modifying the FreeBSD kernel Netflix streaming servers — Scott Long K4: An Overview of Security in the FreeBSD Kernel 131 Dr. Marshall Kirk McKusick P8A: Transparent Superpages for FreeBSD on ARM 151 Zbigniew Bodek P8B: Carve your NetBSD 165 Pierre Pronchery and Guillaume Lasmayous P9A: How FreeBSD Boots: a soft-core MIPS perspective 179 Brooks Davis, Robert Norton, Jonathan Woodruff, and Robert N.
    [Show full text]
  • Managing Traffic with ALTQ
    THE ADVANCED COMPUTING SYSTEMS ASSOCIATION The following paper was originally published in the Proceedings of the FREENIX Track: 1999 USENIX Annual Technical Conference Monterey, California, USA, June 6–11, 1999 Managing Traffic with ALTQ Kenjiro Cho Sony Computer Science Laboratories, Inc., Tokyo © 1999 by The USENIX Association All Rights Reserved Rights to individual papers remain with the author or the author's employer. Permission is granted for noncommercial reproduction of the work for educational or research purposes. This copyright notice must be included in the reproduced paper. USENIX acknowledges all trademarks herein. For more information about the USENIX Association: Phone: 1 510 528 8649 FAX: 1 510 548 5738 Email: [email protected] WWW: http://www.usenix.org Managing Traffic with ALTQ Kenjiro Cho Sony Computer Science Laboratories, Inc. Tokyo, Japan 1410022 [email protected] Abstract Meters Traffic meters measure the properties of a traf- fic stream (e.g., bandwidth, packet counts). The ALTQ is a package for traffic management. ALTQ measured characteristics are stored as flow state and includes a queueing framework and several advanced used by other functions. queueing disciplines such as CBQ, RED, WFQ and RIO. ALTQ also supports RSVP and diffserv. ALTQ can be Markers Packet markers set a particular value to some configured in a variety of ways for both research and op- portion of the packet header. The written values eration. However, it requires understanding of the tech- could be a priority, congestion information, an ap- nologies to set up things correctly. In this paper, I sum- plication type, or other types of information.
    [Show full text]
  • The Click Modular Router
    The Click Modular Router EDDIE KOHLER, ROBERT MORRIS, BENJIE CHEN, JOHN JANNOTTI, and M. FRANS KAASHOEK Laboratory for Computer Science, MIT Click is a new software architecture for building flexible and configurable routers. A Click router is assembled from packet processing modules called elements. Individual elements implement sim- ple router functions like packet classification, queueing, scheduling, and interfacing with network devices. A router configuration is a directed graph with elements at the vertices; packets flow along the edges of the graph. Several features make individual elements more powerful and com- plex configurations easier to write, including pull connections, which model packet flow driven by transmitting hardware devices, and flow-based router context, which helps an element locate other interesting elements. Click configurations are modular and easy to extend. A standards-compliant Click IP router has sixteen elements on its forwarding path; some of its elements are also useful in Ethernet switches and IP tunneling configurations. Extending the IP router to support dropping policies, fairness among flows, or Differentiated Services simply requires adding a couple elements at the right place. On conventional PC hardware, the Click IP router achieves a maximum loss-free forwarding rate of 333,000 64-byte packets per second, demonstrating that Click's modular and flexible architecture is compatible with good performance. Categories and Subject Descriptors: C.2.1 [Computer-Communication Networks]: Network Architecture and Design|Packet-switching networks; C.2.6 [Computer-Communication Net- works]: Internetworking|Routers; D.2.11 [Software Engineering]: Software Architectures| Domain-specific architectures General Terms: Design, Management, Performance Additional Key Words and Phrases: Routers, component systems, software router performance An article describing a previous version of this system was published in Operating Systems Review 34(5) (Proceedings of the 17th Symposium on Operating Systems Principles), pp 217{231, December 1999.
    [Show full text]
  • Software Defined Networking with Openflow Switches & BCN
    International Journal of Recent Technology and Engineering (IJRTE) ISSN: 2277-3878, Volume-8 Issue-5, January 2020 SDNOFS: Software Defined Networking with OpenFlow Switches & BCN-ECN with ALTQ for Congestion Avoidance Vamshi Krishna Sabbi, Azad Shrivastava, Sunil J. Wagh, T. V. Prasad Abstract: High-performance computing cluster in a cloud that will enable to prevent congestion with primary environment. High-performance computing (HPC) helps advantages of centralized method provisioning, lower scientists and researchers to solve complex problems involving operation cost, guaranteed content delivery [1]. Recent SDN multiple computational capabilities. The main reason for using a studies show that single point of failure in typical networks message passing model is to promote application development, porting, and execution on the variety of parallel computers that is not able to meet the growing demand-based security can support the paradigm. Since congestion avoidance is critical issues of all components in the network, creating a complex for the efficient use of different applications, an efficient method structure that is difficult to manage. [2] That's right. the for congestion management in software-defined networks based generic Open Flow network comprises with three on Open Flow protocol has been presented. This paper proposed components: the Open Flow controller, the Open Flow two methods; initially, to avoid the congestion problem used by switch and the hosts. Each of the switches Hot spot traffic Software Defined Networks (SDN) with open flow switches, this method was originally defined as a communication protocol in patterns, network business, defective area routing and SDN environments which allows the SDN controller to interact frequency / voltage connection scaling (lower connection directly with the forwarding plane of network devices such as speed to save power) both can make a significant switches and routers, both physical and virtual (hypervisor- contribution to congestion.[3].
    [Show full text]
  • 1999 USENIX Annual Technical Conference
    CONFERENCE WEB SITE: http://www.usenix.org/events/usenix99/ May 3,1999. Pre-registration savings deadline 19991999 USENIXUSENIX AnnualAnnual TechnicalTechnical ConferenceConference JUNEJUNE 6–11,6–11, 1999 1999 MONTEREYMONTEREY CONFERENCECONFERENCE CENTERCENTER MONTEREY,MONTEREY, CALIFORNIA, CALIFORNIA, USA USA "USENIX has always been a great event offering high-quality sessions, broken up into tutorials, an exhibition and a technical conference, that tends to draw a very seriously technical crowd" Phil Hughes, Linux Journal TalkTalk toto youryour peerspeers andand leading-edgeleading-edge developers,sharedevelopers,share problemsproblems andand theirtheir solutions,andsolutions,and bringbring homehome ideas,techniquesideas,techniques andand technologiestechnologies you'llyou'll applyapply immediately.immediately. SponsoredSponsored byby TheThe USENIXUSENIX AssociationAssociation USENIX Conference Office Non-Profit 22672 Lambert Street, Suite 613 Organization Lake Forest, CA 92630 US Postage PAID Phone: 1.949.588.8649 USENIX Fax: 1.949.588.9706 Association Email: [email protected] Office hours: 8:30 am–5:00 pm Pacific Time Please pass the brochure along to a colleague! y er b egist .R 1999. ve ents/usenix99 a ay 3, v S M g/e 19991999 USENIXUSENIX .usenix.or www AAnnnnuauall TTeecchhnniiccaall CCoonnffeerreennccee JUNEJUNE 6–11,6–11, 19991999 MONTEREMONTEREYY CCONFERENCEONFERENCE CENTERCENTER MONTEREMONTEREYY,, CCALIFORNIA,ALIFORNIA, USAUSA A renowned conference by and for programmers,, developers,,and system administrators workinging inin adadvvanced systems and software.. Refereed papers track—at the heart of our reputation for cutting-edge technical excellence—this year’s highly current interest research reports cover resource management, file systems, virtual memory systems, security, Web server performance, storage systems, O/S performance, and more. The FREENIX track—top-quality technical presentations on the latest developments in the world of freely redistributable software, including the business side of developing open source software.
    [Show full text]
  • Certreq-BSDA-2012.Pdf
    BSDA Certification Requirements Document November 15, 2012 Version 1.1 Copyright © 2012 BSD Certification Group All Rights Reserved. All trademarks are owned by their respective companies. This work is protected by a Creative Commons License which requires Attribution and prevents Commercial and Derivative works. The human friendly version of the license can be viewed at http://creativecommons.org/licenses/by/3.0/ which also provides a hyperlink to the legal code. These conditions can only be waived by written permission from the BSD Certification Group. See the website for contact details. Cover design by Jenny Rosenberg BSDA Certification Requirements Document November 15, 2012 PREFACE Welcome! This document introduces the BSD Associate (BSDA) examination and describes in considerable detail the objectives covered by the exam. The exam covers material across all four major projects of BSD Unix - NetBSD, FreeBSD, OpenBSD and DragonFly BSD. While the testing candidate is expected to know concepts and practical details from all four main projects, it is not necessary to know all the details of each one. A thorough reading of this document is recommended to understand which concepts and practical details are expected to be mastered. Throughout this document, a clear distinction is placed on 'recognizing' and 'understanding', versus 'demonstrating' and 'performing'. Certain objectives call for the mere understanding of certain topics, while others call for the ability to demonstrate performance level knowledge of the topic. The difference is an important one, and should be remembered. Successful mastery of the BSDA examination will, in most cases, require study and practice. The requirements for the exam encompass more background in BSD than is common among casual users or those new to BSD.
    [Show full text]
  • Dfly Usenix2005 Bsd.Pdf
    WWW.DRAGONFLYBSD.ORG What Is DragonFly? ●Forked off of FreeBSD-4.x ~2 years ago. ●A ground-up reworking of traditional BSD programming models to achieve our goals. ●A new approach to SMP scaleability in the BSD world. ●Designing for long-term code maintainability and robustness. ●Designing for long-term forwards and backwards compatibility. ●Uber Goal is transparent, natively-supported, fully cache coherent single-system-image clustering, with all the trimmings. ●A parallel effort is being undertaken to improve userland. DragonFly Kernel Side Programming Methodologies ●A Threaded, cpu-localized approach to parallelism ●Very little differentiation between UP and SMP coding practices. ●Minimal UP vs SMP tradeoffs. ●Concept of natural ownership of data structures (either by a cpu or by a thread) for which no synchronization is necessary to access. ●Focus on greatly simplifying the programming model. ●But the best algorithms are not always quite that simple. ●Synchronous cross-cpu data access more expensive, but there are plenty of ways to remove the issue from the critical path and the APIs can be very simple. DragonFly User side system methodologies ●Target mainstream installs, assume that large scale customization will use a different installation and upgrade mechanism. ●Make a clear distinction between files owned by the installation, and files that can be adjusted by the system operator to simplify the upgrade regimen and reduce confusion. ●Ultimate goal is to provide production-level support by emphasizing forwards and backwards compatibility. ●Biggest single problem is the package management system. ●Second biggest problem is kernel data structure visibility in userland. ●Third biggest problem is kernel syscall compatibility over time.
    [Show full text]
  • Firewalling with Openbsd's PF Packet Filter
    Firewalling with OpenBSD’s PF packet filter Peter N. M. Hansteen [email protected] Copyright © 2005 - 2012 Peter N. M. Hansteen This document is © Copyright 2005 - 2012, Peter N. M. Hansteen. All rights reserved. Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. THIS DOCUMENTATION IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. The document is a ’work in progress’, based on a manuscript prepared for a lecture at the BLUG (see http://www.blug.linux.no/) meeting of January 27th, 2005. Along the way it has spawned several conference tutorials as well as The Book of PF (http://nostarch.com/pf2.htm) (second edition, No Starch Press November 2010), which expands on all topics mentioned in this document presents several topics that are only hinted at here.
    [Show full text]