Dynamic Hooks

Total Page:16

File Type:pdf, Size:1020Kb

Dynamic Hooks Dynamic Hooks: Hiding Control Flow Changes within Non-Control Data Sebastian Vogl, Technische Universität München; Robert Gawlik and Behrad Garmany, Ruhr-University Bochum; Thomas Kittel, Jonas Pfoh, and Claudia Eckert, Technische Universität München; Thorsten Holz, Ruhr-University Bochum https://www.usenix.org/conference/usenixsecurity14/technical-sessions/presentation/vogl This paper is included in the Proceedings of the 23rd USENIX Security Symposium. August 20–22, 2014 • San Diego, CA ISBN 978-1-931971-15-7 Open access to the Proceedings of the 23rd USENIX Security Symposium is sponsored by USENIX Dynamic Hooks: Hiding Control Flow Changes within Non-Control Data † † Sebastian Vogl∗, Robert Gawlik , Behrad Garmany , Thomas Kittel∗, † Jonas Pfoh∗, Claudia Eckert∗, Thorsten Holz ∗Technische Universität München †Horst Görtz Institute for IT-Security, Ruhr-University Bochum Abstract 1 Introduction Over the last decade, the sophistication and technical Generally speaking, malicious code leverages hooks level of malicious software (malware) has increased dra- within a system to divert the control flow. Without them, matically. In the early 2000s, we saw malware such as an attacker is blind to the events occurring in the sys- the I Love You [29] and Blaster worms [3] that gener- tem, rendering her unable to perform malicious activities ally operated in user space with very little in the way (e.g., hiding of files or capturing of keystrokes). How- of defensive mechanisms. In contrast, we nowadays see ever, while hooks are an integral part of modern attacks, complex kernel level malware such as Stuxnet, Duqu, and they are at the same time one of their biggest weaknesses: Flame [6] that show an increase in sophistication in the Even the most sophisticated attack can be easily identi- target of their attack, the exploitation methods used to fied if one of its hooks is found. In spite of this fact, deliver them, and their ability to evade detection. By tar- hooking mechanisms have remained almost unchanged geting kernel space, modern malware effectively runs at over the last years and still rely on the persistent mod- the same privilege level as the operating system (OS), ification of code or control data to divert the control enabling it to attack and modify any part of the system flow. As a consequence, hooks represent an abnormal- including the kernel itself. In addition, malware can take ity within the system that is permanently evident and can advantage of stealth techniques that were originally only in many cases easily be detected as the hook detection used by kernel rootkits to hide itself deep within the sys- mechanisms of recent years amply demonstrated. tem. This makes the detection of malware increasingly In this paper, we propose a novel hooking concept that difficult, especially as malware continues to evolve, en- we refer to as dynamic hooking. Instead of modifying abling it to stay one step ahead of the defenders. Cur- persistent control data permanently, this hooking mech- rently, one the most sophisticated methods employed is anisms targets transient control data such as return ad- data-only malware [16,41]. dresses at run-time. The hook itself will thereby reside However, even very sophisticated malware such as within non-control data and remains hidden until it is data-only malware has an Achilles’ heel: in general, mal- triggered. As a result, there is no evident connection be- ware needs to intercept events within the system to be tween the hook and the actual control flow change, which able to fulfill its purpose [27, 44]. Without this capabil- enables dynamic hooks to successfully evade existing de- ity, malware would be unable to react to events or pro- tection mechanisms. To realize this idea, dynamic hooks vide fundamental functionality such as key logging and make use of exploitation techniques to trigger vulner- file hiding, which would severely limit its possibilities. abilities at run-time. Due to this approach, dynamic Event interception, however, requires malware to divert hooks cannot only be used to arbitrarily modify the con- the control flow of the infected system at run-time. To trol flow, but can also be applied to conduct non-control achieve this, malware must install hooks in the system data attacks, which makes them more powerful than their that facilitate the required control flow transfer on be- predecessors. We implemented a prototype that makes half of the malware whenever the desired event occurs. uses of static program slicing and symbolic execution to While malware might manage to hide itself, these hooks automatically extract paths for dynamic hooks that can represent an abnormality that will be permanently visible then be used by a human expert for their realization. To within the system and thus lends itself well to becoming demonstrate this, we used the output provided by our the basis of detection mechanisms. This insight led to prototype to implement concrete examples of dynamic a wide range of research that enable the monitoring of hooks for both modern Linux and Windows kernels. malware hooking behavior for the purpose of signature USENIX Association 23rd USENIX Security Symposium 813 generation [47] or detecting malware based on control thereby provides detailed information about each jump flow modifications [15, 20, 43]. condition in the path and the actual vulnerability in an Although existing systems are not yet able to de- intuitive format, which makes the output suitable for ex- tect all hooks that are placed by malware, the remain- ploit generation frameworks or a human expert. We used ing possibilities for malware to install hooks are con- this prototype to automatically identify dynamic hooks stantly dwindling. Hooks that are based on code mod- for recent Linux and Windows kernels. Additionally, ifications are usually no longer an option, since changes we implemented proof of concepts (POCs) of dynamic to code areas can be easily detected due to their static na- hooks that demonstrate how they can be used in prac- ture. This leaves attackers only with the option of data tice to intercept events such as system calls or to imple- hooks [43,47], but even here the options are increasingly ment backdoors. This proves that the suggested hooking restricted by modern detection mechanisms. The reason mechanism is not only powerful, but also realistic. for this development is that, in contrast to malware where In summary, we make the following contributions: one can observe a constant evolution of techniques and mechanisms used, hooking techniques have not signifi- We present a novel hooking concept called dynamic • cantly changed over the course of recent years. hooking that targets transient control data at run- In this paper, we present a novel hooking concept that time instead of persistent control-data. This ap- we refer to as dynamic hooking. In contrast to existing proach bypasses existing hook detection techniques hooking mechanisms which persistently modify control proposed in the last few years. data, our hooking approach targets transient control data We show how dynamic hooks for OS kernels can be such as return addresses at run-time. As a consequence, • the resulting control flow change that is introduced by automatically found by leveraging binary analysis the hook only becomes visible when the hook is actu- techniques and implemented a prototype. ally triggered. This significantly complicates the detec- We provide detailed POC implementations of dy- • tion of dynamic hooks as security mechanisms can no namic hooks for both Linux and Windows kernels longer focus on persistent control data, but must also that demonstrate their capabilities and possibilities. take transient control data into account. What is even more, the hook itself will thereby reside in non-control data, which is much more difficult to analyze and ver- 2 Technical Background ify [4,15] when compared to control data that traditional hooks target. Despite the fact that dynamic hooks reside Before presenting our approach to realize dynamic purely in non-control data, they are able to reliably inter- hooks, we first review background information that is cept the execution flow of functions similar to traditional essential for the understanding of the remainder of the hooks. Furthermore, they can be used in pure data-only paper. We begin by defining important terms and then attacks, which are by themselves a realistic and danger- discuss why malware in general requires hooks within ous threat [3, 5]. Thus they are not only harder to detect, the system to function. Finally, we cover existing hook- but also more powerful than their predecessors. ing mechanisms and their countermeasures. To provide these capabilities, dynamic hooks modify data in such a way that they will trigger vulnerabilities at 2.1 Definitions run-time. Through this approach, they are able to arbi- trarily modify the control flow, while the hook itself only We first introduce important terms that we will use consists of the data that triggers and exploits the vulner- throughout the paper. In particular, we highlight the dif- ability. This makes them quite similar to traditional ex- ferences between control data and non-control data as ploitation techniques with the exception that they target well as transient and permanent control data. applications that are already controlled by the attacker. Due to this fact, the attack surface for dynamic hooks is Control data and non-control data. Control data much broader compared to traditional exploitation, since specifies the target location of a branch instruction. By an attacker can not only attack external functions, but changing control data, an attacker can arbitrarily change also internal functions. the control flow of an application. Examples of control Furthermore, dynamic hooks can be obtained automat- data are return addresses and function pointers. ically in a manner comparable to automated exploit gen- In contrast, non-control data never contains the target eration [2].
Recommended publications
  • Advance Dynamic Malware Analysis Using Api Hooking
    www.ijecs.in International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume – 5 Issue -03 March, 2016 Page No. 16038-16040 Advance Dynamic Malware Analysis Using Api Hooking Ajay Kumar , Shubham Goyal Department of computer science Shivaji College, University of Delhi, Delhi, India [email protected] [email protected] Abstract— As in real world, in virtual world also there are type of Analysis is ineffective against many sophisticated people who want to take advantage of you by exploiting you software. Advanced static analysis consists of reverse- whether it would be your money, your status or your personal engineering the malware’s internals by loading the executable information etc. MALWARE helps these people into a disassembler and looking at the program instructions in accomplishing their goals. The security of modern computer order to discover what the program does. Advanced static systems depends on the ability by the users to keep software, analysis tells you exactly what the program does. OS and antivirus products up-to-date. To protect legitimate users from these threats, I made a tool B. Dynamic Malware Analysis (ADVANCE DYNAMIC MALWARE ANAYSIS USING API This is done by watching and monitoring the behavior of the HOOKING) that will inform you about every task that malware while running on the host. Virtual machines and software (malware) is doing over your machine at run-time Sandboxes are extensively used for this type of analysis. The Index Terms— API Hooking, Hooking, DLL injection, Detour malware is debugged while running using a debugger to watch the behavior of the malware step by step while its instructions are being processed by the processor and their live effects on I.
    [Show full text]
  • Userland Hooking in Windows
    Your texte here …. Userland Hooking in Windows 03 August 2011 Brian MARIANI SeniorORIGINAL Security SWISS ETHICAL Consultant HACKING ©2011 High-Tech Bridge SA – www.htbridge.ch SOME IMPORTANT POINTS Your texte here …. This document is the first of a series of five articles relating to the art of hooking. As a test environment we will use an english Windows Seven SP1 operating system distribution. ORIGINAL SWISS ETHICAL HACKING ©2011 High-Tech Bridge SA – www.htbridge.ch WHAT IS HOOKING? Your texte here …. In the sphere of computer security, the term hooking enclose a range of different techniques. These methods are used to alter the behavior of an operating system by intercepting function calls, messages or events passed between software components. A piece of code that handles intercepted function calls, is called a hook. ORIGINAL SWISS ETHICAL HACKING ©2011 High-Tech Bridge SA – www.htbridge.ch THE WHITE SIDE OF HOOKING TECHNIQUES? YourThe texte control here …. of an Application programming interface (API) call is very useful and enables programmers to track invisible actions that occur during the applications calls. It contributes to comprehensive validation of parameters. Reports issues that frequently remain unnoticed. API hooking has merited a reputation for being one of the most widespread debugging techniques. Hooking is also quite advantageous technique for interpreting poorly documented APIs. ORIGINAL SWISS ETHICAL HACKING ©2011 High-Tech Bridge SA – www.htbridge.ch THE BLACK SIDE OF HOOKING TECHNIQUES? YourHooking texte here can …. alter the normal code execution of Windows APIs by injecting hooks. This technique is often used to change the behavior of well known Windows APIs.
    [Show full text]
  • Contents in This Issue
    APRIL 2006 The International Publication on Computer Virus Prevention, Recognition and Removal CONTENTS IN THIS ISSUE 2 COMMENT LEAP YEAR Problems for AV vendors: some thoughts Although the hype surrounding OSX/Leap-A far outweighs the number of reported infections, the 3 NEWS virus does present a number of new ideas that we may well see again. Glyn Kennington investigates. More updating woes page 4 Spy couple sentenced ‘Real’ computer virus MR AND MRS ROOTKIT Viewers of the German version of the Mr. and Mrs. Smith movie DVD were surprised to find a little 3 VIRUS PREVALENCE TABLE more than they had bargained for on their DVDs thanks to the presence of a new protection system. VIRUS ANALYSES The protection software was found to be using 4 A small step for Mac OS X rootkit-like techniques to hide itself. Elia Florio discusses the security issues associated with the 6 Not a feeble attempt Settec DRM case. page 10 10 FEATURE LINUX COMPARATIVE Stories from the DRM world: the Settec case The main competition amongst products this month seemed to be to determine 13 COMPARATIVE REVIEW which could have the least useful Red Hat Linux 9 documentation – find out which products redeemed themselves by achieving a VB 100%. page 13 20 END NOTES & NEWS This month: anti-spam news & events and Sorin Mustaca takes an indepth look at PayPal phishing. ISSN 1749-7027 COMMENT ‘I see drowning in • Analysing proactive technologies, including heuristics and behaviour blockers so as to penetrate new malware as systems despite these barriers. one of the main • Interfering with anti-virus solutions, for instance, by issues facing the blocking automatic updates.
    [Show full text]
  • A Brief Survey on Rootkit Techniques in Malicious Codes
    A Brief Survey on Rootkit Techniques in Malicious Codes Sungkwan Kim, Junyoung Park, Kyungroul Lee Ilsun You Soonchunhyang University Korean Bible University Shinchang-myun, Asan-si, Republic of Korea Seoul, Republic of Korea fcarpedm, wwkim3, [email protected] [email protected] Kangbin Yim∗ Soonchunhyang University Shinchang-myun, Asan-si, Republic of Korea [email protected] Abstract Nowadays, malicious codes are significantly increasing, leading to serious damages to information systems. It is worth to note that these codes generally depend on the rootkit techniques to make it more difficult for themselves to be analyzed and detected. Therefore, it is of paramount importance to research the rootkits to effectively defend against malicious codes. In this paper, we explore and survey the rootkit techniques both in user-level and kernel-level. Several rootkit samples are also utilized for the test and verification purpose. Keywords: rootkit, malicious codes, keyboard security 1 Introduction The superlative invention of the Internet in the 20th century has generated innovative developments in the computer industry. While internet speed is increasing, adverse effects are also increasing. A com- puter virus, which would have taken a long time to propagate in former days, can now spread throughout the world currently in a few seconds or minutes. In the past, the spreading technology was very simple and the path was limited, thus enabling an account technician sufficient time to protect against the virus. However, malicious codes have been intelligently armed with self-deformation and concealment, cre- ating many problems such as Distributed Denial of Services Attacks (DDoS), SPAM, and hijacking of personal information[2].
    [Show full text]
  • Captain Hook: Pirating AVS to Bypass Exploit Mitigations WHO?
    Captain Hook: Pirating AVS to Bypass Exploit Mitigations WHO? Udi Yavo . CTO and Co-Founder, enSilo . Former CTO, Rafael Cyber Security Division . Researcher . Author on BreakingMalware Tomer Bitton . VP Research and Co-Founder, enSilo . Low Level Researcher, Rafael Advanced Defense Systems . Malware Researcher . Author on BreakingMalware AGENDA . Hooking In a Nutshell . Scope of Research . Inline Hooking – Under the hood - 32-bit function hooking - 64-bit function hooking . Hooking Engine Injection Techniques . The 6 Security Issues of Hooking . Demo – Bypassing exploit mitigations . 3rd Party Hooking Engines . Affected Products . Research Tools . Summary HOOKING IN A NUTSHELL . Hooking is used to intercept function calls in order to alter or augment their behavior . Used in most endpoint security products: • Anti-Exploitation – EMET, Palo-Alto Traps, … • Anti-Virus – Almost all of them • Personal Firewalls – Comodo, Zone-Alarm,… • … . Also used in non-security products for various purposes: • Application Performance Monitoring (APM) • Application Virtualization (Microsoft App-V) . Used in Malware: • Man-In-The-Browser (MITB) SCOPE OF RESEARCH . Our research encompassed about a dozen security products . Focused on user-mode inline hooks – The most common hooking method in real-life products . Hooks are commonly set by an injected DLL. We’ll refer to this DLL as the “Hooking Engine” . Kernel-To-User DLL injection techniques • Used by most vendors to inject their hooking engine • Complex and leads security issues Inline Hooking INLINE HOOKING – 32-BIT FUNCTION HOOKING Straight forward most of the time: Patch the Disassemble Allocate Copy Prolog Prolog with a Prolog Code Stub Instructions JMP INLINE HOOKING – 32-BIT FUNCTION HOOKING InternetConnectW before the hook is set: InternetConnectW After the hook is set: INLINE HOOKING – 32-BIT FUNCTION HOOKING The hooking function (0x178940) The Copied Instructions Original Function Code INLINE HOOKING – 32-BIT FUNCTION HOOKING .
    [Show full text]
  • Towards a General Defense Against Kernel Queue Hooking Attacks
    Towards a General Defense against Kernel Queue Hooking Attacks Jinpeng Wei 1 and Calton Pu 2 1Florida International University, 11200 SW 8th Street, Miami, FL, 33199 USA, [email protected] 2Georgia Institute of Technology, 266 Ferst Dr, Atlanta, GA 30332 USA, [email protected] Abstract Kernel queue hooking (KQH) attacks achieve stealthy malicious function execution by embedding malicious hooks in dynamic kernel schedulable queues (K-Queues). Because they keep kernel code and persistent hooks intact, they can evade detection of state-of-the-art kernel integrity monitors. Moreover, they have been used by advanced malware such as the Rustock spam bot to achieve malicious goals. In this paper, we present a systematic defense against such novel attacks. We propose the Precise Lookahead Checking of function Pointers approach that checks the legitimacy of pending K-Queue callback requests by proactively checking function pointers that may be invoked by the callback function. To facilitate the derivation of specifications for any K-Queue, we build a unified static analysis framework and a toolset that can derive from kernel source code properties of legitimate K-Queue requests and turn them into source code for the runtime checker. We implement proof-of-concept runtime checkers for four K-Queues in Linux and perform a comprehensive experimental evaluation of these checkers, which shows that our defense is effective against KQH attacks. Keywords : control flow integrity; kernel queue hooking; rootkits; runtime defense; static analysis 1 Introduction Rootkits have become one of the most dangerous threats to systems security. Because they run at the same privilege level as the operating systems kernel, they can modify the OS behavior 1 in arbitrary ways.
    [Show full text]
  • Evasive Internet Protocol: End to End Performance
    EVASIVE INTERNET PROTOCOL: END TO END PERFORMANCE By Maaz Khan Submitted in partial fulfillment of the requirements for the Degree of Master of Science Thesis Advisor: Prof. Michael Rabinovich Department of Electrical Engineering and Computer Science CASE WESTERN RESERVE UNIVERSITY August 2011 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the thesis/dissertation of Maaz Khan ______________________________________________________ Masters candidate for the ________________________________degree *. Michael Rabinovich (signed)_______________________________________________ (chair of the committee) Mehmet Koyuturk ________________________________________________ Vincenzo Liberatore ________________________________________________ ________________________________________________ ________________________________________________ ________________________________________________ 06/09/2011 (date) _______________________ *We also certify that written approval has been obtained for any proprietary material contained therein. Contents Contents i List of Figures iii Abstract iv Chapter 1 Introduction 1 1.1 Basic Approach . 2 1.2 Security and feasibility . 3 Chapter 2 Architecture 6 2.1 Delegation of Authority . 6 2.2 T-Address . .8 2.3 Datagrams . 9 2.4 Obtaining a Destination T-address. 13 Chapter 3 Packet Modification using Netfilter Framework 15 3.1 The Packet Buffer . 15 3.1.1 SKB basic management functiuons . 18 3.2 The Netfilter API . .20 i 3.2.1 Netfilter Hooks . .21 3.2.2 Registering and Unregistering hook functions . .23 Chapter 4 Implementation 27 4.1 Components . 28 4.2 Changing the MSS . 31 Chapter 5 Performance 33 5.1 Experiment Setup . 33 5.2 TCP v/s EIP Performance . ..35 5.3 UDP v/s EIP Performance . .39 Chapter 6 Conclusion 43 References 44 ii List of Figures 1. T-Address . .. .. .. .. 9 2. Type-1 Datagram . .. .. .. 11 3. Type-2 Datagram . 11 4.
    [Show full text]
  • Countering Kernel Rootkits with Lightweight Hook Protection
    Countering Kernel Rootkits with Lightweight Hook Protection ZhiWang XuxianJiang WeidongCui PengNing NC State University NC State University Microsoft Research NC State University [email protected] [email protected] [email protected] [email protected] ABSTRACT stealing private information, escalating privileges of malicious pro- Kernel rootkits have posed serious security threats due to their stealthy cesses, and disabling defense mechanisms. manner. To hide their presence and activities, many rootkits hi- Given the serious security threats, there has been a long line of jack control flows by modifying control data or hooks in the kernel research on rootkit defense. Specifically, prior research efforts can space. A critical step towards eliminating rootkits is to protect such be roughly classified into three categories. In the first category, hooks from being hijacked. However, it remains a challenge be- systems such as Panorama [33], HookFinder [32], K-Tracer [15], cause there exist a large number of widely-scattered kernel hooks and PoKeR [24] focus on analyzing rootkit behaviors. Systems and many of them could be dynamically allocated from kernel heap in the second category are primarily designed for detecting rootk- and co-located together with other kernel data. In addition, there is its based on certain symptoms exhibited by rootkit infection. Ex- a lack of flexible commodity hardware support, leading to the so- amples are Copilot [20], SBCFI [21], and VMwatcher [13]. In called protection granularity gap – kernel hook protection requires the third category, systems such as SecVisor [26], Patagonix [16], byte-level granularity but commodity hardware only provides page- and NICKLE [23] have been developed to preserve kernel code level protection.
    [Show full text]
  • Subverting Operating System Properties Through Evolutionary DKOM Attacks
    Subverting Operating System Properties through Evolutionary DKOM Attacks Mariano Graziano1;3, Lorenzo Flore2, Andrea Lanzi2, and Davide Balzarotti1 1 Eurecom 2 Universit`adegli Studi di Milano 3 Cisco Systems, Inc. Abstract Modern rootkits have moved their focus on the exploitation of dynamic memory struc- tures, which allows them to tamper with the behavior of the system without modifying or injecting any additional code. In this paper we discuss a new class of Direct Kernel Object Manipulation (DKOM) attacks that we call Evolutionary DKOM (E-DKOM). The goal of this attack is to alter the way some data structures \evolve" over time. As case study, we designed and im- plemented an instance of Evolutionary DKOM attack that targets the OS scheduler for both userspace programs and kernel threads. Moreover, we discuss the implementation of a hypervisor-based data protection system that mimics the behavior of an OS com- ponent (in our case the scheduling system) and detect any unauthorized modification. We finally discuss the challenges related to the design of a general detection system for this class of attacks. 1 Introduction Rootkits are a particular type of malicious software designed to maintain a hidden access to a compromised machine by targeting the running kernel. To mitigate this severe threat, several defense techniques for code protection and attestation have been proposed in the literature [27, 37, 39, 46]. These mechanisms try to protect the appli- cations and the kernel code against any illicit modification of its instructions. This also prevents hooking techniques that attempt to divert the control flow to a routine controlled by the attacker.
    [Show full text]
  • 2019 Mid-Market Threat and Incident Response Report
    TM Infocyte Mid-Market Threat and Incident Response Report (Q2, 2019) 2019 Mid-market Threat and Incident Response Report infocyte.com 1 TM Infocyte Mid-Market Threat and Incident Response Report (Q2, 2019) Q2 2019 Mid-market Threat and Incident Response Report by Chris Gerritz, Co-founder and Chief Product Officer, Infocyte Executive Summary In the 90-day span from April to June 2019, Infocyte’s SaaS threat detection and incident response platform, Infocyte HUNT1, has performed over 550,000 forensic inspections on systems across hundreds of customer networks within the mid-enterprise business sector. These inspections were divided between partner-led investigations, proactive compromise assessments, and continuous use by Infocyte subscribed customers. As part of these inspections, we performed analysis on over 12.4 million unique files and 44,800 fileless in-memory injections found in whitelisted/approved applications. We reviewed 339,000+ accounts and associated behavioral logs for malicious activity, and evaluated 161,000+ unique applications for possible threats and vulnerabilities. This report is a summary of our findings from customers and partners. It includes what we have learned about the threats and our recommendations on what companies can do to lower their risk of being affected by these and other security threats. The findings and recommendations in this report are significant for companies in the mid-market range having between 99 and 5,000 employees and up to $1 billion in annual revenue. Most industry reports of this nature – such as the annual Verizon Data 1: Infocyte HUNT is an independent, Breach Incident Report and the FireEye Mandiant M-Trends report cloud-deployable proactive security and – are focused on the large enterprise, consisting of companies incident response platform that helps that typically have far larger security budgets, larger teams and organizations detect and respond to threats and vulnerabilities hiding within more tools and resources compared to mid-market companies.
    [Show full text]
  • Chapter 19 Windows Rootkits a Game Of
    CHAPTER 19 WINDOWS ROOTKITS A GAME OF “HIDE AND SEEK” Sherri Sparks, Shawn Embleton, and Cliff Zou School of Electrical Engineering and Computer Science, University of Central Florida, Orlando, FL 32816, USA E-mail: {ssparks, sembleton, czou}@cs.ucf.edu Rootkits are a type of malware that attempt to hide their presence on a system, typically by compromising the communication conduit between an Operating System and its users. In this chapter, we track the evolution of rootkits and the techniques used to defend against them from the earliest rootkits to highly advanced, present day rootkits capable of exploiting processor virtualization extensions and infecting the BIOS. 1. Introduction Despite all of the popular press surrounding malicious code like viruses and worms, until the past few years rootkits had remained a relatively hidden threat. If one were asked to classify viruses and worms by a single defining characteristic, the first word to come to mind would probably be replication. In contrast, the single defining characteristic of a rootkit is stealth. Viruses reproduce, but rootkits hide. They hide by compromising the communication conduit between an Operating System and its users. A rootkit can be defined as “a set of programs which patch and trojan existing execution paths within the system”.1 Before delving into the low-level technical details, it is helpful to view the problem at a higher level of abstraction. Most modern Operating Systems are based upon the concept of a layered architecture. A layered architecture attempts to divide a computer system into hierarchal groups of related components that communicate according to predefined sets of rules, or interfaces.2 At the highest level of abstraction, we can divide a system into three layers: users, Operating System (OS), and hardware.
    [Show full text]
  • Pywall: a Python Firewall by the Pywall Team Stephen Brennan, Jeffrey Copeland, Yigit Kucuk, Andrew Mason
    PyWall: A Python Firewall By the PyWall Team Stephen Brennan, Jeffrey Copeland, Yigit Kucuk, Andrew Mason Background Firewalls Firewalls permit or deny network traffic based on a configurable set of criteria. Typical filtering rules include source/destination IP address, protocol, and source/destination port. Modern firewalls include stateful rules that consider a sequence of interactions over time instead of individual packets, allowing firewalls to implement features like TCP connection tracking and port knocking. Because of their simplicity and subsequent speed, firewalls often serve as a first line of defense against network­based attacks. Understanding the underlying mechanisms of a firewall is important if one is interested in computer security. Because implementing a system is the best way to understand its underpinnings. we have implemented a firewall using Python and some Netfilter tools. Before going into the details of our implementation, we should give some background on TCP, the Netfilter project, python­netfilterqueue, and IPTables. ​ ​ TCP (Transmission Control Protocol) TCP, along with UDP, is responsible for nearly all traffic at the transport layer of the internet. TCP in particular is worth noting for two reasons. First, it is overwhelmingly the most popular transport layer protocol, accounting for 82% of traffic and 91% of bytes transmitted on the Web according to a 2013 study. [3] As a result, having a firewall that can filter on TCP packets is of the utmost importance. Second, TCP is connection­based, and therefore a stateful protocol. This adds a level of complexity to implementing anything more than simple port filters which will be discussed later in the paper.
    [Show full text]