Digital Forensics: a Demonstration of the Effectiveness of the Sleuth Kit and Autopsy Forensic Browser

Total Page:16

File Type:pdf, Size:1020Kb

Digital Forensics: a Demonstration of the Effectiveness of the Sleuth Kit and Autopsy Forensic Browser Digital Forensics: A Demonstration of the Effectiveness of The Sleuth Kit and Autopsy Forensic Browser Anthony Dowling A thesis submitted for the degree of Master of Science (Information Science) at the University of Otago, Dunedin, New Zealand Date: May 14, 2006 ii Abstract The Sleuth Kit is a collection of Linux tools that perform different aspects of a file system analysis. The Autopsy Forensic Browser is a graphical user interface that provides a user friendly interface to the command line tools contained within The Sleuth Kit. This research project investigates the use of The Sleuth Kit and Autopsy Forensic Browser as forensic investigation tools, with the aim of demonstrating the effectiveness of these tools in real world case studies as digital forensic tools. The research found that The Sleuth Kit and Autopsy Forensic Browser provide an effective file system analysis toolset. The flexibility of the tools contained within The Sleuth Kit often lead to complex command line strings, the complexity of which is overcome by the automation provided by the Autopsy Forensic Browser. Not only do The Sleuth Kit and Autopsy Forensic browser provide an effective toolset, they also offer an affordable alternative to expensive commercial or proprietary based toolsets. Digital Forensics is an area of increasing importance with an expanding field of coverage requiring many different tools to help perform varying functions. It is with this in mind that the focus of this research project is three case studies that are utilised to demonstrate the effectiveness of The Sleuth Kit and Autopsy Forensic Browser. The demonstration of The Sleuth Kit and Autopsy Forensic Browser contained within the case studies could serve as an introductory overview of a new toolset for investigators looking for an alternative or complementary Digital Forensics toolset. iii iv Preface The author would like to thank the following persons and institutions for the help and support they have given prior and during the writing of this thesis. • Kevin and Yvonne Dowling, for proof reading the thesis and giving helpful advice. • David Welch and Scott Williamson, for providing ideas and direction when trouble arose with the thesis process. • Brian Carrier, author of The Sleuth Kit and Autopsy Forensic Browser, whom was quick to respond to all queries regarding the toolset. • All the contributors to The Sleuth Kit Developer and User forums, whom were always quick to provide feedback and answers to any questions. v vi Table of Contents Abstract....................................................................................................................... iii Preface...........................................................................................................................v Table of Contents .......................................................................................................vii List of Tables ..............................................................................................................xv List of Figures............................................................................................................xxi Chapter 1 Introduction................................................................................................1 1.1 Research Objective ..............................................................................................3 1.2 Structure of Thesis ...............................................................................................4 Chapter 2 Digital Forensics: An Overview................................................................7 2.1 Digital Forensics Defined ....................................................................................7 2.2 Uses for Digital Forensics....................................................................................9 2.3 Examples of Digital Forensics in Action...........................................................11 2.3.1.1 Dr Colin Bouwer Case.........................................................................11 2.3.1.2 Paedophile Case...................................................................................11 2.3.1.3 Operation Troy Case............................................................................12 2.4 Summary............................................................................................................13 Chapter 3 Volatility of Information .........................................................................15 3.1 Order of Volatility..............................................................................................16 3.1.1 Registers......................................................................................................16 3.1.2 Main Memory .............................................................................................16 3.1.3 Network State..............................................................................................17 3.1.4 Running Processes ......................................................................................18 3.1.5 Hard Disk....................................................................................................18 vii 3.1.6 Removable Media .......................................................................................19 3.1.7 Paper Printouts............................................................................................19 3.2 Persistence of Data.............................................................................................20 3.2.1 Positive aspects for recovery of deleted information..................................21 3.2.2 Negative aspects for recovery of deleted information ................................22 3.2.3 Influential factors on longevity of deleted information ..............................22 3.3 Problems involved with collection and examination of evidence .....................24 3.3.1 Problems involved with collection and examination of volatile information ..............................................................................................................................24 3.3.2 General Problems involved with collection and examination of evidence.26 3.4 Live versus Dead Analysis.................................................................................28 3.5 Summary............................................................................................................30 Chapter 4 Hard Disk based Information.................................................................33 4.1 Introduction........................................................................................................33 4.1.1 Data Organisation .......................................................................................33 4.2 Volume Analysis................................................................................................36 4.2.1 General Theory of Partitions.......................................................................36 4.2.2 Usage of Volumes in UNIX and Microsoft Windows................................37 4.2.3 Sector Addressing .......................................................................................38 4.2.4 Analysis Basics ...........................................................................................39 4.2.4.1 Analysis Techniques ............................................................................39 4.2.4.2 Consistency Checks .............................................................................39 4.2.4.3 Extracting the Partition Contents.........................................................40 4.2.4.4 Recovering Deleted Partitions .............................................................41 4.3 DOS Partitions ...................................................................................................42 4.3.1 General Overview .......................................................................................42 4.3.1.1 Basic MBR Concepts...........................................................................42 4.3.1.2 Extended Partition Concepts................................................................44 4.3.1.3 Putting the concepts together...............................................................46 4.3.1.4 Boot Code ............................................................................................48 4.3.2 Data Structures............................................................................................48 4.3.2.1 MBR Data Structure ............................................................................48 4.3.2.2 Extended Partition Data Structures......................................................50 viii 4.3.3 Analysis Considerations..............................................................................51 4.4 File System Analysis..........................................................................................52 4.4.1 Important Issues..........................................................................................52 4.4.1.1 Clusters ................................................................................................52 4.4.1.2 Encrypted Files ....................................................................................52 4.4.1.3 Allocation Strategies............................................................................53 4.4.1.4 Wiping Techniques ..............................................................................54 4.4.1.5 Slack Space ..........................................................................................55
Recommended publications
  • Guidelines on Mobile Device Forensics
    NIST Special Publication 800-101 Revision 1 Guidelines on Mobile Device Forensics Rick Ayers Sam Brothers Wayne Jansen http://dx.doi.org/10.6028/NIST.SP.800-101r1 NIST Special Publication 800-101 Revision 1 Guidelines on Mobile Device Forensics Rick Ayers Software and Systems Division Information Technology Laboratory Sam Brothers U.S. Customs and Border Protection Department of Homeland Security Springfield, VA Wayne Jansen Booz Allen Hamilton McLean, VA http://dx.doi.org/10.6028/NIST.SP. 800-101r1 May 2014 U.S. Department of Commerce Penny Pritzker, Secretary National Institute of Standards and Technology Patrick D. Gallagher, Under Secretary of Commerce for Standards and Technology and Director Authority This publication has been developed by NIST in accordance with its statutory responsibilities under the Federal Information Security Management Act of 2002 (FISMA), 44 U.S.C. § 3541 et seq., Public Law (P.L.) 107-347. NIST is responsible for developing information security standards and guidelines, including minimum requirements for Federal information systems, but such standards and guidelines shall not apply to national security systems without the express approval of appropriate Federal officials exercising policy authority over such systems. This guideline is consistent with the requirements of the Office of Management and Budget (OMB) Circular A-130, Section 8b(3), Securing Agency Information Systems, as analyzed in Circular A- 130, Appendix IV: Analysis of Key Sections. Supplemental information is provided in Circular A- 130, Appendix III, Security of Federal Automated Information Resources. Nothing in this publication should be taken to contradict the standards and guidelines made mandatory and binding on Federal agencies by the Secretary of Commerce under statutory authority.
    [Show full text]
  • A Usability Analysis of the Autopsy Forensic Browser
    Proceedings of the Second International Symposium on Human Aspects of Information Security & Assurance (HAISA 2008) A Usability Analysis of the Autopsy Forensic Browser D.J. Bennett and P. Stephens Department of Computing (Academic), Canterbury Christ Church University, Canterbury, United Kingdom e-mail: {david.bennett, paul.stephens}@canterbury.ac.uk Abstract This paper reviews the usability of the Autopsy Forensic Browser. Two expert-based usability review techniques are used: Cognitive Walkthrough and Heuristic Evaluation. The results of the evaluation indicate that there are many areas where usability could be improved and these are classified into areas of eight overlapping areas. Examples from each area are presented, with suggestions as to methods to alleviate them. The paper concludes with a future work proposal to effect the changes suggested and retest the current and the replacement system with a user-based evaluation. Keywords Usability, Human-Computer Interaction, Interface Design, Autopsy Forensic Browser, The Sleuth Kit, Cognitive Walkthrough, Heuristic Evaluation 1. Introduction This paper reviews the usability of the Autopsy Forensic Browser tool. The reasoning for this is to improve future versions of the tool. In many ways forensic analysis tools are no different to any other mission critical software in terms of the need for usability. However, failure in usability in such tools could lead to outcomes which deny liberty to innocent persons, or enable criminals to continue with criminal activity should an investigation fail in some way. 1.1. Forensics and the Autopsy Forensic Browser Gottschalk et al. (2005) define computer forensics as the identification, preservation, investigation, and documentation of computer systems data used in criminal activity.
    [Show full text]
  • Forensic Toolkit (FTK)
    Forensic Toolkit (FTK) User Guide | 1 AccessData Legal and Contact Information Document date: January 31, 2018 Legal Information ©2018 AccessData Group, Inc. All rights reserved. No part of this publication may be reproduced, photocopied, stored on a retrieval system, or transmitted without the express written consent of the publisher. AccessData Group, Inc. makes no representations or warranties with respect to the contents or use of this documentation, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. Further, AccessData Group, Inc. reserves the right to revise this publication and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. Further, AccessData Group, Inc. makes no representations or warranties with respect to any software, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. Further, AccessData Group, Inc. reserves the right to make changes to any and all parts of AccessData software, at any time, without any obligation to notify any person or entity of such changes. You may not export or re-export this product in violation of any applicable laws or regulations including, without limitation, U.S. export regulations or the laws of the country in which you reside. AccessData Group, Inc. 588 West 400 South Suite 350 Lindon, UT 84042 USA AccessData Trademarks and Copyright Information The following are either registered trademarks or trademarks of AccessData Group, Inc. All other trademarks are the property of their respective owners. AccessData® AD Summation® Mobile Phone Examiner Plus® AccessData Certified Examiner® (ACE®) Discovery Cracker® MPE+ Velocitor™ AD AccessData™ Distributed Network Attack® Password Recovery Toolkit® AD eDiscovery® DNA® PRTK® AD RTK™ Forensic Toolkit® (FTK®) Registry Viewer® LawDrop® Summation® | 2 A trademark symbol (®, ™, etc.) denotes an AccessData Group, Inc.
    [Show full text]
  • Comparative Evaluation of Mobile Forensic Tools
    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/322250449 Comparative Evaluation of Mobile Forensic Tools Chapter in Advances in Intelligent Systems and Computing · January 2018 DOI: 10.1007/978-3-319-73450-7_11 CITATIONS READS 0 486 6 authors, including: John Alhassan Sanjay Misra Federal University of Technology Minna Covenant University Ota Ogun State, Nigeria 40 PUBLICATIONS 16 CITATIONS 302 PUBLICATIONS 1,059 CITATIONS SEE PROFILE SEE PROFILE Adewole Adewumi Rytis Maskeliunas Covenant University Ota Ogun State, Nigeria Kaunas University of Technology 51 PUBLICATIONS 46 CITATIONS 94 PUBLICATIONS 164 CITATIONS SEE PROFILE SEE PROFILE Some of the authors of this publication are also working on these related projects: Learning from Failure: Evaluation of Agent Dyads in the Context of Adversarial Classification Game View project Biohashing based on Boolean logic operations View project All content following this page was uploaded by Rytis Maskeliunas on 08 January 2018. Provided by Covenant University Repository The user has requested enhancement of the downloaded file. CORE Metadata, citation and similar papers at core.ac.uk Comparative Evaluation of Mobile Forensic Tools J. K. Alhassan1(&), R. T. Oguntoye1, Sanjay Misra2, Adewole Adewumi2, Rytis Maskeliūnas3, and Robertas Damaševičius3 1 Federal University of Technology, Minna, Nigeria [email protected] 2 Covenant University, Otta, Nigeria [email protected] 3 Kaunas University of Technology, Kaunas, Lithuania [email protected] Abstract. The rapid rise in the technology today has brought to limelight mobile devices which are now being used as a tool to commit crime. Therefore, proper steps need to be ensured for Confidentiality, Integrity, Authenticity and legal acquisition of any form of digital evidence from the mobile devices.
    [Show full text]
  • Extending the Sleuth Kit and Its Underlying Model for Pooled Storage File System Forensic Analysis
    Extending The Sleuth Kit and its Underlying Model for Pooled Storage File System Forensic Analysis Fraunhofer Institute for Communication, Information Processing and Ergonomics Jan-Niclas Hilgert* [email protected] Martin Lambertz [email protected] Daniel Plohmann [email protected] © Fraunhofer FKIE Digital Forensic Analysis Slide 2 August 8th, 2017 © Cyber Analysis & Defense Department, Fraunhofer FKIE File Systems n Define how data is read from and written to a storage device n Utilize metadata to keep order of the data stored n File systems differ in many aspects EXT2FS HFS NTFS n Extensive background knowledge is required for a forensic analysis n But not always existent Slide 3 August 8th, 2017 © Cyber Analysis & Defense Department, Fraunhofer FKIE File System Forensic Analysis De-Facto Standard Model Physical Storage Media Sectors of Data Device Analysis Volume Volume n Universal model for a file system Analysis forensic analysis n Presented by Brian Carrier in 2005 File System n Consists of four interdependent steps File Analysis n Implemented in The Sleuth Kit Application Analysis Slide 4 August 8th, 2017 © Cyber Analysis & Defense Department, Fraunhofer FKIE File System Forensic Analysis De-Facto Standard Model Physical Storage Media Sectors of Data Device Analysis n Works great on a lot of established file systems Volume Volume Analysis EXT2FS NTFS File System HFS File Analysis n Problem: It hasn’t been reviewed or changed since its publication Application Analysis Slide
    [Show full text]
  • Digital Forensics Tutorials – Analyzing a Disk Image in Kali Autopsy
    Digital Forensics Tutorials – Analyzing a Disk Image in Kali Autopsy Explanation Section About Disk Analysis Once the proper steps have been taken to secure and verify the disk image, the actual contents of the image must be analyzed for suspicious or incriminating evidence. When looking at the contents of an image, it is necessary to not only look at the clearly visible contents such as folders on the desktop and images in user files, but the image must also be checked for hidden, encrypted, or deleted files. It is always better to assume that a suspect may have known that they were to be investigated and took steps to hide, delete, or otherwise make it difficult to find the information they had been storing on their USB or computer. About Kali Linux Sleuth Kit and Autopsy Autopsy and Sleuth Kit are open source digital investigation tools that run on Windows, Linux, OS X, and other Unix systems. Autopsy is the custom front-end application of Sleuth Kit. They can be used to analyze disk images and perform in-depth analysis of file systems (such as NTFS, FAT, Ext3) and several volume system types. Examiners and analysts can use the Autopsy graphical interface or the Sleuth Kit command line tools to conduct an investigation. In this case, we will be launching the Autopsy graphical interface via the Sleuth Kit command line. Autopsy/Sleuth Kit allow for an examiner to open a .dd or other type of disk image file, hash the file, and search for files and other information contained within the file.
    [Show full text]
  • AD-Ediscovery-Product-Review-From
    eDiscovery Full eDiscovery Suite Empowering Excellence from Data Collection to Analysis for Endpoint & Remote Data Collection, Forensic Imaging, Document Review, and Much More AD eDiscovery is Company Name Brand challenges for over 30 years. For example, AccessData Group, Inc. one of the more difficult tasks is collecting a single, integrated data from remote computers which has Product Name Brand(s) become even more prevalent in the platform for preservation, AD eDiscovery work-from-home environments we find litigation holds, collection, AD Enterprise ourselves these days. Fortunately, Forensic Toolkit (FTK) AccessData stands out as one of the few data processing, and Quin-C companies that offers tools and platforms AD QBlaze that allow customers to successfully assessment, along with Summation retrieve and process electronically stored legal review and information from anywhere. Latest Developments and Updates production.” • Collect from Microsoft Office 365, Teams, The Comprehensive eDiscovery Mimecast email management, and Family from AccessData Proofpoint cybersecurity. AccessData is a comprehensive provider of • Speed data collection and analysis with computer forensics and litigation support automated tasks. technologies and boasts a broad spectrum • Remotely collect data from Apple macOS of stand-alone and enterprise-grade Catalina and Mojave operating systems. software platforms. • The new AD QBlaze platform simplifies processing and review in an easy-to- One of their flagship products, AD access SaaS model. eDiscovery, supports an end-to-end discovery process across the entire There are many uncertainties one Electronic Discovery Reference Model encounters when attempting to be (EDRM). A single SQL database serves all proficient at eDiscovery processes and components and supports seamless, procedures but there is a company that connected workflows in a forensically has aptly and consistently addressed those sound environment.
    [Show full text]
  • FTK in Action
    The Forensic Process Examined: Creating cases for classroom use Yvonne LeClaire Lewis University MSIS 68-595 Table of Contents Introduction ................................................................................................................................................. 4 Digital Evidence ........................................................................................................................................... 5 Computers.................................................................................................................................................. 5 Storage Devices ......................................................................................................................................... 5 Handheld Devices ...................................................................................................................................... 6 Peripheral Devices ..................................................................................................................................... 6 Network Devices ....................................................................................................................................... 7 Miscellaneous Possible Sources ................................................................................................................ 7 Determining the Course of Action ............................................................................................................. 7 Uses for Digital Evidence ...........................................................................................................................
    [Show full text]
  • Performance of Android Forensics Data Recovery Tools
    This is author accepted copy; for final version please refer to: B.C. Ogazi-Onyemaechi, Ali Dehghantanha, Kim-Kwang Raymond Choo, “Performance of Android Forensics Data Recovery Tools”, Pages 91-110, Chapter 7, (Elsevier) Contemporary Digital Forensic Investigations Of Cloud And Mobile Applications Performance of Android Forensics Data Recovery Tools Bernard Chukwuemeka Ogazi-Onyemaechi1, Ali Dehghantanha1; Kim-Kwang Raymond Choo2 1School of Computing, Science and Engineering, University of Salford, Manchester, United Kingdom 2 Information Assurance Research Group, University of South Australia, Australia [email protected]; [email protected]; [email protected] Abstract- Recovering deleted or hidden data is among most important duties of forensics investigators. Extensive utilisation of smartphones as subject, objects or tools of crime made them an important part of residual forensics. This chapter investigates the effectiveness of mobile forensic data recovery tools in recovering evidences from a Samsung Galaxy S2 i9100 Android phone. We seek to determine the amount of data that could be recovered using Phone image carver, Access data FTK, Foremost, Diskdigger, and Recover My File forensic tools. The findings reflected the difference between recovery capacities of studied tools showing their suitability in their specialised contexts only. Keywords: Data recovery, digital forensics, deleted file recovery, mobile forensics, Android forensics. 1 1.0 INTRODUCTION Smart mobile devices, particularly smartphones, are increasingly popular in today’s Internet-connected society (1–4). For example, few years ago in 2010, shipments of smartphone grew by 74 percent to 295 million units (3,4). Unsurprisingly, sales of smartphones have been increasing since then (5,6), and it has been estimated that 1.5 billion smartphones will be sold by 2017 and 1 billion mobile subscribers by 2022 (7–15).
    [Show full text]
  • A User-Oriented Network Forensic Analyser
    A USER-ORIENTED NETWORK FORENSIC ANALYSER 1 1 1,2 1,2 D. Joy , F. Li , N.L. Clarke and S.M. Furnell 1Centre for Security, Communications and Network Research (CSCAN) Plymouth University, Plymouth, United Kingdom 2Security Research Institute, Edith Cowan University, Western Australia [email protected] Abstract Network forensics is becoming an increasingly important tool in the investigation of cyber and computer- assisted crimes. Unfortunately, whilst much effort has been undertaken in developing computer forensic file system analysers (e.g. Encase and FTK), such focus has not been given to Network Forensic Analyser Tools (NFATs). The single biggest barrier to effective NFATs is the handling of large volumes of low-level traffic and being able to exact and interpret forensic artefacts and their context – for example, being able extract and render application-level objects (such as emails, web pages and documents) from the low-level TCP/IP traffic but also understand how these applications/artefacts are being used. Whilst some studies and tools are beginning to achieve object extraction, results to date are limited to basic objects. No research has focused upon analysing network traffic to understand the nature of its use – not simply looking at the fact a person requested a webpage, but how long they spend on the application and what interactions did they have with whilst using the service (e.g. posting an image, or engaging in an instant message chat). This additional layer of information can provide an investigator with a far more rich and complete understanding of a suspect’s activities. To this end, this paper presents an investigation into the ability to derive high-level application usage characteristics from low-level network traffic meta-data.
    [Show full text]
  • The Sleuth Kit (TSK)/Autopsy Software Version: Version 3.2.2/Version 2.24
    The Sleuth Kit (TSK) 3.2.2/Autopsy 2.24 Test Results for Deleted File Recovery and Active File Listing Tool July 2, 2014 This report was prepared for the Department of Homeland Security Science and Technology Directorate Cyber Security Division by the Office of Law Enforcement Standards of the National Institute of Standards and Technology. For additional information about the Cyber Security Division and ongoing projects, please visit www.cyber.st.dhs.gov. July 2014 Test Results for Deleted File Recovery and Active File Listing Tool: The Sleuth Kit (TSK) 3.2.2/Autopsy 2.24 Contents Introduction ......................................................................................................................... 1 How to Read This Report .................................................................................................... 1 1 Results Summary .......................................................................................................... 2 1.1 FAT ........................................................................................................................ 3 1.2 ExFat ...................................................................................................................... 3 1.3 NTFS ............................................................................................................................4 1.4 ext ........................................................................................................................... 4 1.5 HFS+ .....................................................................................................................
    [Show full text]
  • Practical Investigations of Digital Forensics Tools for Mobile Devices Maynard Yates II, M.S
    Practical Investigations of Digital Forensics Tools for Mobile Devices Maynard Yates II, M.S. Florida Agricultural and Mechanical University Department of Computer and Information Sciences Technical Building A, Room 211 Tallahassee, FL 32307-5100 [email protected] ABSTRACT A few examples of these changes are: With the continued growth of the mobile device market, the Correspondence: Postal mail → Electronic mail (E- possibility of their use in criminal activity will only continue to mail) → SMS messages (text messages) increase. While the mobile device market provides a great variety of manufactures and models causing a strong diversity. It Telecommunications: Telephones → car powered cell becomes difficult for a professional investigator to choose the phones→ battery powered cell phones proper forensics tools for seizing internal data from mobile Calendar: Secretary → Day Planner→ Personal Data devices. Through this paper, we will give a comprehensive Assistant (PDA)→ “Smartphone” perspective of each popular digital forensic tool and offer an inside view for investigators to choose their free sources or commercial tools. In addition, a summary for the future direction As technology continues to permeate society and mobile for forensics tools in mobile devices. computing becomes more prevalent, people will more heavily depend on applications such as e-mail, SMS (Short Message Service), MMS (Multimedia Messaging Service) and online Categories and Subject Descriptors transactions (i.e. bank, ins, etc); such devices provide a good K.4.1. [Computers and Society]: Public Policy Issues - abuse source of evidence for forensic investigators to prove or disprove and crime involving computers; D.4.6 [Operating Systems]: the commitment of crimes or location of suspects/victims [6].
    [Show full text]