Application of Cortical Learning Algorithms to Movement Classification Towards Automated Video Forensics

Total Page:16

File Type:pdf, Size:1020Kb

Application of Cortical Learning Algorithms to Movement Classification Towards Automated Video Forensics Application of Cortical Learning Algorithms to Movement Classification towards Automated Video Forensics By Abdullah Alshaikh A Thesis submitted in partial fulfilment of the requirement for the degree of Doctor of Philosophy at Staffordshire University, Stafford, United Kingdom February 2019 Declaration I, Abdullah Alshaikh, declare that all work submitted is my own, that any other external material used within my report my report is documented and referenced fully. Date: ............................................. Signature:....................................... ii Abstract The need for proper and acceptable video forensics process is necessary due to the proliferation and advancement of video technologies in all aspects of our life, hence the legal system has heavily invested in this area. Also, the classification of the movements of objects detected from a video feed is an essential module to automate the forensic video process. Recently, new bio- inspired machine learning techniques have been proposed in the attempt of mimicking the function of the human brain. Hierarchical Temporal Memory (HTM) theory has proposed new computational learning models, Cortical Learning Algorithms (CLA), inspired from the neocortex, which offer a better understanding of how our brains function. This research aims to study the requirements of video forensic investigation and Police procedures to propose a new semi-automated post-incident analysis framework and to investigate the application of the CLA to movement classification towards an automated video forensics process. This research starts by reviewing the research related to police practices for video forensics as well as various proposed video forensic frameworks. Then a Questionnaire targeting CCTV/Video Forensics practitioners has been developed to capture the requirements for automating the video forensics process, this has been followed by proposing a new post-incident analysis framework. Then, a literature review covering state-of-the-art movement classification algorithms has been carried out. Finally, a novel CLA-based movement classification algorithm has been proposed and devised to classify the movements of moving objects in realistic video surveillance scenarios, and the test results have been evaluated. Tests applied on twenty-three videos have been conducted to detect movement anomalies in different scenarios. Additionally, in this study, the proposed algorithm has been evaluated and compared against several state-of-the-art anomaly detection algorithms. The proposed algorithm has achieved 66.29% average F-measure, with an improvement of 15.5%compared to the k- Nearest Neighbour Global Anomaly Score (kNN-GAS) algorithm. The Independent Component Analysis-Local Outlier Probability (ICA-LoOP) scored 42.75%, the Singular Value Decomposition Influence Outlier (SVD-IO) achieved 34.82%, whilst the Connectivity Based Factor algorithm (CBOF) scored 8.72%. The proposed models, which are based on HTM, have empirically portrayed positive potential and had exceeded in performance when compared to state-of-the-art algorithms. iii List of Publications This research activity has led to several publications in international journals. These are summarized below: 1. AlShaikh, A. and Sedky, M., (2015). Post Incident Analysis Framework for Automated Video Forensic Investigation. International Journal of Computer Applications, 129(17), pp. 38-44. 2. Alshaikh, A., & Sedky, M. (2016). Movement Classification Technique for Video Forensic Investigation. International Journal of Computer Applications, 135(12), pp. 1-7. ‏ 3. AlShaikh, A. and Sedky, M., (2017). A Cortical Learning Movement Classification Algorithm for Video Surveillance. International Journal of Computer Applications 6(12), pp. 501-510. 4. AlShaikh, A. and Sedky, M., (2019), Application of Cortical Learning Algorithms to Movement Classification, International Journal of Computer Applications 8(3), pp. 58- 65. iv Acknowledgements First of all, I would like to thank God Almighty for reconciling me in my whole life. Then I would like to express my thanks to the honourable man who is made of great knowledge and ethics, my supervisor Dr Mohamed Sedky. He has made great contributions to this research project since it was only an idea until it developed and became what it is now. I would also like to thank the great University of Staffordshire and the great professors for their great role in supporting research and researchers for the advancement of science not only in the UK but throughout the world, also to my wonderful mother and father who blessed me every step of my life. My precious wife and beloved children who accompanied me throughout the course of my life. I would also like to thank all the officials responsible for the university library that provided me the material necessary for this research thesis. I thank all those who stood beside me. v List of Contents Declaration ................................................................................................................................................... ii Abstract ....................................................................................................................................................... iii List of Publications ..................................................................................................................................... iv Acknowledgements ...................................................................................................................................... v List of Contents .......................................................................................................................................... vi List of Figures .............................................................................................................................................. x List of Tables ............................................................................................................................................. xii Abbreviations............................................................................................................................................ xiii Chapter 1 ..................................................................................................................................................... 1 Introduction ................................................................................................................................................. 1 1.1 Context ............................................................................................................................................ 1 1.2 Project Aim ..................................................................................................................................... 3 1.3 Objectives........................................................................................................................................ 3 1.4 Scope of the Investigation ............................................................................................................... 4 1.5 Research Approach ......................................................................................................................... 6 1.5.1 Evaluation of the proposed post-incident analysis framework ................................................... 9 1.5.2 Evaluation of the proposed movement classification technique ................................................. 9 1.6 Research questions........................................................................................................................ 10 1.7 Contribution to knowledge ............................................................................................................ 10 1.8 Thesis structure ............................................................................................................................. 11 Chapter 2 ................................................................................................................................................... 14 Video Forensic ........................................................................................................................................... 14 2.1 Introduction .................................................................................................................................. 14 2.2 Background ................................................................................................................................... 14 2.3 Digital Forensic ............................................................................................................................ 16 2.3.1 Digital Evidence ....................................................................................................................... 20 2.3.2 Characteristics of Digital Evidence .......................................................................................... 20 2.3.3 Role of Digital Evidence ........................................................................................................... 21 2.3.4 Legal Requirements .................................................................................................................. 22 2.3.5 Legal Evidence ......................................................................................................................... 24 2.4 The Forensic Models ....................................................................................................................
Recommended publications
  • Video and Imaging, 2013-2016
    UvA-DARE (Digital Academic Repository) Video and Imaging, 2013-2016 Ruifrok, A.; Geradts, Z. Publication date 2016 Document Version Final published version Published in 18th INTERPOL International Forensic Science Managers Symposium, Lyon, France License Article 25fa Dutch Copyright Act Link to publication Citation for published version (APA): Ruifrok, A., & Geradts, Z. (2016). Video and Imaging, 2013-2016. In M. M. Houck (Ed.), 18th INTERPOL International Forensic Science Managers Symposium, Lyon, France: 11-13 October 2016 : review papers (pp. 568-585). Interpol. https://www.interpol.int/content/download/33314/426506/version/1/file/INTERPOL%2018th%2 0IFSMS%20Review%20Papers.pdf General rights It is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), other than for strictly personal, individual use, unless the work is under an open content license (like Creative Commons). Disclaimer/Complaints regulations If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library: https://uba.uva.nl/en/contact, or a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible. UvA-DARE is a service provided by the library of the University of Amsterdam (https://dare.uva.nl) Download date:25 Sep 2021 _________________________________________________________________ 18th INTERPOL International Forensic Science Managers Symposium Lyon, France 11-13 October 2016 Review Papers EDITED BY: DR.
    [Show full text]
  • About the AAFS
    American Academy of Forensic Sciences 410 North 21st Street Colorado Springs, Colorado 80904 Phone: (719) 636-1100 Email: [email protected] Website: www.aafs.org @ AAFS Publication 20-2 Copyright © 2020 American Academy of Forensic Sciences Printed in the United States of America Publication Printers, Inc., Denver, CO Typography by Kathy Howard Cover Art by My Creative Condition, Colorado Springs, CO WELCOME LETTER Dear Attendees, It is my high honor and distinct privilege to welcome you to the 72nd AAFS Annual Scientific Meeting in Anaheim, California. I would like to thank the AAFS staff, the many volunteers, and everyone else who have worked together to create an excellent program for this meeting with the theme Crossing Borders. You will have many opportunities to meet your colleagues and discuss new challenges in the field. There are many workshops and special sessions that will be presented. The Interdisciplinary and Plenary Sessions will provide different views in forensic science—past, present, and future. The Young Forensic Scientists Forum will celebrate its 25th Anniversary and is conducting a workshop related to the meeting theme. More than 1,000 presentations are scheduled that will provide you with more insight into the developments in forensic science. The exhibit hall, always interesting to explore, is where you will see the latest forensic science equipment, technology, and literature. The theme Crossing Borders was chosen by me and my colleagues at the Netherlands Forensic Institute (NFI). We see many definitions of crossing borders in forensic science today. For the 2020 meeting, six words starting with the letters “IN” are included in the theme.
    [Show full text]
  • Sejarah Forensik Dan Digital Forensik
    Sejarah Forensik dan Digital Forensik Disusun untuk memenuhi tugas ke II, MK. Manajemen Investigasi Tindak Kriminal (Dosen Pengampu : Yudi Prayudi, S.Si, M.Kom) Fathirma’ruf 13917213 PROGRAM PASCASARJANA TEKNIK INFORMATIKA FAKULTAS TEKNIK INDUSTRI UNIVERSITAS ISLAM INDONESIA YOGYAKARTA 2014 MATERI ILMU FORENSIK DAN DIGITAL FORENSIK 1.1. Definisi Forensik Forensik merupakan sebuah penerapan dari berbagai ilmu pengetahuan yang digunakan untuk menjawab pertanyaan-pertanyaan penting dari sebuah system hokum, yang dalam hal ini berkaitan dengan hokum pidana, penerapan bidang ilmu ini tidak terlepas dari penggunaan metode-metode ilmiah, atau ilmu pengetahuan, aturan-aturan yang dibentuk dari fakta-fakta dari suatu kejadian sebagai bentuk melakukan pengenalan terhadap bukti- bukti fisik. Menurut Dr Edmond Locard. Istilah Forensik berasal dari bahasa yunani yaitu “Forensis” yang berarti debat atau perdebatan merupakan bidang ilmu pengetahuan yang digunakan untuk membantu proses penegakan keadilan melalui proses penerapan ilmu (sains). Sedangkan menurut beberapa pendapat lain Forensik berasal dari bahasa latin yaitu “Forum” yang berarti tempat/lokasi untuk melakukan transaksi. Dalam perkembangan selanjutnya semakin banyak bidang ilmu yang dilibatkan atau dimanfaatkan dalam penyidikan suatu kasus kriminal untuk kepentingan hukum dankeadilan. Dari beberapa pendapat yang telah dijelaskan diatas maka dapat saya jelaskan pendefinisian terhadap ilmu forensic adalah Ilmu forensik adalah penerapan suatu bidang Ilmu pengetahuan dengan tujuan untuk pengungkapan suatu kasus tertentu demi penetapan hukum dan pelaksanaan hukum dalam sistem peradilan hukum pidana maupun hukum perdata. Prinsip dasar ilmu forensik dipelopori oleh Dr Edmond Locard. Ia berspekulasi bahwa setiap kontak yang Anda buat dengan orang lain, tempat, atau hasil objek dalam pertukaran materi fisik. Ini dikenal sebagai Locar exchange principle . Ini pertukaran materi fisik dapat dapat digunakan untuk membuktikan tidak bersalah seseorang atau bersalah di pengadilan hukum.
    [Show full text]
  • Physiological Sciences: a Guide to Forensic Subdivisions
    Physiological Sciences: A Guide To Forensic Subdivisions Physiological science is a type of biology that focuses on the study of the human body and how it functions. Forensic science is closely tied to this since forensics is a system of using science to help provide proof and answers for legal and criminal cases. Forensics is a very broad field that can be broken down into several sub-sectors, including the physiology, criminalistics, digital analysis, and social sciences. Forensic Aerial Photography Forensic aerial photography is a bit different from standard forensic photography that tends to focus in on accident and crime scenes. Forensic aerial photography involves recording images from above to show the full scale of an area or scene in question. Reconstructing Traffic Accidents – Learn how police use forensic aerial photography to investigate road accidents. Forensic Anthropology Anthropology is the study of the development and evolution of the human race. When combined with forensics, it can be used to identify the remains of a body, even if it is heavily decomposed or destroyed in some other ways. Forensic Anthropologists – Find out more about what forensic anthropologists do with examples of how they study a body or skeleton. Forensic Anthropology Resources – A forensic anthropologist supplies numerous links and resources for those interested in this field. American Board of Forensic Anthropology – This organization provides helpful information for those new to forensic anthropology along with a list of recognized educational programs. Forensic Archeology Archaeologists typically try to find clues about the distant past through a series of specialized techniques and procedures. Forensic archaeologists use the same methods but for the purpose of uncovering the truth behind various crimes or accidents.
    [Show full text]
  • Forensic Science 1 Forensic Science
    Forensic science 1 Forensic science "Forensics" redirects here. For other uses, see Forensics (disambiguation). Forensic science Physiological sciences • Forensic anthropology • Forensic archaeology • Forensic odontology • Forensic entomology • Forensic pathology • Forensic botany • Forensic biology • DNA profiling • Bloodstain pattern analysis • Forensic chemistry • Forensic osteology Social sciences • Forensic psychology • Forensic psychiatry Forensic criminalistics • Ballistics • Ballistic fingerprinting • Body identification • Fingerprint analysis • Forensic accounting • Forensic arts • Forensic footwear evidence • Forensic toxicology • Gloveprint analysis • Palmprint analysis • Questioned document examination • Vein matching Digital forensics • Computer forensics • Forensic data analysis • Database forensics • Mobile device forensics • Network forensics • Forensic video • Forensic audio Related disciplines • Fire investigation Forensic science 2 • Fire accelerant detection • Forensic engineering • Forensic linguistics • Forensic materials engineering • Forensic polymer engineering • Forensic statistics • Forensic taphonomy • Vehicular accident reconstruction People • William M. Bass • George W. Gill • Richard Jantz • Edmond Locard • Douglas W. Owsley • Werner Spitz • Auguste Ambroise Tardieu • Juan Vucetich Related articles • Crime scene • CSI effect • Perry Mason syndrome • Pollen calendar • Skid mark • Trace evidence • Use of DNA in forensic entomology • v • t [1] • e Forensic science is the scientific method of gathering and examining
    [Show full text]
  • A Short Note on Forensic Science
    A SHORT NOTE ON FORENSIC SCIENCE - Yash Vardhan Singh Definition of Forensic Science Forensic science is the application of natural sciences to matters of the law. In practice, forensic science draws upon physics, chemistry, biology, and other scientific principles and methods. Forensic science is concerned with the recognition, identification, individualization, and evaluation of physical evidence. Forensic scientists present their findings as expert witnesses in the court of law. The word “forensic” means “pertaining to the law”; forensic science resolves legal issues by applying scientific principles to them. Forensic Science is the application of the methods and techniques of the basic sciences to legal issues. As you can imagine Forensic Science is a very broad field of study. Crime Laboratory Scientists, sometimes called Forensic Scientists or, more properly, Criminalists, work with physical evidence collected at scenes of crimes. Forensic science is the scientific analysis and documentation of evidence suitable for legal proceedings. Many people have heard the term “forensics” used to describe school debate clubs. There is a similarity between these two forms of the word. In academic forensics, political or other issues are debated between two teams using a logical approach, and likewise in forensic science the debate (or comparison) is between the physical evidence and the known or suspected circumstances about an event. The word forensic comes from the Latin adjective forensis, meaning "of or before the forum." In Roman times, a criminal charge meant presenting the case before a group of public individuals in the forum. Both the person accused of the crime and the accuser would give speeches based on their side of the story.
    [Show full text]
  • Best Practice Manual for Facial Image Comparison 2018-01-15
    BPM for Facial Image Comparison ENFSI-BPM-DI-01 (vs.01) ENFSI-BPM-DI-01 (vs.01) BPM for Facial Image Comparison Best Practice Manual BPM for the for Facial Image Comparison ENFSI-BPM-DI-01 Version 01 - January 2018 ENFSI’s position on Best Practice Manuals ENFSI wishes to promote the improvement of mutual trust by encouraging forensic harmonisation through the development and use of Best Practice Manuals. Furthermore, ENFSI encourages sharing Best Practice Manuals with the whole Forensic Science Community which also includes non ENFSI Members. Visit www.enfsi.eu/documents /bylaws for more information. It includes the ENFSI policy document Policy on Creation of Best Practice Manuals within ENFSI (code: QCC-BPM-001). Official language The text may be translated into other languages as required. The English language version remains the definitive version. Copyright The copyright of this text is held by ENFSI. The text may not be copied for resale. Further information For further information about this publication, contact the ENFSI Secretariat. Please check the website of ENFSI (www.enfsi.eu) for update information. ENFSI-BPM-DI-01 (vs.01) BPM for Facial Image Comparison Best Practice Manual for Facial Image Comparison CONTENTS ACKNOWLEDGEMENTS ......................................................................................................... 4 1. AIMS ........................................................................................................................... 4 2. SCOPE ......................................................................................................................
    [Show full text]
  • JFI Abstracts from 2019
    JFI Abstracts from 2019 Issue 4: October to December 2019 Letter to the Editor Author(s): Laskowski, Gregrory Eric Type: Letter to the Editor Published: 2019, Volume 69, Issue 4, Page 397 Abstract: Re: Assessing Latent Print Proficiency Tests: Lofty Aims, Straightforward Samples, and the Implications of Nonexpert Performance. J. For. Ident. 2019, 69 (3), 281-296 Testifying on Fingerprint Examinations in 2019 Author(s): Neumann, Cedric, Ph.D Type: Commentary Published: 2019, Volume 69, Issue 4, Page 405 The Fingerprint Disaster Victim Identification Toolkit: From Powder to Biometrics Author(s): Tamisier, Laurent; Thiburce, Nicolas; Prat, Lionel; Malo, Marianne; Ledroit, Pierre Type: Technical Note Published: 2019, Volume 69, Issue 4, Page 413 Abstract: For the past 25 years, the Disaster Victim Identification(DVI) Squad of the Institut de Recherche Criminelle de la Gendarmerie Nationale, the Forensic Laboratory of the French Gendarmerie, has been involved in more than 80 identification missions of various types including natural disasters, aircraft crashes, road traffic accidents, and terrorist attacks. Members of this DVI squad have sometimes operated in extreme conditions, forcing them to adapt their equipment. This technical note explores the use of a fingerprint disaster victim identification toolkit, which is a portable kit that was developed through years of experience by fingerprint experts. This toolkit not only allows the use of traditional techniques to produce postmortem records but also includes a biometric sensor with a specific interface, combined with a portable automated fingerprint identification system. This operational toolkit offers an all-in-one system, devoted to disaster victim identification. Using Gun Blue to Enhance Fingermark Ridge Detail on Ballistic Brass Author(s): Christofidis, George; Morrissey, Joanne; Birkett, Jason W.
    [Show full text]
  • Virtualeva 2020 SESSION DESCRIPTIONS
    VirtuaLEVA 2020 SESSION DESCRIPTIONS In Alphabetical Order with more to be added! * Indicates presentation by a corporate representative W = Workshop (hands-on) L = Lecture (R) = Recorded Session (NR) = Not Recorded Session Accreditation? ISO 17025? What’s This All About? L (R) 90 Minutes This presentation will provide an overview of a forensic laboratory accreditation program. It will cover the general requirements of the ISO 17025 standard and how the Ohio Division of State Fire Marshal Forensic Laboratory works towards meetinG the requirements with special emphasis on video Forensics. Finally, there will an overview of the laboratory assessment process. Presenters: Bradley Barkhurst is a LEVA Certified Forensic Video Analyst and, since 2016, a Forensic Specialist Supervisor with the Ohio Division of State Fire Marshal Forensic Laboratory. Prior, he worked For ten years as a forensic video analyst with the Ohio Organized Crime Investigations Commission. He holds a BFA in electronic media From the University oF Cincinnati. He is currently pursuing a Master of Science degree From the University College of Dublin, Ireland Centre For Cybersecurity and Cybercrime Investigation and expects to graduate in 2020. In 2020, he obtained a forensic video examiner certification with the International Association of Identification. Bradley is a LEVA Board member and an active member in IAI, HTCIA and MORPCA. Chris Corpora is a LEVA CertiFied Forensic Video Analyst who works on Audio and Video Analysis at the Santa Clara County Crime Laboratory in San Jose, CA. Chris has been a Technical Assessor for ANAB (previously ASCLD/LAB) in the area of Digital Evidence since 2015 and has completed four external lab assessments and numerous other internal audits at his own lab since he started working there almost 20 years aGo.
    [Show full text]
  • Legal and Practical Responses to the Most Common Challenges Faced by Forensic Video Analysts
    LEGAL AND PRACTICAL RESPONSES TO THE MOST COMMON CHALLENGES FACED BY FORENSIC VIDEO ANALYSTS by Jonathan W. Hak, Q.C., Dipl., B.Sc., LL.B., LL.M. Copyright © Jonathan W. Hak, Q.C. 2011 TABLE OF CONTENTS 1. Introduction....................................................................................................3 2. Interpretation and Narration of Video Evidence .............................................3 2.1 Why is expert interpretation and narration of video evidence necessary? 3 2.2 Who is qualified to interpret and narrate video evidence? ......................6 2.3 Are there court rulings that permit a forensic video analyst to interpret and narrate video evidence for the court? .......................................................15 2.4 Are there court rulings that prohibit a forensic video analyst from interpreting and narrating video evidence for the court? .................................22 2.5 Are there limitations on the interpretation and narration that a forensic video analyst may testify about in court?.........................................................25 3. Photographic Video Comparison Evidence .................................................25 3.1 What is the scientific basis for PVCE?..................................................26 3.2 What is the legal basis for PVCE?........................................................28 3.3 Are there court rulings that accept PVCE? ...........................................30 3.3.1 Vehicles.........................................................................................30
    [Show full text]
  • Video Evidence a Law Enforcement Guide to Resources and Best Practices
    DRAFT Video Evidence A Law Enforcement Guide to Resources and Best Practices With the rapid growth and improvements in video technology used in government, business, and personal applications, law enforcement leaders are recognizing the importance of improving their agencies’ capabilities of utilizing that video evidence to solve crimes. Despite the growing availability of video evidence, many state and local law enforcement agencies have indicated that gathering and analyzing video information can be very difficult. Video evidence can come from a multitude of different devices, with differing systems, formats, players, and technology, yet an agency’s ability to properly secure, catalog, store, and maintain its evidentiary value and integrity is critical to a professional police organization. Clearly, guidance and best practices are needed to improve public safety agencies’ ability to appropriately utilize and manage video data. The purpose of this resource is to provide answers to straightforward common questions that law enforcement officers, or the agencies they represent, may have regarding properly securing, collecting, storing, and analyzing video by directing them to valuable tools and resources from experts in the field. Global Strategic Solutions Working Group March 2014 Background Many state, local, and tribal law enforcement agencies across the United States are not in a position to be able to fund, create, and maintain a specialized video forensics unit. Yet there are a number of larger law enforcement agencies, as well as federal and nonfederal agencies, that have such capabilities and are trained to respond to major threats and incidents (bombings, mass-casualty events, school shootings, etc.). They have the expertise that allows them to secure and analyze videos from multiple sources, which greatly improves the ability to investigate a crime and identify the suspect/suspects.
    [Show full text]
  • A Simplified Guide to Forensic Audio and Video Analysis
    A Simplified Guide To Forensic Audio and Video Analysis Introduction Unlike other forms of forensic evidence, audio and video recordings can provide a real-time, eyewitness account of a crime so investigators can watch or hear what transpired. For instance, a surveillance video captures a bank robbery in progress, or a hidden camera records an undercover sting operation. Over the past decade, sources of recorded audio and video that can assist in an investigation have increased exponentially. Closed circuit television systems (CCTV) and video and audio recorders can be found in businesses, at traffic intersections, parking lots, bank machines, on police-vehicle dashboards and of course, in cell phones. For large-scale events or crimes, the sheer amount of recorded audio and video evidence can be massive. During the riots that occurred in Vancouver, British Columbia after the 2011 Stanley Cup Finals, more than 5,000 hours of recordings were captured. Law enforcement has since brought charges against more than a hundred rioters using video evidence and more charges are expected. For most crimes, however, high-quality audio and/or video recordings are often not available. This is where forensic audio and video expertise can help. Forensic experts have many techniques to enhance recordings that can bring out details and provide a clearer picture of what occurred, or make an audio recording more audible. This in turn helps investigators, lawyers and jurors better conduct their duties. Principles of Forensic Audio and Video Analysis To assist in an investigation, forensic experts can repair, recover, enhance and analyze audio and video recordings using an array of scientific tools and techniques.
    [Show full text]