DOCSLIB.ORG

MPEG-7-Aligned Spatiotemporal Video Annotation and Scene

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
MPEG-7-Aligned Spatiotemporal Video Annotation and Scene MPEG-7-Aligned Spatiotemporal Video Annotation and Scene Interpretation via an Ontological Framework for Intelligent Applications in Medical Image Sequence and Video Analysis by Leslie Frank Sikos Thesis Submitted to Flinders University for the degree of Doctor of Philosophy College of Science and Engineering 5 March 2018 Contents Preface ............................................................................................................................................ VI List of Figures .............................................................................................................................. VIII List of Tables .................................................................................................................................. IX List of Listings .................................................................................................................................. X Declaration .................................................................................................................................... XII Acknowledgements ..................................................................................................................... XIII Chapter 1 Introduction and Motivation ......................................................................................... 1 1.1 The Limitations of Video Metadata.............................................................................................. 1 1.2 The Limitations of Feature Descriptors: the Semantic Gap ...................................................... 2 1.2.1 Common Visual Descriptors .................................................................................................. 4 1.2.2 Common Audio Descriptors .................................................................................................. 5 1.2.3 Common Spatiotemporal Feature Descriptors, Feature Aggregates, and Feature Statistics .................................................................................................................................... 7 1.3 Machine Learning Approaches for Multimedia Understanding .............................................. 7 1.4 Motivation: Multimedia Semantics in the Medical Domain ..................................................... 9 1.5 Summary ....................................................................................................................................... 12 Chapter 2 Medical Video Semantics ............................................................................................. 13 2.1 Challenges in Medical Video Interpretation ............................................................................ 13 2.2 From Video Metadata to Medical Video Semantics ................................................................ 16 2.3 Summary ....................................................................................................................................... 19 Chapter 3 Formal Knowledge Representation .............................................................................. 20 3.1 Structured Data ............................................................................................................................ 20 I Contents 3.2 Controlled Vocabularies and Ontologies: from RDFS to OWL 2 .......................................... 21 3.2.1 Modeling with RDFS ............................................................................................................ 22 3.2.2 Modeling with OWL ............................................................................................................. 23 3.2.2.1 Class Declarations ......................................................................................................... 26 3.2.2.2 Property Declarations ................................................................................................... 27 3.2.2.3 Individual Declarations ................................................................................................ 33 3.2.3 Serialization ........................................................................................................................... 35 3.3 Description Logics: Formal Grounding for OWL Ontologies ............................................... 38 3.4 A Hybrid DL-Based Formalism for Video Event Representation ......................................... 39 3.4.1 Rationale ................................................................................................................................. 40 3.4.2 Development.......................................................................................................................... 47 3.4.3 Importance in Spatiotemporal Reasoning ......................................................................... 49 3.5 Summary ........................................................................................................................................ 49 Chapter 4 Ontology Implementations .......................................................................................... 50 4.1 Common Vocabularies and Ontologies for Video Representation ....................................... 50 4.2 Common Medical Ontologies..................................................................................................... 53 4.2.1 Biomedical Ontologies for Representing Background Knowledge ................................. 55 4.2.2 Vocabularies and Ontologies for the Semantic Annotation of Medical Multimedia ............................................................................................................................. 56 4.3 Structured Video Data Deployment .......................................................................................... 57 4.3.1 Lightweight Video Annotations .......................................................................................... 57 4.3.2 Video Representations in Graph Databases ...................................................................... 59 4.3.3 Semantic Enrichment of Videos with Linked Data .......................................................... 61 4.4 Summary ....................................................................................................................................... 62 Chapter 5 Ontology-Based Structured Video Annotation .......................................................... 63 5.1 Semantic Video Annotation ........................................................................................................ 63 5.1.1 Feature Extraction for Concept Mapping .......................................................................... 63 5.1.2 Knowledge Representation of Video Scenes ..................................................................... 64 II Contents 5.1.3 Ontology-Based Video Indexing and Retrieval ................................................................ 65 5.1.4 Primary Application Areas .................................................................................................. 68 5.2 Structured Video Annotation Tools .......................................................................................... 68 5.2.1 A Retrospective Survey of Semantic Video Annotation Tools ....................................... 69 5.2.2 State-of-the-Art Structured Video Annotation Tools ...................................................... 73 5.2.3 Comparison of Structured Video Annotation Tools ........................................................ 74 5.3 Standards Alignment ................................................................................................................... 77 5.4 Linked Data Support ................................................................................................................... 77 5.5 Ontology Use ................................................................................................................................ 78 5.6 Spatiotemporal Annotation Support ......................................................................................... 80 5.7 Summary ....................................................................................................................................... 81 Chapter 6 Video Ontology Engineering ........................................................................................ 82 6.1 The Video Ontology (VidOnt) ................................................................................................... 82 6.1.1 Rationale ................................................................................................................................. 83 6.1.2 Formal Grounding ................................................................................................................ 84 6.1.2.1 Terminological Knowledge .......................................................................................... 85 6.1.2.2 Assertional Knowledge ................................................................................................. 86 6.1.2.3 Role Box .......................................................................................................................... 87 6.1.2.4 Increasing Expressivity ................................................................................................. 88 6.1.3 Evaluation ............................................................................................................................... 89 6.1.3.1 Case Study 1: Professional Video Production ..........................................................
Load more

Recommended publications
  • GCSE Media Studies Controlled Assessment IT Resources And
    GCSE Media Studies IT Resources and Submission Guidance for Controlled Assessment version 1.1 Teacher Resource Bank / GCSE Media Studies / IT Resources for Controlled Assessment / Version 1.1 Resources for Controlled Assessment For the Controlled Assessment unit(s) of the course candidates must complete a practical production task. For Unit 2 this is chosen from one of the topics listed in Assignment Bank 3. This document contains information on resources that could be used to complete the work. These suggestions also apply to Unit 4 (Double Award). Moving Image 120 second trailer or opening sequence (or two 60 second teaser trailers) for a feature film or television program aimed at a specific audience. There is no need to invest in industry standard video cameras for the production of controlled assessment productions. By dividing your candidates into groups you can easily schedule the use of filming equipment to avoid extra expenses. Hardware: Flip Ultra is an affordable camcorder and includes a built in USB connection for data transfer. A tripod can be bought separately for still shots. Other affordable camcorders include: Canon FS10, JVC GZ-MG33OA, Samsung VP- MX20, and the Panasonic SDR-S7. Software: iMovie (free with Macs) and Windows Movie Maker (PC) both feature a simple drag-and-drop interface. Other software includes: Microsoft Photostory (free download if you have other Microsoft products), Cyberlink PowerDirector, Serif MoviePlus, Pinnacle Studio, Adobe Premiere Elements. Final Cut Express also offers a lot of features but is a more complicated program. Xtranormal.com is a website that offers the easy creation of animation scenes using a ‘text-to-movie’ feature.
    [Show full text]
  • The Uses of Animation 1
    The Uses of Animation 1 1 The Uses of Animation ANIMATION Animation is the process of making the illusion of motion and change by means of the rapid display of a sequence of static images that minimally differ from each other. The illusion—as in motion pictures in general—is thought to rely on the phi phenomenon. Animators are artists who specialize in the creation of animation. Animation can be recorded with either analogue media, a flip book, motion picture film, video tape,digital media, including formats with animated GIF, Flash animation and digital video. To display animation, a digital camera, computer, or projector are used along with new technologies that are produced. Animation creation methods include the traditional animation creation method and those involving stop motion animation of two and three-dimensional objects, paper cutouts, puppets and clay figures. Images are displayed in a rapid succession, usually 24, 25, 30, or 60 frames per second. THE MOST COMMON USES OF ANIMATION Cartoons The most common use of animation, and perhaps the origin of it, is cartoons. Cartoons appear all the time on television and the cinema and can be used for entertainment, advertising, 2 Aspects of Animation: Steps to Learn Animated Cartoons presentations and many more applications that are only limited by the imagination of the designer. The most important factor about making cartoons on a computer is reusability and flexibility. The system that will actually do the animation needs to be such that all the actions that are going to be performed can be repeated easily, without much fuss from the side of the animator.
    [Show full text]
  • Windows 8 Compatibility for Grass Valley® ADVC® Products, EDIUS®, and Related Products
    APPLICATION NOTE Windows 8 Compatibility for Grass Valley® ADVC® Products, EDIUS®, and Related Products A status report on Grass Valley product compatibility with Windows 8 December 2012 Many customers have been asking when products sold by Grass Valley’s Desktop and Enterprise Solutions (DES) division will sup- port Windows 8. Grass Valley has been testing and qualifying products with Windows 8 and is continuing to do so. This document is a status update of this testing. Future dates and schedules mentioned in this document are subject to change without notice. Most DES products also support Windows XP and Windows Vista, with a number also supporting Windows 7 (see the application note: “Windows 7 Compatibility for Grass Valley ADVC Products, EDIUS, and Related Products” PRV-4078M-1). In addition, ADVC products with a FireWire (IEEE 1394) port are compatible with many versions of MacOS including versions 10.5 and 10.6. For full specifications of which operating systems are supported for each product, please consult the specific product’s current data sheet or our website at www.grassvalley.com/products. Note: Windows 8 support is limited to the 64-bit version. EDIUS Neo 3.5 Nonlinear Editing EDIUS Pro 6.5 Nonlinear Editing EDIUS Express (requires v3.52 update) (requires v6.52 update) The EDIUS Neo 3.5 nonlinear editing EDIUS Pro 6.5 nonlinear editing software EDIUS Express v1.02 has been certified software works on Windows 8 64-bit. works with Windows 8 64-bit. to work with Windows 8 64-bit. Configurations of the EDIUS Neo 3 with the HDSPARK™ HDMI output monitoring board have also been certified to work with Windows 8 64-bit.
    [Show full text]
  • EDIUS Pro 8 (Version 8.22) EDIT ANYTHING
    EDIT ANYTHING This manual describes the new features and modifications on Version 8.22. For features not mentioned in this manual, see the latest “EDIUS Pro 8 Topic Library”. • Note that the latest “EDIUS Pro 8 Topic Library” does not include the new features and modifications of Version 8.2 and later. EDIUS Pro 8 (Version 8.22) New Features F2541606152 www.grassvalley.com July 2016 Notice to Reader f It is prohibited to copy a part or all of this product without prior permission. f The contents or specifications of this product may be changed without prior notice. f We have prepared the contents of this product to the best of our ability; however if you have any questions about the contents, or if there are any errors or missing items, please contact Grass Valley. f However we do not take any responsibility for malfunctions arising from use, irrespective of the points outlined in the preceding paragraph. f Irrespective of whether it was due to a usage error, Grass Valley takes no responsibility for extraordinary, incidental or derivative claims, including those for lost earnings generated by the application of this product. f It is prohibited to analyze, reverse engineer, decompile, or disassemble any of the items included with this product, including the software, hardware, and manuals. f Grass Valley, GV STRATUS, K2, Aurora, Summit, Infinity, and EDIUS are either registered trademarks or trademarks of Grass Valley USA, LLC in the United States and/or other countries. f Microsoft and Windows are registered trademarks of Microsoft Corporation, USA. f Intel, Xeon, and Core Duo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
    [Show full text]
  • Sep 15 3 Secunia Advert Secunia.Pdf (Colour) WHAT’S NEW - SECURITY
    WHAT’S NEW - MICROSOFT NEW! Windows 10 Education Edition …familiar, fast & secure operating system for a range of devices Windows 10 Education Edition, exclusively for education and charity customers, includes all features and functionalities of the Enterprise Edition, optional Long Term Servicing Branch and significant academic discount: • Strengths of Windows 7 & 8 combined - with NEW! Edge Web Browser • MDOP - personalise user experience, simplified application deployment & improved application compatibility • Enterprise Ready - premium features designed to address large scale mobility, security, management & virtualisation needs • Student Licenses - license all Faculty/Staff FTE for Windows 10 under EES, OVS-ES & Schools Agreements - receive student licenses at no additional cost Now with simplified upgrade and deployment paths Call 01974 200 201 NEW! Office 365 Education Plan …simplified plan to offer more value Microsoft has announced that, as of 1st September 2015, it will be making significant changes to its Office 365 offering for new and existing education customers: • One, simplified plan- with the option of Full Voice with PSTN • Unlimited archive, Data Loss Prevention (DLP), Inplace Hold & eDiscovery • Voicemail support included - for unified messaging in your inbox • Student Licenses - license all Faculty/Staff FTE for Office ProPlus under EES, OVS-ES & Schools Agreements - receive student licenses at no additional cost We can help you with the licensing, deployment planning, migration, implementation and management of your
    [Show full text]
  • Animation Software Free Download Windows 7L
    Animation Software Free Download Windows 7l Animation Software Free Download Windows 7l 1 / 3 2 / 3 7 Best Rotoscoping Software for your Animation Project · 10 Best Free VPN Software for your Windows PC. Filed Under: Freeware.. Freeware Files.com - Download free Animation Software. ... OS: Windows XP/Vista/7/8/10 (32-Bit/64-Bit). In: Free Graphics Tools > Animation .... Download and install the best free apps for Animation Software on Windows, Mac, iOS, and Android from CNET Download.com, your trusted source for the top .... for Windows, Linux and OSX. Download ... Download. We providing two flavors of binary builds of Synfig for all supported operating systems. Please choose ... Synfig is a free and open-source software licensed under GNU GPL v3. ... Microsoft Windows 7 or above; Dual-Core CPU at 2 Ghz or better; 2GB RAM or more .... Adobe Animate CC (Adobe Flash Professional)2017. ... The most popular animation software. ... Free and Easy Animated Movie Maker for Both Beginners and Experts.. 10 Best Free Download Animation Software for Windows and Mac 2020 ... 7, Anim8or, Windows, Difficult, 3D animation is Anim8or's main function.. Make professional cartoon animation videos for education, business, marketing and training with Animiz cartoon video creator tool.. List of best free download 2D and 3D animation software for Windows 10/8/7, for beginners & professionals. Small companies and freelance .... 1 Download Moviestorm. The Moviestorm Installer for Windows will start to download automatically in a few seconds. Save the file to a suitable folder (Right).. Easily create stunning 2D animations using keyframes with this motion graphics software. Export to video, flash, GIF or HTML5.
    [Show full text]
  • Plugs 'N Pixels Issue
    plugs-n-pixels IMAGE CREATION, MANIPULATION & EDUCATION Terragen 2 final release: A storm’s a-brewin’! Other recent releases: Topaz Adjust 3 & Simplify 2 onOne Plug-in Suite 4.5 Filter Forge for Mac Xara Web Designer Corel Painter 11 DAZ Carrara 7 and more! •HowieFarkes scenes for Carrara •New World Digital Art for Terragen 2 WEBSITE: www.plugsandpixels.com plugs-n-pixels EMAIL: [email protected] Page 3: Terragen 2 final release s t Page 4: New World Digital Art for TG2 n Pages 5-6: DAZ Carrara 7 e t Page 7: HowieFarkes scenes for Carrara n Pages 8-9 onOne Plug-in Suite 4.5 o Page 10: Topaz Adjust 3 c Page 11: Topaz Simplify 2 f Page 12: Topaz DeNoise 2 o Page 13: Topaz Artists Page 14: Filter Forge e l Page 15: PictoColor iCorrect EditLab b Page 16: Zaxwerks 3D Invigorator a t Page 17: N-Sided Quidam 3 Page 18: Xara Web Designer Page 19: Corel Painter 11 Page 20: Closing Artwork ISSUE #14 Layout created in ACD Canvas X Final PDF by Acrobat 9 Pro Text and images by Mike Bedford (except as noted) Background created with Carrara 7 (customized preset) A couple of our favorite plug-ins have recently received updates. The incredibly versatile Filter Forge is now also available for Mac OS-X (one of FF’s almost 6000 effects, HEINOUS by filter author Carl, is shown at left). Topaz Adjust (its detail- enhancing effects are shown above) is now in version 3 with a totally revamped interface. The long wait is over! www.plugsandpixels.com/terragen.html by New World Digital Art Fake Stone & Hero RockBackground Pack art: It was literally years in the making, but Terragen 2 has now left beta and has reached its final release! Terragen has long been known as one of the premier applications for the visualization of landscapes and natural environments, used by Hollywood movie studios, game developers, advertising groups and casual users worldwide.
    [Show full text]
  • Modifing Thingiverse Model in Blender
    Modifing Thingiverse Model In Blender Godard usually approbating proportionately or lixiviate cooingly when artier Wyn niello lastingly and forwardly. Euclidean Raoul still frivolling: antiphonic and indoor Ansell mildew quite fatly but redipped her exotoxin eligibly. Exhilarating and uncarted Manuel often discomforts some Roosevelt intimately or twaddles parabolically. Why not built into inventor using thingiverse blender sculpt the model window Logo simple metal, blender to thingiverse all your scene of the combined and. Your blender is in blender to empower the! This model then merging some models with blender also the thingiverse me who as! Cam can also fits a thingiverse in your model which are interchangeably used software? Stl files software is thingiverse blender resize designs directly from the toolbar from scratch to mark parts of the optics will be to! Another method for linux blender, in thingiverse and reusable components may. Svg export new geometrics works, after hours and drop or another one of hobbyist projects its huge user community gallery to the day? You blender model is thingiverse all models working choice for modeling meaning you can be. However in blender by using the product. Open in blender resize it original shape modeling software for a problem indeed delete this software for a copy. Stl file blender and thingiverse all the stl files using a screenshot? Another one modifing thingiverse model in blender is likely that. If we are in thingiverse object you to modeling are. Stl for not choose another source. The model in handy later. The correct dimensions then press esc to animation and exporting into many brands and exported file with the.
    [Show full text]
  • Learning Virtualdub the Complete Guide to Capturing, Processing, and Encoding Digital Video
    Learning VirtualDub The complete guide to capturing, processing, and encoding digital video Georgios Diamantopoulos Sohail Salehi John Buechler Birmingham - Mumbai Learning VirtualDub The complete guide to capturing, processing, and encoding digital video Copyright © 2005 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, Packt Publishing, nor its dealers or distributors will be held liable for any damages caused or alleged to be caused either directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First edition: April 2005 Published by Packt Publishing Ltd. 32 Lincoln Road Olton Birmingham, B27 6PA, UK. ISBN 1-904811-35-3 www.packtpub.com Cover Design by www.visionwt.com Credits Authors Layout Georgios Diamantopoulos Paramita Chakrabarti Sohail Salehi John Buechler Indexer Ashutosh Pande Commissioning Editor David Barnes Proofreader Chris Smith Technical Editors Ashutosh Pande Cover Designer Paramita Chakrabarti Helen Wood About the Authors Georgios Diamantopoulos was born in February 1984. Born and raised in Corinth, Greece, his scientific inclination towards computers was evident in his teenage years and he pursued his dreams by moving to Birmingham, UK to study Computer Systems Engineering in 2001.
    [Show full text]
  • Remediating Gower's Confessio Amantis in Machinima
    Accessus Volume 2 | Issue 1 Article 2 2015 “For it Acordeth Noght to Kinde”: Remediating Gower’s Confessio Amantis in Machinima Sarah L. Higley University of Rochester, NY, [email protected] Follow this and additional works at: http://scholarworks.wmich.edu/accessus Part of the English Language and Literature Commons, European Languages and Societies Commons, Film and Media Studies Commons, and the Medieval Studies Commons Recommended Citation Higley, Sarah L. (2015) "“For it Acordeth Noght to Kinde”: Remediating Gower’s Confessio Amantis in Machinima," Accessus: Vol. 2: Iss. 1, Article 2. Available at: http://scholarworks.wmich.edu/accessus/vol2/iss1/2 This Article has been accepted for inclusion in Accessus by the editorial board of the journal and administrator of ScholarWorks at WMU. For more information, please contact [email protected]. Higley: Remediating Gower's Confessio 1 “For it Acordeth Noght to Kinde”: Remediating Gower’s Confessio Amantis in Machinima Sarah L. Higley Vimeo https://vimeo.com/98521054 or: YouTube: https://www.youtube.com/watch?v=FcliUQvo_cY&list=UUd_irf-08NAMyz8m37QXVSA Introduction The “medieval film” is a phrase often heard across academia, and it has double meaning for me. It primarily refers, of course, to film forms of “neomedievalism,” or cinematic remediation of medieval subject matter and literature. However, I hear in it, too, a film made in the Middle Ages, if that were possible, most resonantly in the title of the 2014 anthology The Medieval Motion Picture,1 as though illuminators were somehow bringing their illustrations to life within 1. The Medieval Motion Picture: The Politics of Adaptation, ed.
    [Show full text]
  • 0789737973 Sample.Pdf
    YouTube® for Business: Online Video Marketing for Any Business Associate Publisher Greg Wiegand Copyright © 2009 by Pearson Education, Inc. All rights reserved. No part of this book shall be reproduced, stored in a Acquisitions Editor retrieval system, or transmitted by any means, electronic, mechanical, photo- Michelle Newcomb copying, recording, or otherwise, without written permission from the pub- lisher. No patent liability is assumed with respect to the use of the information contained herein. Although every precaution has been taken in Development Editor the preparation of this book, the publisher and author assume no responsibil- Kevin Howard ity for errors or omissions. Nor is any liability assumed for damages resulting from the use of the information contained herein. Managing Editor ISBN-13: 978-0-7897-3797-7 Patrick Kanouse ISBN-10: 0-7897-3797-3 Library of Congress Cataloging-in-Publication Data Project Editor Mandie Frank Miller, Michael, 1958- Copy Editor YouTube for business : online video marketing for any business / Mike Henry Michael Miller. p. cm. Indexer Includes index. Brad Herriman ISBN 978-0-7897-3797-7 1. Internet marketing. 2. Webcasting. 3. YouTube (Firm) I. Title. Technical Editor HF5415.1265.M556 2009 John Rice 658.8'72--dc22 Publishing Coordinator 2008028344 Cindy Teeters Printed in the United States of America First Printing: August 2008 Designer Trademarks Anne Jones All terms mentioned in this book that are known to be trademarks or service Composition marks have been appropriately capitalized. Que Publishing cannot attest to the accuracy of this information. Use of a term in this book should not be Bronkella Publishing regarded as affecting the validity of any trademark or service mark.
    [Show full text]
  • Virtualdubmod Help
    VirtualDubMod is a project that was born when suddenly a lot of modifications to the original VirtualDub by Avery Lee sprung up, mainly on the Doom9 forums. Some people got tired of needing several diffrent modified VirtualDub executables, so the idea arose to put them all together into a single app, VirtualDubMod. The founders were: VirtualDubOGM - Cyrius VirtualDubMPeg2 - Pulco-Citron VirtualDubAVS - Belgabor Extended features in VirtualDubMod 1.5.x Nb : VirtualDubMod now has a basic Unicode support. However this support is only available in Windows versions that handle it natively (2k/XP handle it). Win9x doesn't handle Unicode natively and so you won't have Unicode support in VirtualDubMod with this OS. This short documentation give you some information on the following subjects in VirtualDubMod 1.5.x : Preferences AVI Information Image formats Streams menu Multiple streams handling Comments and chapters handling Previewing and Saving Batch mode Miscellanea Preferences Since version 1.5.4.x VirtualDubMod also uses an extended tree list thanks to which you can access all its preferences. Depending on which kind of preference it is, clicking on an item in the tree will make appear a combo box or an edit box (optionally an icon to popup a file selector). For enabling / disabling preferences (checkbox / radio button) click on the checkbox or radio button. The default video mode (Direct stream copy, Fast recompress, Normal recompress, Full processing mode) in which VirtualDubMod starts can be changed in the Main preferences. The Display preferences let you choose to enable/disable by default the Display input video and Display output video of the Options menu.
    [Show full text]