CONTEXT IN GEOGRPAHIC DATA: HOW TO EXPLORE, EXTRACT AND ANALYZE DATA FROM SPATIAL VIDEO AND SPATIAL VIDEO GEONARRATIVES A dissertation submitted to Kent State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy by Jayakrishnan Ajayakumar August 2019 © Copyright All rights reserved Except for previously published materials Dissertation written by Jayakrishnan Ajayakumar B.Tech, Cochin University of Science and Technology, 2009 M.S., Kent State University, 2015 Ph.D., Kent State University, 2019 Approved by Dr. Andrew Curtis , Chair, Doctoral Dissertation Committee Dr. Jacqueline W. Curtis , Members, Doctoral Dissertation Committee Dr. Eric Jefferis Dr. Michael Leitner Dr. Ye Zhao Accepted by Dr. Scott C. Sheridan , Chair, Department of Geography Dr. James L. Blank , Dean, College of Arts and Science TABLE OF CONTENTS TABLE OF CONTENTS ............................................................................................................... iii LIST OF FIGURES .........................................................................................................................v LIST OF TABLES ......................................................................................................................... xi ACKNOWLEDGEMENTS .......................................................................................................... xii CHAPTERS I. Introduction ..........................................................................................................................1 II. Background ..........................................................................................................................6 III. Exploring Spatial Videos ...................................................................................................14 Camera Player ....................................................................................................................15 Spatial Video Player (SVP) ..............................................................................................25 Discussions ........................................................................................................................35 IV. Spatio-Temporal Exploration of Spatial Videos ................................................................37 Spatial Video Library (SVL) ............................................................................................38 Illustrative Examples .........................................................................................................48 Discussions ........................................................................................................................53 V. The Use of Geonarratives to Add Context to Fine Scale Geospatial Research .................55 Design and Components ....................................................................................................60 An Empirical Illustration: A Spatial Video Geonarrative in Joplin, Missouri ..................67 Discussions ........................................................................................................................76 iii VI. GeoCluster: A Software for Extracting Spatial Patterns From Spatial Video Geonarratives ............................................................................................................................................80 Spatial Filter .......................................................................................................................81 Workflow and Technical Implementation .........................................................................92 Empirical Illustration .........................................................................................................94 Discussions ........................................................................................................................98 VII. Addressing the Data Guardian and Geospatial Scientist Collaborator Dilemma: How to share health records for spatial analysis while maintaining patient confidentiality ........100 Design and Algorithms ....................................................................................................105 Workflow and Technical Implementation .......................................................................109 Experiments .....................................................................................................................111 Results ..............................................................................................................................113 Discussions ......................................................................................................................119 VIII. CONCLUSION AND FUTURE WORK ........................................................................123 REFERENCES ............................................................................................................................129 iv LIST OF FIGURES Figure 1. GPX file example with a single-track point’s latitude and longitude represented as an attribute and the media time as an extension tag ..........................................................................20 Figure 2. Synchronized video and spatial data. The synchronized data is represented as a set of tuples used for spatio-temporal querying. ......................................................................................20 Figure 3. GPS path for the synchronized video. The orange lines indicate missing path information.. ...................................................................................................................................21 Figure 4. Category creation for mapping. A) create a category B) edit category for a mapped spatial object C) create a spatial object and assign category D) spatial video for mapping .. .......22 Figure 5. Complete work flow for Camera Player .. ......................................................................24 Figure 6. Complete workflow for the synchronizer module .. .......................................................28 Figure 7. User interface for the synchronizer module with map for the GPS path, and embedded YouTube player to display the spatial videos .. .............................................................................28 Figure 8. Visualization module showing three videos synchronized with a single GPS path. .. ...30 Figure 9. GPS Creator. The marker on the map indicate the nodes of the new path, while the polyline shows the original GPS reference path. .. ........................................................................32 Figure 10. Digitizer module used for mapping objects seen in the spatial videos... ......................34 v Figure 11. Adding categories in the Digitizer. A) creating a new category B) the green marker represents a categorized mapped point C) spatial video display to enhance mapping... ...............35 Figure 12. Workflow diagram for the crawler. The input is a folder and output is an index file... ........................................................................................................................................................40 Figure 13. Index JSON file containing when the video was created, the media time and the corresponding GPS coordinates and the GPS data bounds... .........................................................40 Figure 14. R-tree for spatial indexing. A, B, and C denotes nodes (bounding boxes), and d, e, f, g, and h are the leaves.... ................................................................................................................42 Figure 15. User interface for Explorer... ........................................................................................43 Figure 16. A) Grid based heatmap showing spatial distribution of spatial videos. B) Study area selection. C) Spatial query with circular region as query object... ................................................44 Figure 17. Results of a query with year, videos and sections... .....................................................45 Figure 18. Results of a sample video section selection. The video is at the selected video section time and the red dot on the map indicates the corresponding GPS position..................................45 Figure 19. A dialog box to add information to a geotagged image.... ...........................................47 Figure 20. An image cart with geotagged images..........................................................................47 Figure 21. Geotagged images from the spatial video library opened in Google Earth as a KML... ........................................................................................................................................................48 Figure 22. A spatial point query with a buffer of 15 meters.... ......................................................49 vi Figure 23. Frames for a spatial point query for years A) 2011, B) 2012, C) 2013, D) 2015, E) 2016................................................................................................................................................50 Figure 24. Results of a frame-based query. A) The source frames are 2011, B) 2012, C) 2013, D) 2014, E) 2015, F) 2016... ...............................................................................................................51 Figure 25. Geonarrative sentences added to the spatial video library as an external dataset... .....52 Figure 26. A) A geonarrative sentence location,