TECHNICAL REPORT DOCUMENTATION PAGE for Individuals with Sensory Disabilities, This Document Is Available in Alternate TR0003 (REV 10/98) Formats
Total Page:16
File Type:pdf, Size:1020Kb
STATE OF CALIFORNIA • DEPARTMENT OF TRANSPORTATION ADA Notice TECHNICAL REPORT DOCUMENTATION PAGE For individuals with sensory disabilities, this document is available in alternate TR0003 (REV 10/98) formats. For information call (916) 654-6410 or TDD (916) 654-3880 or write Records and Forms Management, 1120 N Street, MS-89, Sacramento, CA 95814. 1. REPORT NUMBER 2. GOVERNMENT ASSOCIATION NUMBER 3. RECIPIENT'S CATALOG NUMBER CA17-2996 4. TITLE AND SUBTITLE 5. REPORT DATE Research and Support for MTLS Data Management and Visualization September 30, 2016 6. PERFORMING ORGANIZATION CODE AHMCT Research Center, UC Davis 7. AUTHOR 8. PERFORMING ORGANIZATION REPORT NO. Travis Swanston, Kin Yen, Stephen Donecker, Bahram Ravani, and Ty Lasky UCD-ARR-16-09-30-01 9. PERFORMING ORGANIZATION NAME AND ADDRESS 10. WORK UNIT NUMBER AHMCT Research Center UCD Dept. of Mechanical & Aerospace Engineering Davis, California 95616-5294 11. CONTRACT OR GRANT NUMBER IA65A0560, Task 2996 13. TYPE OF REPORT AND PERIOD COVERED 12. SPONSORING AGENCY AND ADDRESS Final Report California Department of Transportation October 2015 – September 2016 P.O. Box 942873, MS #83 Sacramento, CA 94273-0001 14. SPONSORING AGENCY CODE Caltrans 15. SUPPLEMENTARY NOTES 16. ABSTRACT This report documents the research project “Research and Support for MTLS Data Management and Visualization.” The primary goal of the project was to support Caltrans District 4 in their upgrade and enhancement efforts for Mobile Terrestrial Laser Scanning (MTLS) data management. The research included investigating data storage, management, and organization. It also included developing software tools for automated data cataloging to a geospatial-enabled web-based portal to view MTLS data availability. This research expanded District 4’s leading-edge MTLS capabilities. 17. KEY WORDS 18. DISTRIBUTION STATEMENT Mobile Terrestrial Laser Scanning (MTLS), Mobile LiDAR, No restrictions. This document is available to the Light Detection and Ranging (LiDAR), Mobile mapping, Data public through the National Technical Information management Service, Springfield, Virginia 22161. 19. SECURITY CLASSIFICATION (of this report) 20. NUMBER OF PAGES 21. COST OF REPORT CHARGED Unclassified 65 Reproduction of completed page authorized DISCLAIMER The research reported herein was performed by the Advanced Highway Maintenance and Construction Technology (AHMCT) Research Center, within the Department of Mechanical and Aerospace Engineering at the University of California – Davis, for the Division of Research, Innovation and System Information (DRISI) at the California Department of Transportation. AHMCT and DRISI work collaboratively to complete valuable research for the California Department of Transportation. The contents of this report reflect the views of the author(s) who is (are) responsible for the facts and the accuracy of the data presented herein. The contents do not necessarily reflect the official views or policies of the STATE OF CALIFORNIA or the FEDERAL HIGHWAY ADMINISTRATION. This report does not constitute a standard, specification, or regulation. The contents of this report do not necessarily reflect the official views or policies of the University of California. This report does not constitute an endorsement of any products or services described herein. For individuals with sensory disabilities, this document is available in Braille, large print, audiocassette, or compact disk. To obtain a copy of this document in one of these alternate formats, please contact: the Division of Research, Innovation and System Information, MS-83, California Department of Transportation, P.O. Box 942873, Sacramento, CA 94273-0001. Advanced Highway Maintenance and Construction Technology Research Center Department of Mechanical and Aerospace Engineering University of California at Davis Research and Support for MTLS Data Management and Visualization Travis Swanston, Kin Yen, Stephen Donecker, Bahram Ravani & Ty A. Lasky: Principal Investigator Report Number: CA17-2996 AHMCT Research Report: UCD-ARR-16-09-30-01 Final Report of Contract: IA65A0560, Task 2996 September 30, 2016 California Department of Transportation Division of Research, Innovation and System Information Research and Support for MTLS Data Management and Visualization ACKNOWLEDGMENTS The authors thank the California Department of Transportation (Caltrans) for their support, in particular Nelson Aguilar, Rebecca Boyer, Kourosh Langari, Kirsten Lawrence, Carlos Sablan, and Christopher Urkofsky of Caltrans District 4 Division of Right of Way and Land Surveys, Samuel Retta and Jim Mao of Caltrans District 4 IT, John Gilmore and Paul Fredrickson with the Office of Land Surveys, and Arvern Lofton with the Division of Research, Innovation and System Information. The authors acknowledge the dedicated efforts of the AHMCT team who have made this work possible. ii Research and Support for MTLS Data Management and Visualization ABSTRACT This report documents the research project “Research and Support for MTLS Data Management and Visualization.” The primary goal of the project was to support Caltrans District 4 in their upgrade and enhancement efforts for Mobile Terrestrial Laser Scanning (MTLS) data management. The research included investigating data storage, management, and organization. It also included developing software tools for automated data cataloging to a geospatial-enabled web-based portal to view MTLS data availability. This research expanded District 4’s leading-edge MTLS capabilities. iii Research and Support for MTLS Data Management and Visualization EXECUTIVE SUMMARY This research study focused on support for Caltrans District 4 (D4) in their upgrade and enhancement efforts for Mobile Terrestrial Laser Scanning (MTLS) data management. The research included investigating data storage, management, and organization. It also included developing software tools for automated data cataloging to a geospatial-enabled web-based portal to view MTLS data availability. Caltrans D4 has been acquiring MTLS data for several years both through consultant services and through the Caltrans MTLS system. D4 has reached a point where the storage, management, and organization of this data have become both critical and challenging. Through this research, the Advanced Highway Maintenance and Construction Technology (AHMCT) Research Center has investigated D4’s current data management situation and needs, developed targeted recommendations for D4’s immediate use, and developed automated data cataloging tools to assist D4’s MTLS data management. Research Objectives and Methodology There were two main objectives of this research study: first, to assess and understand Caltrans D4’s data management situation and needs, and second, to develop software tools for automated data cataloging of MTLS data availability for a web-based GIS portal. AHMCT researchers addressed the first objective by meeting with key D4 personnel, including representatives from Surveys and from Information Technology (IT). We held several meetings, which were also attended by the Division of Research, Innovation and System Information (DRISI), either in Oakland at the D4 district office or by teleconference and webinar. Through these discussions and the inspection of their file systems, we developed a clear understanding of the data size, the directory structure for each project, the contents of each project, and the physical configuration of the drives being used to store the data. Several problematic issues were identified through this process, and recommended actions were provided to D4 at the earliest possible time. AHMCT also provided assistance in consolidating and securing essential MTLS data that was spread across multiple external hard drives. The detailed findings and recommendations of this portion of the research are provided in this report. The second objective was met by working with D4 to define their needs for an automated data-cataloging tool. The tool, named LidarCrawl, is written in the Java programming language, and works with the PostgreSQL database with the PostGIS extension. This tool catalogs MTLS data for a web-based portal to investigate MTLS data availability. LidarCrawl greatly enhances D4’s ability to explore and manage its MTLS data. Software modules can be added to utilize the existing GIS IT infrastructures of other Caltrans districts or DRISI if the PostGIS database is not being used for their GIS database. Results and Recommendations This research resulted in a set of recommendations and executed actions to improve MTLS data management in Caltrans D4. As part of this effort, D4’s remaining MTLS data that was stored on external drives was located and copied into the NetApp system, significantly reducing iv Research and Support for MTLS Data Management and Visualization risks to this vital asset, including corruption or complete loss of data gathered with costly and labor-intensive efforts. The research also provided a software tool to automatically catalog existing MTLS data. This tool also provides a web-based viewing mode that allows a general Caltrans user to check the availability of MTLS data at a given geographic location. This tool greatly enhances the ability of Caltrans D4 to properly manage and discover their MTLS data. The following recommendations are made based upon the results of this research study: Leverage the recommendations and practices developed for D4 by seeing how they apply in other districts working with MTLS and adjusting them as needed. Work