Lidar- and AR-Based Monitoring of Evolved Building Façades Upon Zoning Conflicts
Total Page：16
File Type：pdf, Size：1020Kb
sensors Article LiDAR- and AR-Based Monitoring of Evolved Building Façades upon Zoning Conflicts Naai-Jung Shih * and Yi Chen Department of Architecture, National Taiwan University of Science and Technology, Taipei 106, Taiwan; [email protected] * Correspondence: [email protected]; Tel.: +886-(2)-27376718 Received: 13 September 2020; Accepted: 25 September 2020; Published: 1 October 2020 Abstract: Zoning conflicts have transformed Old Street fabrics in terms of architectural style and construction material in Lukang, Taiwan. This transformation should be assessed as a contribution to digital cultural sustainability. The objective of this study was to compare the evolved façades resultant from the changes made by the development of architectural history and urban planning. A combination of 3D scan technology and a smartphone augmented reality (AR) app, Augment®, was applied to the situated comparison with direct interaction on-site. The AR application compared 20 façades in the laboratory and 18 façades in four different sites using a flexible interface. The comparisons identified the correlation of evolved façades in real sites in terms of building volumes and components, pedestrian arcades on store fronts, and previous installations. The situated comparisons were facilitated in a field study with real-time adjustments to 3D models and analyses of correlations across details and components. The application of AR was demonstrated to be effective in reinstalling scenes and differentiating diversified compositions of vocabulary in a remote site. Keywords: markerless AR; LiDAR; old street heritage; building façade; architecture style; situated study; smartphone 1. Introduction The Old Street in Lukang is replete with historical buildings (Figure1). Lukang had originally been reconstructed from a harbor before it assumed its current fabric. Its historical identity was reshaped from a place that could hardly achieve a thorough view of the sky, to a representative icon of cultural sustainability. Its tangible pattern of development can be traced back over 300 years. The fabric, which was created from the beginning to the current setting of support, was reshaped in an evolved manner. The long-term developed urban fabric has transformed the township with the landscape of the streets being reconstructed and conserved. This evolution, which occurred within each block, dramatically impacted the construction of building style. This transformation should be assessed as a fulfillment of cultural sustainability. The assessment of heritage can benefit from rapid technological advancements in such fields as human computer interaction, information modeling, construction, situated learning, tourism, and 3D data acquisition. For example, augmented reality (AR) has been widely and successfully applied in recent years. AR enables real and virtual information in an actual environment to be combined, registered, and interacted upon in real-time [1–3]. This interaction is particularly important in tacit knowledge, which is typically challenging to articulate to others [4]. Similar to case studies of environments prior to architecture design, AR can present virtual content with the real world around the user [5]. This virtual content can be created from models originated from the physical world with a high level of realistic appearance. The integration of three different modeling methodologies (TLS, GPR, 3D modelling) were Sensors 2020, 20, 5628; doi:10.3390/s20195628 www.mdpi.com/journal/sensors Sensors 2020, 20, 5628 2 of 26 developed to create an educational app [6]. Users can explore reality with new layers of information Sensorsusing 2020 mobile, 20, x AR FOR applications PEER REVIEW for a novel interactive and highly dynamic experience [7,8]. 2 of 26 Figure 1. StreetStreet scenes scenes of of the the Old Old Street Street in Lukang, Taiwan. ThisAR applicationstransformation have should been be successfully assessed as a implemented fulfillment of incultural a broad sustainability. range ofdisparate The assessment fields, ofincluding heritage navigation,can benefit education,from rapid industry,technological medical advancements practice, andin such landscape fields as architecture human computer [9–13]. interaction,Technically, information huge sets of modeling, input data construction, have been situated registered learning, to reconstruct tourism, accurateand 3D data 3D cityacquisition. models Forfor ARexample, applications augmented [14]. reality Moreover, (AR) has extended been wide realityly and and successfully informative applie modelsd in have recent been years. created AR enablesfor architectural real and heritagevirtual frominformation scans toin building an actual information environment modeling to be (BIM),combined, virtual registered, reality (VR),and interactedand AR [15 upon]. Heritage in real-time building [1–3]. information This interaction modeling is particularly (HBIM) embodies important complexity in tacit knowledge, in surveying which and ispreservation typically challenging [16]. Geological to articulate view of to relics others and [4]. landscapes Similar to enhances case studies the social of environments awareness of prior culture to architectureand the protection design, of AR heritage can present [17]. virtual content with the real world around the user [5]. This virtual contentConstruction-specific can be created from studiesmodels wereoriginated made from that the focused physical on world safety with with a high the finerlevel of details realistic of VRappearance./AR environment The integration to attract of three significant different attention modeling [18 ],methodologies to simulate the(TLS, environmental GPR, 3D modelling) context wereand spatio-temporal developed to create constraints an educational of various processesapp [6]. [Users19], to can conduct explore structural reality analysiswith new to determinelayers of informationbehavior under using di ffmobileerent loadingAR applic conditionsations for of a novel interactive interactive 3D models and highly [20], todynamic setup tasks experience on a variety [7,8]. of machineAR applications tools based have on target been markers successfully [21], andimplemented to contribute in toa onlinebroad educationrange of disparate for management fields, includingand engineering navigation, [22]. Dimensional education, industry, inconsistencies medical of building practice, design and amonglandscape participants architecture in VR [9–13]. seem Technically,to be partially huge alleviated sets of throughinput data AR have by adding been regi a realstered object to thatreconstruct is accurately accurate scaled 3D [city23]. models for AR applicationsAR offers practical [14]. Moreover, advantages extended because itrealit allowsy and educators informative to use models real objects. have Education-relatedbeen created for architecturalstudies were heritage carried from out focusing scans to onbuilding STEM info [24rmation], m-learning modeling (mobile (BIM), learning), virtual reality and traditional(VR), and ARe-learning [15]. Heritage (electronic building learning) information [25], to enablemodeling students (HBIM) to locateembodies any comple object representedxity in surveying in a given and preservationspace [26], to [16]. achieve Geological a better view understanding of relics and of la culturalndscapes aspects enhances [27], tothe enhance social awareness laboratory of learning culture andenvironments the protection [28], of and heritage to develop [17]. new learning paradigms in outdoor co-space and implement a mobileConstruction-specific AR system for creative studies design were courses made that [29]. focu 3Dsed modules on safety can with be di thefficult finer to details obtain, of and VR/AR their environmentoperation should to notattract be toosignificant complicated attention in use in[18], situated to simulate learning the [30]. environmental The link between context real world and spatio-temporalobjects and digital constraints media should of various bring aprocesses new and beneficial[19], to conduct quality structural for learning analysis [31]. to determine behaviorVR andunder AR different have been loading of great conditions interest toof tourisminteractive researchers 3D models [32 [20],,33]. to Tourism setup tasks experiences on a variety can ofbe machine transformed tools bybased these on technologiestarget markers into [21], virtual and to tours contribute and augmented to online education tourism experiencesfor management [34]. andConcerning engineering tourism, [22]. ARDimensional can supply inconsistencies tourists with detailedof building and design visceral among local informationparticipants [35in– VR38]. seemIn addition, to be partially the utilities alleviated of VR through and AR AR in by communication adding a real object and engagement that is accurately can be scaled understood [23]. or improvedAR offers through practical interactions advantages with because traditional it allows 3D scenes educators or entities. to use To real achieve objects. this, Education-related the information studiesmodel shouldwere carried be extended out focusing to a direct on manipulation STEM [24], m-learning of 3D building (mobile façades learning), which possessand traditional a strong e-learningrelation to the(electronic past development learning) [25], of local to enable urban students architecture. to locate The exemplificationany object represented of components in a given can space [26], to achieve a better understanding of cultural aspects [27], to