Improving the accessibility of underwater cultural heritage through digital technologies

Prof. Fabio Bruno Agenda

• Presentation

• 3D Recording process

• Dry Visit in Virtual Reality

• Underwater Augmented Reality

• Assited survey and documentation Presentation

• 13 Departments • 900 Professors and Researchers • 750 technical and administrative staff • 30.000 students Presentation

Underwater Underwater 3D and Underwater communication and Augmented Reality mechatronics localization

Preservation and dissemination of Underwater Cultural and Natural Heritage Presentation: ongoing projects

• iMARECULTURE - iMmersive serious games and Augmented REality as tools to raise awareness and access to European underwater CULTURal heritagE Horizon 2020 Call: H2020-SC6-CULT-COOP-2016-2017. Lead Partner: Cyprus University Of Technology. www.imareculture.eu • BLUEMED - Plan/test/coordinate Underwater Museums, Diving Parks and Knowledge Awareness Centres in order to support sustainable and responsible tourism development and promote Blue growth in coastal areas and islands of the Mediterranean. www.bluemed. Programme Interreg Mediterranean. interreg-med.eu Lead Partner: Regional Development Fund of the Region of Thessaly (Greece).

• Lab4Dive - Mobile Smart Lab for Augmented Archaeological Dives EASME (European Agency for SMEs) Call EASME/EMFF/2016/1.2.1.4 “BLUE-LABS”. Lead partner: Atlantis Consulting, Thessaloniki (Greece). www.lab4dive.com • MOLUX – Mobile Lab for Underwater Exploration POR Calabria 2014-2020 Lead Partner: 3D Research

• DIVESAFE – Integrated system for scientific and environmental underwater surveys, with advanced health and safety feaures www.divesafe.eu EASME (European Agency for SMEs) Call “BLUE-ECONOMY” Lead partner: Atlantis Consulting, Thessaloniki (Greece). Tourism and Underwater Cultural Heritage

• 2001 UNESCO Convention on the Ph: MIBACT ISCR Protection of Underwater Cultural Heritage: – “The preservation in situ of underwater cultural heritage shall be considered as the first option before allowing or engaging in any activities directed at this heritage.” • Underwater Archaeological Parks represent a unique opportunity for the development of coastal area because: – Diving in the Med is possible almost 9 months/year – Diving tourism is sustainable also by minor destinations – 24 million certified divers in the world – 800.000 Europeans divers each year make one trip with 10 night-outs spending more than 1,4 billion Euros annually 3D Recording of Underwater CH for VR&AR

• Methodology

Opto-acoustic data Data fusion and 3D Site preparation 3D Reconstruction VR&AR acquisition modelling Site Preparation Images acquisition

Video recorded for the BLUEMED Project – courtesy of Greek Minister of Culture and Sport, Ephorate of Underwater Antiquities Images enhancement tool developed in iMARECulture

Freeware tool with 5 different algorithms available on: www.imareculture.eu Acoustic surveying Acoustic surveying with an Autonomous Surface Vehicle Merging optical and acoustic data

An integrated optical and acoustic survey of the underwater archaeological site allow us to obtain a multi- resolution textured 3D model of the underwater scenario.

Optical survey Acoustic survey

Multi-resolution textured 3D model Merging optical and acoustic data

Multi-resolution textured 3D model (Surface of 35 million triangles) Dry Visit in Virtual Reality From 3D model to Virtual Reality

Add the coastal landscape From 3D Model to Virtual Reality

Surface of the sea, visible coast-line, sky, additional elements (buoys, boats, etc.) From 3D Model to Virtual Reality

Underwater flora e fauna , Point of Interests (POIs), graphical effects (turbidity, refractions, fog, caustics) Providing contents… and fun

Diving buddy Interaction with POIs (text/audio/etc.)

360° video storytelling Switch from present to past VR systems

VR semi-immersive visualization • HD monitor based on passive 3D technology. • Controller based on a multi-touch screen tablet.

VR immersive visualization • HMD (head mounted display) technology. • Wireless handheld controller. Visualization and Controller Modules Knowledge Awareness Center in Amaliapolis (Greece) Knowledge Awareness Center in Amaliapolis (Greece) Virtual Diving at the Peristera Shipwreck (Sporades, Greece) iMARECulture Pilot site The underwater archaeological park of Baiae

The Underwater Archaeological Park of Baiae is located 15 Km east of Naples iMARECulture Pilot site: The underwater archaeological park of Baiae iMARECulture Baiae Pilot – Villa con Ingresso a Protiro

Images courtesy of MIBACT - ISCR iMARECulture Baiae Pilot – Villa con Ingresso a Protiro

Photogrammetric 3D model produced by MIBACT-ISCR Baiae Pilot – Villa con Ingresso a Protiro Hypotetical recostruction made under the supervision of MIBACT-ISCR

iMARECulture received funding from the EU-H2020 programme. GA No. 727153. Virtual Diving in Baiae at the «Villa con ingresso a protiro» Underwater Augmented Reality

Image courtesy of MIBACT-ISCR and Parco Archeologico dei Campi Flegrei Traditional underwater itinerary Underwater tablets and smartphones

• ValsTech

• Alltab • iDive

• Divevolk • Easydive Underwater tablet with localization • The underwater tablet can be coupled with a waterproof case containing a control board and the electronics of the localization system • The two devices communicate through a wireless interface Underwater acoustic localization

Setup 1: 4 fixed beacons (LBL)

• Long baseline = good accuracy • Two-way ranging = slow update Underwater acoustic localization

Setup 2: Surface buoy + USBL Setup 3: ASV + (U)SBL

• Ultra-short baseline = poor accuracy • Accuracy depends on GPS and IMU Underwater acoustic localization

Setup 4: 4 fixed transducers with one control electronics (SBL)

• Four acoustic transducers are placed on a pole fixed to the sea bottom on a known GPS position

• Short-baseline = acceptable accuracy • One-way ranging = No delay for multiple tablets Underwater tablet with acoustic localization

The tablet in a waterproof case is equipped with an acoustic localization system Underwater Augmented Reality - APP INTERFACE Underwater Augmented Reality in Baiae

iMARECulture received funding from the EU-H2020 programme. GA No. 727153. Tests in Baiae – June 2018 BLUEMED testing of the augmented diving

Testing multi-users simultaneous localization on the Kikintos shipwreck (Greece) in collaboration with the Greek Minister of Culture and Sports – Ephorate of Underwater Antiquities User Interface App: «Georeferenced photos» Assited survey and documentation Lab4Dive – Mobile Smart Lab for Augmented Archaeological Dives

Acoustic transducer Control Electronics

Co – funded by the EMFF programme of the European Union External Camera Lab4Dive – Main functionalities

• Assists the diver navigation, especially in bad visibility condition; • Improves the efficiency of the underwater surveys; • Simplifies the geo-localization of objects, photos and 3D models; • Supports the photogrammetric recording; • Allows the mission director to easily plan the mission and manage the data acquired during the various dives. WORKFLOW of L4D system

1. Plan a mission on the mission manger and upload it on the tablet WORKFLOW of L4D system - Mission manager

1. Log-in 2. Create new mission 3. Select the mission site 4. Import an existing mission (optional) 5. Choose a bathymetry (optional) 6. Create targets or import targets from previous missions 7. Create mission path (optional) 8. Save the mission on the cloud WORKFLOW of L4D system

2. Perform the survey WORKFLOW of L4D system

3. Upload and analyze the survey results 4. Create photogrammetric geo-referenced 3D model Field testing with IENAE archaeologists Mycenaean shipwreck at Modi (ca 1200 BC) at 25-30 m depth Users training Testing and feedback from the users

• 15 users (archeologists, photographers, surveyors, etc) have tested the tablet in 4 weeks of fieldwork on 2 different sites • Feedback has been collected orally and by questionnaires • The system is considered useful for surveying, recording the position of a site or finds, describe first archaeological observations, perform photogrammetric surveys. • The accuracy of the localization is not enough for documenting excavation. DIVESAFE

Integrated system for scientific and environmental underwater surveys, with advanced health & safety features

PROJECT PARTNERS

Co-funded by the EMFF programme of the European Union DIVESAFE

The DiveSafe system is based on the following components: 1. A Diver Propulsion Vehicle (DPV) equipped with a mainboard and various sensors, manageable from an underwater tablet; 2. an underwater tablet and Apps for surveying, navigation and mission planning; 3. an underwater acoustic positioning and communication system; 4. wearable sensors to monitor the physiological status of divers; 5. a remote server that host the cloud database.

Co-funded by the EMFF programme of the European Union VR Dry Visit - conclusions and open challenges

• Conclusions – VR is an excellent tool to disseminate UCH – Engage people with funny and educative apps

• Open Challenges – Provide a lot of different contents (audio, video, 3D, etc.) in a seamless way – Assign goals and task to do in order to motivate people to play and learn – Teach to be responsible tourists and divers UWAR - Conclusions and open challenges

• Conclusions – On-map localization is useful in large sites or when turbidity complicates orientation and navigation – Tablet provides contents related to the diver position – AR is exciting for submerged ruins

• Open Challenges – Need for faster, cheaper and more accurate acoustic localization – Improve ergonomics (reduce size, increase screen contrast, etc.) Thanks for your attention

Fabio Bruno Phone: +39 0984 494623 mob.: +39 320 4258033 email: [email protected] fabiobrunounical

@fabiounical www.3dresearch.it www.tech4sea.it

www.diveinhistory.com www.bluemed.interreg-med.eu www.imareculture.eu

www.visas-project.eu www.divesafe.eu www.lab4dive.com www.comasproject.eu