<<

ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

Annual Reviews in Control xxx (xxxx) xxx

Contents lists available at ScienceDirect

Annual Reviews in Control

journal homepage: www.elsevier.com/locate/arcontrol

Review article

Challenges and future trends in marine

∗ Enrica Zereik a, , Marco Bibuli a, Nikola Miškovi c´ b, Pere Ridao c, António Pascoal d a CNR - Institute of Marine , Via De Marini 6, Genova, 16149, Italy b University of Zagreb, Faculty of and Computing, Unska 3, Zagreb, 10 0 0 0, Croatia c University of Girona, Girona, 17071, Spain d Laboratory of Robotics and Engineering Systems / Institute for Systems and Robotics, Instituto Superior Tecnico, Univ. Lisbon, Av. Rovisco Pais, 1 -Torre Norte, Lisboa, 1049-001, Portugal

a r t i c l e i n f o a b s t r a c t

Article history: Spawned by fast paced progress in marine science and technology, the past two decades have witnessed Received 5 July 2018 growing interest in ocean exploration and exploitation for scientific and commercial purposes, the de-

Revised 30 September 2018 velopment of technological products for the maritime and offshore industries, and a host of other ac- Accepted 2 October 2018 tivities in which the marine environment takes center stage. In this context, marine robotics has steadily Available online xxx emerged as a key enabling technology for the execution of increasingly complex and challenging missions Keywords: at sea. Intensive research and development in this field have led to major advances and shown unequiv- Marine robotics ocally the effectiveness and reliability of marine robotics solutions in several domains. This progress goes Field applications hand in hand with the availability of increasingly sophisticated acoustic networks for multiple, coopera- Future trends tive missions involving surface and underwater robots. At the root of this trend is the fruitful dialogue between robotic systems developers and end-users with the capacity to convert general mission objec- tives into functional and technical specifications that serve as application-driven requirements for engi- neering development. The result is the tremendous progress observed in the consolidated methodologies and procedures adopted and the consequent impact on science, industry, and the society at large. In spite of the progress in the area, however many challenges must still be faced and novel applications will con- tinue to set further requirements for future generations of marine robots and their enabling systems. The time is therefore appropriate to overview recent trends in the field of marine robotics and assess their impact on several important application domains. With these objectives in mind, in the present paper we highlight key technological achievements in the field, analyze some of the shortcomings encountered, and indicate specific issues that warrant further research and development effort. To this end, we review a number of highly representative projects in the field, with due account for the theoretical frameworks upon which technological developments build upon. Finally, the paper concludes with an outlook on the future of marine robotics, both from a theoretical and practical standpoint, and describes recently initi- ated projects that hold promise for the development of advanced tools and systems for ocean exploration and exploitation. ©2018 Published by Elsevier Ltd.

Contents

1. Introduction ...... 2 2. Domain overview ...... 3 2.1. Scientific ...... 3 2.2. Industrial ...... 3 2.3. Transport ...... 3 2.4. Human interaction ...... 4 3. Relevant projects ...... 4 3.1. Scientific ...... 4

∗ Corresponding author. E-mail address: [email protected] (E. Zereik). https://doi.org/10.1016/j.arcontrol.2018.10.002 1367-5788/© 2018 Published by Elsevier Ltd.

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

2 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

3.1.1. MORPH Project...... 5 3.1.2. ROBUST Project ...... 5 3.1.3. Wimust project ...... 5 3.1.4. UNEXMIN Project ...... 6 3.1.5. BRIDGES Project ...... 6 3.1.6. NOPTILUS Project ...... 6 3.1.7. AUTODROP Project...... 6 3.1.8. DIGITAL OCEAN Project...... 7 3.1.9. HYDRONET Project ...... 7 3.1.10. SHOAL Project ...... 7 3.1.11. SWARMs Project...... 7 3.2. Industrial - Autonomous intervention ...... 7 3.2.1. ALIVE Project ...... 8 3.2.2. SAUVIM Project...... 8 3.2.3. TRIDENT Project ...... 8 3.2.4. PANDORA Project ...... 9 3.2.5. OCEAN ONE...... 9 3.3. Transport ...... 9 3.3.1. CART Project ...... 9 3.3.2. MINOAS Project ...... 10 3.3.3. RITMARE Italian Flagship Project...... 10 3.4. Human-Robot interaction ...... 10 3.4.1. CO3AUVs project ...... 11 3.4.2. ICARUS and DARIUS projects ...... 12 3.4.3. CADDY Project...... 12 3.4.4. ARROWS Project ...... 12 3.4.5. DexROV project...... 12 3.4.6. IceClimaLizers project...... 13 4. Challenges...... 13 5. Future trends ...... 15 5.1. The Mesobot project, Dana Yoerger, WHOI, USA ...... 15 5.2. The C-Bot project, Pramod Maurya, CSIR-NIO, Goa, India ...... 15 5.3. Projects on Autonomous Ships, Vahid Hassani, NTNU, Norway ...... 16 5.4. Development of a multi-purpose autonomous surface vehicle, Jinwhan Kim, KAIST, Korea ...... 17 6. Conclusions ...... 17 Acknowledgement ...... 17 References ...... 17

1. Introduction observation, sampling, and persistent monitoring of the marine en- vironment.The types of operations required are difficult to be ac- The marine environment represents a challenging framework complished solely through sheer human effort. Thus the quest for for the exploitation of cutting-edge automation-related method- the use of advanced technological tools such as remotely operated ologies and technologies. The oceans cover more than 70% of the vehicles and fully autonomous robots to improve the capability to earth’s surface and support an estimated 90% of the life forms on enhance the human knowledge on such a wide and mysterious en- our planet. They constitute one of the main resources for food, vironment. employment, and economic revenue, and are a potential source Maritime and naval applications such as ship monitoring and of still unknown living and mineral resources, as well as alterna- maintenance, emergency operation support, offshore inspections tive and sustainable energies. From a scientific point of view, the and other related activities can also benefit from scientific and deep ocean is thought to hold the secret to the origin of life. At technological improvements on advanced technologies for ocean the same time, the oceans also harbor a vast cultural heritage in exploration. the forms of archaeological sites yet to be explored. However, the As in the case of space exploration, the ocean environment oceans remain largely unknown, with two thirds of them remain- places formidable challenges to the development of autonomous ing still unexplored. This is especially true in the case of the deep and/or persistent systems for exploration and sampling. In fact, en- ocean: deep, dark, vast, and subject to tremendous bar pressure, gineers and scientists must strive to meet the extremely tight de- the bottom of the oceans is the largest component of the surface sign constraints imposed by the harsh conditions that both surface of our planet and yet it is also the least known. and underwater platforms have to face. Among these, the following Clearly, much work remains to be done to have a synoptic view are worth stressing: of the open sea and the deep oceans over extended areas of inter- est and to exploit the resources available in a sustainable manner. 1. High pressures and low temperatures related to extremely deep This will require the development of new methods and tools for or harsh environments (e.g., abyssala and polar areas) require ocean exploration and exploitation and the reinforcement of strong suitable components and water-tight containers and equipment. cooperative links among universities, research institutes, compa- 2. Underwater communications mandate the use of acoustic de- nies, and stakeholders worldwide to meet this goal. vices that in challenging operational scenarios are plagued with In line with the above trend, there is currently worldwide in- intermittent communication losses and multi-path effects and terest in the development of new tools to support the exploration, exhibit reduced bandwidth and low reliability.

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 3

3. Long range missions require that the vehicles be equipped with time and human resources and being able to obtain better perfor- proper power supply systems (also relying on alternative tech- mance in terms of accuracy on gathered data. The trend observed nologies such as fuel cells, biological batteries, solar panels, over the last few years consists of relying on teams of coopera- etc.) and efficient energy management systems. tive robots, all of which can perform specific and specialized tasks to achieve an overall common goal; several approaches have been

The use of autonomous vehicles requires also the design and proposed in literature to guide the team and allow it to achieve implementation of advanced guidance, navigation, motion control, the requested goals, from simpler formation control with preas- and mission control systems, together with acoustics-based com- signed tasks, to cognitive-based reconfiguration and adaptive be- munication networks in order to afford vehicles acting in isola- havior with on-line optimization of task distribution according to tion or in a group the high level of reliability required to ac- varying conditions (both of the environment dynamics and of the complish complex missions. Marine system development embraces robotic system itself, which could have to deal with failures, robot many theoretical and practical issues that include dynamical sys- re-configuration, as well as changes in mission goals). These sys- tems theory, automatic control, networked systems, identification tems can be employed with the same effectiveness to fulfill differ- and estimation, computer vision, communications, and sensing and ent scientific goals: from water quality monitoring to geophysical measurements, to name but a few. and geo-technical surveys, from and biology-guided

This strong inter-disciplinarity underpins the importance of fos- missions (such as deep ocean research to identify new marine tering interest in the topics related to the marine and maritime species and to better characterize their behaviours) to the evalu-

fields, as well as the importance of encouraging scientists and en- ation and demonstration of bio-inspired systems to enhance the gineers with different backgrounds to connect, exchange ideas, and prevalence and the productivity of robotic platforms in everyday define possible avenues for joint research and development work. life. As a contribution to bringing attention to many of the above topics, in this paper we overview recent trends in the field of ma- 2.2. Industrial rine robotics and assess their impact on several important appli- cation domains. We highlight key technological achievements in During the last decades the Unmanned Underwater Vehicles the field, analyze some of the shortcomings encountered, and in- (UUVs) have been routinely used for inspection and intervention dicate specific issues that warrant further research and develop- tasks. ROVs are currently the work-horse being routinely used ment effort. In the process, we review a number of highly repre- for inspections of harbors, dams, ships, and submerged infrastruc- sentative projects in the field and establish connections with the- tures. Definitively, when the task involves the use on Underwa- oretical frameworks upon which technological developments build ter Vehicle Manipulation Systems (UVMS), teleoperated system are upon. We also provide an outlook on the future of marine robotics, the unique alternative available in the market. Nowadays AUVs both from a theoretical and practical standpoint, and describe re- have become an excellent tool for seafloor mapping using cam- cently initiated projects that hold promise for the development of eras Eustice, Singh, and Leonard (2006) and/or sonar Paduan, Ca- advanced tools and systems for ocean exploration and exploitation. ress, Clague, Paull, and Thomas (2009) . AUVS have been used

The paper is organized as follows: Section 2 contains a brief for dam inspection Ridao, Carreras, Ribas, and García (2010) , ma- description of the most important domains in marine robotics. rine geology Escartín et al. (2008) and deep water archeology

The state of the art in the field is analysed in Section 3 through Bingham et al. (2010) within other applications. However, commer- an extensive overview of some of the most influential projects. cial of the shelf AUVs are only able follow trajectories at a certain

Section 4 summarizes some still open challenges and a number depth or at a fixed altitude from the bottom. Although inspections of primary emerging trends for future developments in marine AUVs are now used routinely for pipe/cable inspection, they are robotics. Finally, Section 6 contains the main conclusions. not able to operate in areas with strong 3D relief. Field operations for intervention in offshore infrastructures, as well as for 3D in- 2. Domain overview spections are still done using ROVs. In the next sections we explore the recent research done in these areas to overcome this situation. Marine robotics encompasses an extremely wide range of topics that are usually defined as application domains. In each domain, 2.3. Transport autonomous marine systems play a key-role in the achievement of specific challenging scientific, commercial, and societal goals. In a world characterized by an automation level which increases The latter can only be met through committed research and de- at fast pace, transportation means and infrastructures are also velopment work leading to cutting-edge methodologies and tech- subjected to innovation. The concept of shipping itself is rapidly nologies that are steadily affording marine robots the capability to changing, moving the consolidated commercial traffic that we ex- address increasing complex problems. A brief introduction to the perience everyday towards a twofold disruptive approach, having main application domains and related challenges are reported next on one side the unmanned ship as a goal and, on the other hand, with a view to giving a broad vision of the broad scope of marine the employment of autonomous marine agents extending the ca- robot applications. pabilities of the ship (in terms of perception of the environment, remote observation, self-maintenance). In recent years a number 2.1. Scientific of projects has been proposed with the aim of firstly evaluate the major issues and current technological limitations towards the em- Since its very first achievements, involving demonstrations in ployment of self-navigating autonomous ships, such as the MUNIN the field, robotics has been viewed as an extremely promising project Porathe, Burmeister, and Rdseth (2013) . Being not currently field with tremendous potential for the development of advanced possible to experimental test autonomous navigation for real ships systems capable of affording scientists the means to monitor the in large scenarios, the activity has focused developing suitable and ocean and its living and non-living resource at unprecedented tem- reliable infrastructures aiming at trials at least confined in con- poral and spatial scales. Tasks such as water sampling, monitor- strained and controlled areas. ing and exploration are extremely simplified by the exploitation of As previously specified, autonomous shipping does not focus robotic teams of heterogeneous and complementary agents, imply- only on self-navigation of the ship itself, but the concept embraces ing also great improvements in results with less effort in terms of the extension of common operations through the exploitation of

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

4 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

(cooperative) autonomous agents capable of extending the opera- as harbour protection. Similar objectives were pursued by the RO- tional range of the ship, allowing wide-range sensing (to enlarge BUST Robust website (2018) and WiMUST Wimust website (2018) , the knowledge of the surrounding environment), outboard interac- Abreu et al. (2016) , Al-Khatib et al. (2015) projects, focused re- tion (exploration and intervention in the operating scenario), self- spectively on cooperative robots equipped with distributed acous- maintenance (with autonomous agents operating within the ship). tic devices for geophysical survey devoted to exploitation and geo-technical applications, and on vast terrain mapping through 2.4. Human interaction robotic technology for mineral and raw material detection and ex- ploitation. Geological and mineralogical information gathering was Although the already high level of autonomy reached by cur- also the main goal of the UNEXMIN project Lopes et al. (2017) , rent marine robotic platforms, there is still an impressive num- Unexmin website (2018) , employing robotic systems for the au- ber of scenarios and applications that requires the skills and adap- tonomous exploration and mapping of European flooded mines. tation capabilities towards unpredictable conditions that only ex- The concept of responsible exploitation of the marine environ- pert human operators can provide. Application scenarios such as ment, assuring its long-term preservation through a cost-effective ship or offshore structure maintenance, biological habitat protec- ocean glider, was addressed in the BRIDGES project Bridges web- tion or archaeological site assessment require a number of opera- site (2018) . Much effort has been (and still is) devoted to the tions (which depend on the current conditions and occurrences) increasing of robotic capacity of operating in a real-world sce- that make unfeasible the exploitation of autonomous platforms, nario without requesting (or minimizing such requests) help from given the huge number of variables and situations to be taken humans: the PANDORA project Lane et al. (2012) , Pandora web- into account by a pre-programmed agent. Anyway, the need of site (2018) aimed at developing and evaluate smart computational human presence in the operational scenario does not exclude the methods to make robots persistently autonomous, where as the exploitation of robotic agents which can act as support platforms NOPTILUS project Chatzichristofis et al. (2012) faced the execution for the actions carried out by human operators. In this view, au- of real-life complex situation-awareness operations. Robotic tech- tonomous agents capable of guiding the operators in the environ- nology has been widely used also to deploy and retrieve data- ment (that can be characterized by low visibility, underwater sea gathering sensors and equipment, as in the AUTODROP project, currents, etc.), as well as carrying out tedious or dangerous tasks, where a dedicated new-concept UUV La Gala, Dubbioso, Ortolani, provide an added value thanks to the gained efficiency and cost- and Sellini (2012) has been developed, or in the DIGITAL OCEAN effectiveness of the operations. Furthermore, the autonomous ca- project Domingues, Essabbah, Cheaib, Otmane, and Dinis (2012) , pability of monitoring the execution of the human operations can aiming at discovering the ocean depth and making it interactive turn into a dramatic enhancement towards safety improvement, through robotics, 3D imagery and mixed reality. giving the chance to provide support and aid before accident oc- A second category is made up of projects relative to environ- currences. mental and infrastructure monitoring, in which different aspects On the other hand, mixed teams of human and robotic agents are considered and different goals are pursued. In particular, the can cooperate with greater effectiveness within emergency situa- development of suitable technological platforms for water qual- tions as in a search and rescue context, as well as within scientific ity monitoring were addressed by HYDRONET Fornai et al. (2012) , missions in harsh environments, as in Polar expeditions. which employed small-scale robots and an ambient intelligence Moreover, heterogeneous multi-agent systems can be exploited framework. The SHOAL project Shoal website (2018) aimed at intro- in both professional (e.g. archaeological) and recreational scenar- ducing a bio-mimetic concept into environmental monitoring pro- ios; in the specific cases robotic platforms can relieve divers from cedure, in particular exploiting a robotic fish swarm to search for difficult, tricky or dangerous tasks, as well as monitor their health contaminants and pollutants. Multi-robot systems were also em- condition (e.g. preventing accidents by detecting early stage signs ployed in the pioneering Co3AUVs project Birk et al. (2012) , deal- of panic or of nitrogen narcosis) and guide them through their ing with both monitoring of critical underwater infrastructures and overall mission, being able to issue a prompt alarm whenever re- interaction with humans during commercial and scientific dives. quired. Underwater and surface vessels for maritime and offshore op- erations are employed also by the very recent SWARMs project 3. Relevant projects Swarms website (2018) , particularly focusing on seabed mapping, pollution monitoring and plume detection & tracking. Following the application domain classification, a number of Very important initiatives are represented by infrastructures relevant projects related to each domain are briefly described next. and networks created with the main purpose to allow collabora- In the process, we highlight their innovative features aimed at im- tive networking among marine stations, institutions, researchers proving single and multiple vehicle systems performance, reducing and all personnel involved in ocean and marine related activities. costs, and enhancing operational safety. For instance, both the Autonomous Ocean Sampling Network (AOSN) website (2018) (aosn) and the AOSN II Ramp et al. (2009) fuse 3.1. Scientific realistic ocean models with advanced robotics and sensor sys- tems to observe and better predict ocean behaviours. Similar As suggested above, the applications in the scientific domain objectives are pursued by the MARS Network Mars network are multi-purpose and the methodologies and technologies used website (2018) , representing the European version of AOSN, and can often be adapted to meet different requirements. Some broad fostering collaboration among European marine stations on basic categories, each one including several different yet comparable research and environmental issues. A family of networks and re- projects, can be identified. search infrastructures particularly devoted to climate change mon- The first one includes research activities aimed at explo- itoring and effects (that is one of the main societal challenges, ration and mapping the marine environment with different goals with very high priority, devised by the European scientific com- in mind: for instance, the MORPH project Kalwa et al. (2012, munity) has been established. Many governments of the world 2016) was devoted to the development of an effective underwa- signed an agreement to form the Global Earth Observation System ter autonomous robotic system composed by many heterogeneous of Systems (GEOSS) website (2018) (geoss) , while in Europe the nodes to carry out different tasks such as seabed mapping and Copernicus Copernicus website (2018) network arose, being dedi- species (e.g. coral reefs) monitoring, oil & gas inspection, as well cated to global monitoring of environment and security. GEOSS and

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 5

Copernicus are in charge of providing measurements suitable to mapping of rugged terrain and structures with full 3D complexity, predict the influence of global change on weather, climate, water, including vertical cliffs. As explained in Kalwa et al. (2016) , poten- energy, health and disasters. The components of GEOSS that are tial applications include the ”study of cold water coral reef com- oriented to climate and ocean are Global Climate Observing System munities, ecosystems in underwater canyons, pipeline and harbor (GCOS) website (2018) (gcos) , Global Ocean Observing System (GOOS) monitoring, or the inspection of offshore wind and wave energy website (2018) (goos) and the European declination of GOOS, Eu- harvesting infrastructures”. The project advanced the novel concept roGOOS website (2018b) (eurogoos) . All these networks and infras- of an underwater robotic system consisting of a number of mobile tructures are sustained by international initiatives such as the Argo robot modules (nodes), carrying complementary sensors suites for programme Argo programme website (2018) , which was started as environment perception. Instead of being physically coupled, the a pilot project on climate and which now boasts an array of more modules are connected via communication links that allow for the than 3500 instruments that are deployed over the world ocean and flow of information among them. Without rigid links, the so-called that can gather data about subsurface ocean properties. The Euro- MORPH Supra-Vehicle can reconfigure itself and adapt to the en- pean contribution to such equipped structure is offered by Euro- vironment and mission goals, in reaction for example to terrain Argo website (2018a) (eric) , dealing with European interests such shape and the presence of nearly vertical cliffs. This flexibility is in- as high latitudes, bio-geochemical measures and depths greater strumental to enable optimal positioning of each sensor, increased than 20 0 0 m. number of simultaneous viewpoints, and high-resolution data col- Over the last years, great efforts were invested in enhancing lection in an effective manner.” training of early–stage researchers in the area of marine robotics, The research and development work undertaken in the scope of as well as consolidating available research infrastructures in order MORPH led naturally to systems that were instrumental in reach- to bring it closer to the wide scientific community. ing a landmark in September 2014 in the Azores sea, Portugal. One of the early examples is European training network Here, for the first time, five autonomous marine robots from dis- FREESUBNET that had the main objective of providing European– tinct partners, equipped with advanced systems for cooperative wide excellence in quality training to young and experienced re- motion programming, control, and navigation performed a series of searchers in the field of cooperative autonomous intervention un- missions that illustrated the concerted operation of the so-called derwater vehicles, Wilson (2012) . The main result was the succes- upper and lower segments of the MORPH supra-vehicles, see the ful training of a number of researchers who created a cohesive illustrations in Fig. 1 . In this set-up, one autonomous surface ve- mass of capability within the European Union in the area of au- hicle labeled SSV played the role of master vehicle and acted as tonomous underwater vehicle development. As a following step, a reference to be tracked by two underwater vehicles, labeled GCV the Marine UAS European innovative training network was formed, and LSV, playing the role of anchors (upper segment). The latter, in Marine uas project website . This EU–funded doctoral program had turn, served as a moving baseline to guide the motion of two un- a high impact on the training of individual researchers and their derwater vehicles (equipped with cameras), named C1V and C2V, knowledge, skills and their future careers in the area of on au- moving close to the seabed and establishing a desired geometric tonomous unmanned aerial systems for marine and coastal mon- formation with the anchors by measuring their ranges to the latter itoring. With the increasing need to perform scientific and eco- (lower segment). The set-up adopted allowed for geo-referencing nomic exploration of the ocean, an innovative training network of the data acquired by the two camera vehicles. Robocademy Vgele et al. (2016) funded by the European Commis- sion through the FP7 Marie Curie Programme was formed with 3.1.2. ROBUST Project the goal to establish a network of European competence centers ROBUST aimed at exploiting cost-effective and reliable technol- in sub-sea robotics, to form experts in sub-sea robotics, and to de- ogy to be devoted to vast terrain mapping, to assess the presence velop advanced robotic technologies needed for the exploration of of minerals and raw material. Currently such exploration is usually the oceans, Robocademy project website . performed by ROVs and crew members; ROBUST project proposed As the need of extending the know–how in the area of to employ a laser-based technology to analyze terrain merged with marine robotics increased over time, two projects were initi- a robotic AUV performing seabed 3D mapping. The final objective ated by the European Commission with the objective of addi- consisted in locate mineral deposits underwater and to position tionally enhancing scientific and technology capacity of marine suitable instruments completing qualitative as well as quantitative robotics research centres in Croatia and Portugal, through twinning surveys. projects EXCELLABUST Excellabust website (2018) and STRONGMAR Strongmar project website . 3.1.3. Wimust project Bringing together the European research fleets owners to en- The WiMUST (Widely scalable Mobile Underwater Sonar Tech- hance their coordination and promote the cost–effective use of nology) project aimed at “expanding and improving the functional- their facilities was successfully conducted as part of EUROFLEETS ities of current cooperative marine robotic systems, effectively en- and EUROFLEETS 2 infrastructure projects Eurofleets project web- abling distributed acoustic array technologies for geophysical sur- site , while EUMarineRobots Eumarinerobots website (2018) , an ac- veying with a view to exploration and geotechnical applications” cess infrastructure, was very recently established, to include aerial, Wimust website (2018) , Abreu et al. (2016) , Al-Khatib et al. (2015) . surface and subsurface marine robots thus representing a big po- The rational for the project stemmed from the realization that tential for R&D in marine robotics across Europe. there is vast potential for groups of marine robots acting in cooper- The extremely huge effort needed to set up such comprehensive ation, sharing data over an underwater acoustic network, to dras- networks and research infrastructures should underline the impor- tically improve the methods available for ocean exploration and tance of a worldwide spread collaboration among all the actors in- exploitation. Traditionally, seismic refection surveys are performed volved in climate, ocean and emerging related topics. using vessels that tow streamers equipped with hydrophones and acquire acoustic signals that originate in one or more acoustic 3.1.1. MORPH Project sources (towed or installed onboard the support vessel) and are The key objective of the MORPH project was to develop efficient reflected and refracted by the seafloor and the subbottom. Pro- methods and tools to map the underwater environment in situa- cessing of the data acquired allow for proper identification of tions that are not easily addressed by current technology. Namely, conspicuous features with geological relevance. In this context, missions that involve underwater surveying and marine habitat geotechnical surveying for civil and commercial applications (e.g.,

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

6 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Fig. 1. MORPH 3D environment mapping using a multiple vehicle formation.

last years experienced big progress in autonomy research; in spite of this last fact, many challenges are still to be faced, particularly concerning platform miniaturization and suitability to operate at big depth, as well as the capability to effectively interpret geosci- entific data.

3.1.5. BRIDGES Project Responsible exploitation, monitoring capability enhancing and further understanding of the marine environment are fundamental steps towards the long-term preservation of our oceans. The main goal of the BRIDGES project has been identified in the develop- ment of glider technology to allow long-term autonomous explo- ration at high depths, involving vast areas and high frequency of survey. Different domains can benefit from such technology: from the oil & gas industry, to the deep sea industry and the environmental monitoring activity (foreseen by the Marine Strat-

Fig. 2. The WiMUST concept: cooperative autonomous marine robots for geotech- egy Framework Directive) to allow for a smart and adequate eco- nical surveys. system management plan. Hence the system should be endowed with the essential abilities to execute unmanned underwater oper- underwater construction, infrastructure monitoring, mapping for ations, to work in the deep ocean, and to assess the environmental natural hazard assessment, environmental mapping, etc.) aims at impact of the maritime economy. sea floor and sub-bottom characterization using towed streamers of fixed lengths that are extremely cumbersome to operate because 3.1.6. NOPTILUS Project they are connected to a support vessel. In other words, acous- NOPTILUS tackled the problems related to the still not achieved tic sources and receivers are coupled. The major achievement of full autonomy of marine robots: currently multi-vehicle systems WiMUST was to physically separate the sources and streamers: the are employed in many applications but they still lack an actual first were installed on two autonomous surface robots while the and effective capability to take over human operators in real- latter, with a maximumm length of 6 m, were towed by a group of world complex activities that require situation-awareness. Such 5 autonomous vehicles (of which 4 underwater). Advanced coop- cases need advanced reasoning and decision-making: that’s why, erative control / navigation systems enabled by an acoustic com- usually, human operators are integrated in the loop. Anyway, their munication and positioning network enabled the marine robots involvement does not necessarily assure good performance: they (both at the surface and submerged) to interact by sharing infor- can be overwhelmed with too much information, their perfor- mation and maneuver in a desired, possibly time-varying forma- mance can be degraded by fatigue, they can very hardly achieve tion while acquiring geotechnical data. In this respect, the global a proper vehicle coordination, and they cannot guarantee opera- WiMUST system may be viewed as the combination of acoustic tion continuity. In order to be able to remove the human opera- sources and an adaptive variable geometry acoustic array. The fi- tor from the control loop and, at the same time, achieve a suit- nal tests in Sines, Portugal in January 2018 demonstrated the effi- able autonomous behaviour for the system, advancements in many cacy of the system in acquiring geotechnical data in a completely robotics abilities have to be pursued: perception and learning mo- autonomous manner. tion control, cognitive-based situation understanding, cooperative and cognitive communications, smart motion strategies. When de- 3.1.4. UNEXMIN Project ploying such a system in a realistic environment, great effort has Mineralogical data is sought also in the UNEXMIN project, aim- to be concentrated in robustness, dependability, adaptability and ing at achieve valuable surveys on the status of European flooded flexibility, especially to be able to deal with unknown complex un- mines, through the employment of an autonomous robotic ex- derwater environments and situations that have not been taught plorer with 3D mapping capabilities. Information coming from or considered before. these exploration activities can be strategically exploited for mak- ing decision on the re-opening of abandoned mines: actualized 3.1.7. AUTODROP Project data is difficult to be obtained with other methodologies. Hence, A specific attention on the development of an improved the idea to perform surveys with robotic technology, that in the methodology to accurately and cost-efficiently deploy and retrieve

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 7 seabed sensors and equipment was shown by AUTODROP. In par- 3.2. Industrial - Autonomous intervention ticular, the employment of an ad hoc developed UUV was planned. Technicalities about the hydrodynamic design, navigation capabil- Intervention operations require the use of Underwater Vehi- ity (also to assure a gentle landing of the sensors) and the possi- cle Manipulator Systems. While Commercial of the Shelf (COTS) bility to change buoyancy properties (thus allowing the equipment work class ROVs are used routinely by the Oil & gas industry, re- retrieval) were addressed and implemented during the project. The searchers are making an effort to develop the I-AUV (Interven- correct retrieval of previously deployed equipment was supported tion AUV), the Autonomous counterpart of the work class ROV. by a service vessel, receiving the GPS coordinates of the AUTODROP Fig. 3 shows the evolution of this research field. Pioneering works UUV. include 1 DOF I-AUV developments like the MBARI OTTER vehi- cle Wang, Rock, and Lees (1995) and the ODIN Choi, Takashige, and Yuh (1994) . More challenging was the UNION EU project 3.1.8. DIGITAL OCEAN Project Rigaud et al. (1998) which was the first attempt to operate au- Robotic technology and devices were also exploited, in the tonomously a vehicle equipped with a 7 DOF arm. At this point DIGITAL OCEAN project, to improve discovery of the ocean, not the technology of electrically driven underwater arms was not yet only from its surface, but through all its depths and in real- ready. The first robust 7 DOF electrical robot arm was developed in time, making a virtual diving in real time possible. The employed the AMADEUS EU project Lane et al. (1997) where a robust 6DOF smart robots collected underwater digital data to generate under- electrically driven robot was developed. The arm, initially used for sea scenes in 3D interactive imagery and these preprocessed back- cooperative object manipulation fixed in an structure of an un- ground productions are then merged through mixed reality, and derwater work-cell, was later on integrated in the SAUVIM I-AUV diffused on-line. Such technological application offer to all people Marani, Choi, and Yuh (2009) . The first autonomous intervention the possibility to freely virtually roam in the ocean realm. demonstration arrived in 2003, in the context of a milestone EU project, ALIVE Evans, Redmond, Plakas, Hamilton, and Lane (2003) . 3.1.9. HYDRONET Project The project, lead by Cybernetix, finalized with a demonstration Fair exploitation, protection and preservation of the waters where the I-AUV homed and docked to a intervention panel were the main topics addressed by HYDRONET. The project aimed to perform a valve turning task (fixed base manipulation). The at employing a network of small-scale robots embedded in an Am- first free floating intervention was done in the context of another bient Intelligence framework to devise and implement new strate- milestone project, SAUVIM Marani et al. (2009) . In this case, the gies and technologies for the assessment and improvement of robot navigated to a target area identified using a DIDSON imag- water quality (in terms of chemical and ecological status). Exploita- ing sonar, where the robot used the camera to identify a simple tion of mathematical models describing the pollutants transport in target easily identifiable using computer vision. SAUVIM used a water bodies, as well as knowledge discovery processes aiming at 7 DOF to grasp the object while floating (Free-floating manipula- extracting and increasing knowledge on water management, en- tion). Two years later, a significantly lighter I-AUV was designed hanced the integrated response of the system. and developed at the university of Girona Ribas, Palomeras, Ri- dao, Carreras, and Mallios (2012) , the GIRONA 500. It was the re- sult of the Spanish project RAUVI, Prats, García, Fernandez, Marín, 3.1.10. SHOAL Project and Sanz (2011) , where a 4 DOF electrically driven robot arm Environmental monitoring was the main purpose also of the was mounted on the GIRONA 500 AUV conforming and I-AUV of SHOAL project, which planned to employ biomimetic approaches less than 200 Kg, 1 order of magnitude less than SAUVIM and to the problem: a shoal of robotic fishes is devoted to the analysis ALIVE. The project demonstrated free-floating object recovery, us- and real-time mapping of the presence in water of contaminants ing visual-servoing while doing station keeping. The concept was and pollutants. Group coordination and swarm intelligence strate- extended later on in a wider European project named TRIDENT gies were applied to allow the multi-agent system to be adaptive Sanz, Marín, Sales, Oliver, and Ridao (2012) ; Simetti, Casalino, with respect to environmental changes. The capability of search for Torelli, Sperind, and Turetta (2014) . In this case a 7 DOF robot arm pollutants both on the surface and underwater (discovering dis- equipped with a 3 finger robot hand were mounted on GIRONA solved chemicals in the water) was studied and implemented for 500 Ribas et al. (2015) . TRIDENT used a multipurpose manipulation the developed fish robots, to be able to react to several sources strategy in two steps. First the I-AUV performed an optical sur- of contamination (underwater leaks from vessel submerged hull or vey of the area of interest building a photo-mosaic. Next, an user from underwater pipelines). selected a target object and the robot was send to recover it au- tonomously. Subsea panel intervention while docked was later on 3.1.11. SWARMs Project reproduced in the TRITON Spanish project Palomeras et al. (2016) , Offshore activity was addressed by the SWARMs project: cur- where a visual-servoing based method for docking was employed. rent operations are mainly executed by divers performing danger- Besides turning a valve, it was also demonstrated how to au- ous missions. Since their possibility to work is limited, the offshore tonomously plug and unplug a connector using fixed-base manip- industry is highly compromised. A solution to this problem is rep- ulation. Valve turning in free flotation was first demonstrated in resented by the exploitation of AUVs and ROVs, but their deploy- Carrera et al. (2014) using learning by demonstration techniques, ment is usually very expensive due to the difficulties and specific and later on in Cieslak, Ridao, and Giergiel (2015) using the task skills required to operate them, as well as their characteristic of priority approach, and later on in Youakim et al. (2017) using real being tailored for specific tasks. Hence, SWARMs planned to extend time path planning techniques to deal with fixed virtual fixed ob- the access to AUVs and ROVs to more users through: i) assuring stacles. The last work also demonstrated free-floating connector re-usability by enabling such systems to cooperatively work, com- plugging and unplugging. Dual arm manipulation using a fixed bining capabilities of heterogeneous non-specialized vehicles; and base underwater work-cell was early demonstrated in Casalino, An- ii) increasing autonomy for AUVs and usability for ROVs. Positive geletti, Bozzo, and Marani (2001) using the AMADEUS arm. An on- outcomes of such new operating modes can be applied to different going project involving the implementation of a dual arm system scenarios, among which: offshore infrastructure inspection, main- is DEXROV Gancet et al. (2016a) , where a satellite based teleopera- tenance and repair; pollution monitoring; ac- tion of an intervention ROV in presence of significant time delays is tivities. targeted. In a different line, recent projects related to Underwater

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

8 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Fig. 3. Evolution of autonomous intervention projects.

be deployed from a non DP vessel. It features acoustic based hom- ing capabilities and vision based docking. Once docked, the system becomes fixed-base manipulation system, simplifying the problem since there is no join control of the vehicle and the manipulator. ALIVE represents what could be the evolution of the current work class ROV.

3.2.2. SAUVIM Project SAUVIM was a project funded by the Office of Naval Research in the USA. The project was developed at the University of Hawaii. Fig. 4. ALIVE project, particular of AUV operations. While ALIVE targeted subsea panel intervention with fixed base manipulation approach, SAUVIM goal was object recovery in free Vehicle Manipulator Systems (UVMS) included the design and de- flotation. The main concept of SAUVIM was the use of a low mass velopment of bio-mimetic designs. One example is the CRABSTER arm (65 kg) mounted on a large mass AUV (6 Ton) to avoid arm UVMS Yoo et al. (2015) which is a legged underwater robot whose to base perturbations, making possible the use of uncoupled con- two frontal legs can be used for bi-manual manipulation. Another trollers for the AUV and the arm. SAUVIM was the first project to interesting project is the Ocean One Khatib et al. (2016) where demonstrate autonomous object recovery in a complex experiment a humanoid robotic avatar is used for ocean exploration and in- including the use of an multibeam imaging sonar to detect the tar- tervention. In Tang, Wang, Wang, Wang, and Tan (2018) , a bio- get area and a camera with a simple visual servoing system to de- mimetic long-fin propulsion system is used to control an I-AUV tect the target. Manipulation was carried out in station keeping us- equipped with a 4 DOF arm. ing the robot arm. Recently, projects like ROBUST are proposing the use of I-AUVs for field applications , like deep mining Simetti, Wanderlingh, 3.2.3. TRIDENT Project Casalino, Indiveri, and Antonelli (2017) . This, together with the re- The TRIDENT concept ( Fig. 6 ) is base on a 2 step methodology cent apparition on the scientific HROV systems Bowen et al. (2013) ; to achieve multipurpose intervention capabilities. During the first Brignone et al. (2015) , which from the hardware point of view are phase, and ASC and an AUV work in tandem. The AUV performs an equivalent to I-AUVs, is expected to foster new field application in optical survey of the seafloor, while the ASC performs as a naviga- the near future. tion and communication gateway. When this phase is completed, the AUV is recovered and a photomosaic of the seafloor is built. 3.2.1. ALIVE Project Next, the user specifies an object in the map to be recovered and ALIVE is an open frame AUV equipped with a 7 DOF hydraulic the I-AUV is send for recovery. Since the object pose is now know, manipulator and 2 hydraulic grasps used for docking the vehicle the robot navigates to the target position. When the object ap- to the bars of a subsea panel. The vehicle weights 3.5 Ton and can pears in the field of view of the camera, the object is identified

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 9

force feedback to exhibit advance manipulation capabilities. Inter- estingly, Ocean One has been designed to draw on the complemen- tary strengths of both humans and robots, As such, it is truly a quantum leap in the development of a new class of robots capa- ble of performing delicate operations underwater, including many of interest to marine scientists and researchers specialized in the preservation of cultural heritage OCEAN ONE project (2018a) .

3.3. Transport

Autonomous marine robots can play multiple roles within the marine and maritime domain: from water monitoring, to safety in- crease in transport and underwater intervention activities (includ-

Fig. 5. SAUVIM project, test campaign. ing assembly, manipulation, decommissioning). In the last two decades, industry has remarkably benefited from marine robot exploitation, thanks to the technological trans- and tracked. Next, a grasp planer selects the best grasping and a fer from pioneering research to professional service applications. task priority framework is used to jointly control the AUV and the Today, research is again ready to transfer its new cutting-edge arm to complete the grasping. results and consolidate its experience through the deployment of effective systems within civil and industrial applications. However, there are obstacles to such deployment of different nature: (i) 3.2.4. PANDORA Project technical (e.g. autonomous anti-collision systems, underwater com- This project aimed at developing technologies to achieve per- munications, vision & localization, persistence in terms of both sistent autonomy. Three themes were targeted: (1) describing the energy support and decisional autonomy); (ii) non-technical (e.g. world for detecting failures in the task execution; (2) directing and lack of a legal framework regulating autonomous marine robot be- adapting intentions by means of planning for responding to fail- haviour in presence of other agents). ures; and (3) acting robustly mixing learning and robust control Therefore, robotics research community, industrial stakeholders for making actions indifferent to perturbations and uncertainty. and end-users should work together in a solid way to push pol- The project tackled scenarios related to the Oil & Gas Industry in- icy makers, public administrations, standards and certification or- cluding riser and mooring chain inspection and valve turning. PAN- ganizations to acknowledge and incorporate consolidated research DORA developed methods to: (1) control an I-AUV using learning results into precise ad hoc regulations. Specifically dealing with by demonstration; (2) Task planning and dispatch using PDDL 1 in- maritime transportation, one of the major requirements is that tegrated with the AUV control architecture, (3) Fault detection and of increasing people and goods safety while reducing costs. CART restoring. The project demonstrated ( Fig. 7 ) a 3 h autonomous in- Bruzzone, Bibuli, Zereik, Ranieri, and Caccia (2017) and MINOAS tervention mission turning valves in a water tank including per- Bibuli et al. (2012) are representative projects addressing safety is- turbation currents, blocked valves and panel occlusions achieving sues in maritime transport. a 80% success rate.

3.2.5. OCEAN ONE 3.3.1. CART Project OCEAN ONE is an underwater robotic avatar jointly developed The CART project proposed a new robotics concept for salvage by Standford University, the King Abdullah University of Science operations of distressed ships at sea, particularly focusing on link- and Technology and the Red Sea Research Center in Saudi Arabia, ing on the emergency towing system of ships in emergency to and Meka Robotics in California. It is a bimanual underwater hu- towing vessel (a very high-risk operation usually performed by hu- manoid ROV-like robot using haptic feedback to allow a human mans). pilot to perform challenging intervention operations underwater. The proposed concept was demonstrated through the de- In collaboration with the French Departement des recherches ar- velopment of cooperative robotic technologies able to (semi- chologiques subaquatiques et sous-marines (DRASSM), the robot )automatically recover the towing system; it proved to be able to was used to explore La Lune, a 17th shipwreck located off the optimize the operations for safeguarding the environment, typi- coast of Toulon (France). The contribution of OCEAN ONE to un- cally preventing oil pollution at sea, while minimizing the risk for derwater manipulation lies in the use of haptic interfaces with human life. In Fig. 9 , the project concept is shown: the B-ART ve- hicle moves away from distress ship carrying the messenger line and the ART vehicle safely ties it to allow ship towing. This avoids

1 Planning Domain Definition Language. that the towing vessel approach the distressed ship at relatively

Fig. 6. TRIDENT concept: (From left to right) Survey phase concept; Intervention phase concept; Seafloor P TRIDENT I-AUV.

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

10 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Fig. 7. PANDORA project, particular of an intervention mission.

Fig. 10 shows some of the robotic platforms employed within the project.

3.3.3. RITMARE Italian Flagship Project RITMARE is an Italian collaborative framework that aims at de- veloping the concepts of extended ship and system of systems. The overall and long-term goal of the project is the enforcement of competitive and globalization capabilities of the Country to- wards technological changes in the marine and maritime sectors, including environmental related challenges such as climate change, marine environment degradation, maritime security and energetic sustainability. Within this huge and challenging framework the project faces the challenge of autonomous shipping with the devel- opment of a heavy size autonomous surface vehicle capable of de- ploying/recovering unmanned underwater robots, performing co-

Fig. 8. The OCEAN ONE underwater robot. operative tasks, thus evolving the capabilities of intelligent marine agents. Moreover, a number of complementary actions are carried out in order to enhance the overall system performance pointing short range, which can be very dangerous in the case of rough sea at: conditions. • Cost planning and reduction in the life-cycle of the ship system. • Modeling of the human perception with respect to comfort fac- 3.3.2. MINOAS Project tors. Ships and vessels are still today heavily employed for the cost • Agent based technologies and explorable 3D models for on- and time efficient transport of goods and humans. Hence, they re- board people and goods management. quire increasingly high safety standards. • Development of innovative autonomous vehicles. Towards this goal, technology and automation can endow ves- • Adaptive navigation, guidance and control systems coupled sels with tools and equipment to monitor the “safe operational” with intelligent data gathering modules. criteria, achieving less effort required, lower level of uncertainty • Innovative instrumentation for mobile platforms. and higher accuracy. The MINOAS project developed an integrated • Small Waterplane Area Twin Hull (SWATH) design and develop- product, based on autonomous robotics technology, to be exploited ment. for the inspection related procedures of the maritime industry. In particular, the project resulted in an increase of the inspection pro- 3.4. Human-Robot interaction cedure quality, as well as in leveraging the engineering and cost performance required, through the standardization of the number In spite of autonomy required to all robotic platforms, Human- and the sequence of the tasks involved in the inspection procedure. Robot interaction is an essential component of all applications in

Fig. 9. CART concept.

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 11

Fig. 10. Some of the robotic platforms exploited in MINOAS. relevant environments, at least at some level; to this aim, suit- maritime), to support human crisis managers and to assist search able methodologies and interfaces should be developed to allow and rescue teams. These tools are suitably integrated into the C4I such interaction. In detail, there are different types of possible (Command, Control, Communications, Computers and Intelligence) interactions between humans and robots: from a human opera- equipment used by crisis managers, in such a way to be effec- tor controlling and monitoring robot activities, to an actual in- tive in real operations and in enhancing the safety of humans. Also tegration of human beings in the loop, allowing a real coopera- the German project AGaPaS Kurowski and Lampe (2014) aimed at tion. Required robotic features in the different cases are varying: demonstrating the added value brought by robotics platforms in from a classical visual interface including all relevant information search & rescue operations at sea. and controls Toal, Omerdic, and Dooly (2011) , to more complex The first starting idea of robot assisting divers during missions, interfaces and structures enriched with multi-modal sensory in- introduced in the CO3AUVs project, has been then resumed and formation and augmented reality Omerdic, Toal, and Vukic (2016) , widely extended by the CADDY project Miškovi c´ et al. (2017) . This Vasilijevic, Vukic, and Miskovic (2016) , Letier et al. (2017) , as well last accomplished its main goal to achieve an effective robotic sys- as to the development of communication based on more ”nat- tem to monitor, guide and obey to human divers during their mis- ural” interaction methodologies, such as speech and/or gestures sions, through a ”natural” interaction based on diver gestures. Chiarella et al. (2015) . Another particular form of interaction is developed in the on- A classical kind of human-robot interaction in the marine and going DexROV project Gancet et al. (2016b) which plans to ex- maritime domain is required by subsea operations by ROVs; the ploit a double advanced arm and hand force feedback exoskeleton OceanRINGS suite Oceanrings website (2018b) is a good example of DexROV website (2018) as interface to assure dexterity to the ROV control and navigation framework for offshore commercial ROVs. pilot. Usually, these technologies are applicable to off-shore oil and gas Dexterous control could be also exploited in the underwater ar- sector, for inspection and maintenance, and can also be exploited chaeology domain, having to deal with fragile and precious finds. for future deployment, monitoring, and maintenance of ocean en- Important research in the field has been conducted within the AR- ergy devices. Such system facilitates ROV operations, reducing ship ROWS project Arrows website (2018) , Allotta et al. (2015) , which time and cost and increasing safety; moreover, it provides a suit- aimed at adapting and developing low cost autonomous underwa- able platform to researchers that can develop, evaluate and test ad- ter vehicle technologies to cover the full extent of archaeological vanced control algorithms, both in simulation and in real world. campaign, reducing cost of operations. The topic concerning Human-Robot interaction is somehow An excellent level of dexterity and precise control is required ”cross-domain”, since robotic systems up-to-date deployed in real also in the on-going (and just started) Antarctic project IceClimaL- world require human intervention, at some level. izers IceClimaLizers project (2018) , which aims at investigating the Recent research activities, also conducted in EU-funded projects, role of selected species of bioconstructors as proxies for climate have investigated, with mostly success, the possibility to integrate changes; skillful manipulation of fragile bio-organisms will be es- humans and robots in very comprehensive and effective systems sential for the project success and will be performed via suitable (such as in search & rescue applications), as well as adopting new teleoperation. and ”more natural” interaction strategies (e.g. exoskeleton, gestures Fig. 11 depicts relationship in time among the mentioned ...). projects focusing on Human-Robot Interaction; note how the appli- The pioneering research work conducted in the CO3AUVs project cation domains are different (from archaeology, to search & rescue Birk et al. (2012) , dealing with the development of an advanced and human safety, as well as support to industrial activities and multi-robot system for underwater environments, led the marine to scientific research in harsh and remote environment). Note also robotics community to investigate mixed human-robot multi-agent how results from a project like OceanRINGS , dealing with technolo- systems with increasingly stronger effort. gies to ease ROV piloting and operations, are important and shared Mixed team of humans and robots have been employed also among all the domains. in a search & rescue context: the DARIUS and ICARUS projects Chrobocinski, Makri, Zotos, Stergiopoulos, and Bogdos (2012) , 3.4.1. CO3AUVs project Icarus website (2018) , Serrano et al. (2015) dealt with the ex- At the time the CO3AUVs was proposed, as well as still today, ploitation of comprehensive unmanned search and rescue tools, in- autonomous underwater platforms was and still are among the cluding specifically-adapted unmanned platforms (air, ground and most exciting challenges of robotics research. Difficulties arising

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

12 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Fig. 11. Timeline of the mentioned main projects dealing with Human-Robot Interaction. from the unstructured environment, in terms of perception, deci- ment while performing their missions. To overcome these prob- sion, control and communication issues, require that robotics go far lems, the EU Project CADDY Caddy website (2018) aims to establish beyond the current approaches and methodologies. an innovative set-up between a diver and companion autonomous The main purpose of the project consisted in enabling advanced robots (underwater and surface) that exhibit cognitive behavior cognitive systems for coordinated and cooperative control of a through learning, interpreting, and adapting to the diver’s behav- team of AUVs, capable of both seamlessly performing monitoring ior, physical state, and actions. tasks (e.g. of underwater infrastructures, also detecting anomalous The CADDY project replaces a human buddy diver with an au- situations) and of acting as companion/support platforms for hu- tonomous underwater vehicle and adds a new autonomous sur- mans (e.g.during scientific and commercial dives). face vehicle to improve monitoring, assistance, and safety of the diver’s mission. The resulting system plays a threefold role similar 3.4.2. ICARUS and DARIUS projects to those that a human buddy diver should have: (i) the buddy “ob- ICARUS and DARIUS projects were devoted to the exploitation of server” that continuously monitors the diver; (ii) the buddy “slave” mature robotic technology in search & rescue applications. that is the diver’s “extended hand” during underwater operations In particular, the ICARUS project proposed to employ unmanned performing tasks such as “do a mosaic of that area”, “take a photo platforms and tools as support for first responders working on of that” or “illuminate that”; and (iii) the buddy “guide” that leads search & rescue during a major crisis, with the final goal to reduce the diver through the underwater environment. costs in terms of human lives and money. The addressed technol- ogy concerns assistive unmanned air, ground and sea vehicles, in 3.4.4. ARROWS Project charge of both the first exploration of the considered area and pro- The main purpose of the ARROWS project consisted in the viding support (as well as enhancing their safety) to human per- adaptation and development of low-cost underwater technologies sonnel. aimed at supporting archaeological campaign activities, like map- The complementary DARIUS project aimed at adapting and inte- ping, diagnosis and excavation tasks. In particular, some of the pur- grating already developed technologies for situation awareness into sued objectives regarded: multi-modal sensing through customized complex multi-national and/or multi-agency search & rescue oper- AUVs for fast and low-cost horizontal surveys of wide areas; high ations. In particular, it focused on the achievement of effective lev- resolution maps through precise image reconstruction and accu- els of interoperability to make these systems effectively useful to rate AUV localization; soft excavation tools to deal with fragile be shared between several organizations. objects; virtual exploration of archaeological sites through mixed- reality environments. 3.4.3. CADDY Project Divers operate in harsh and poorly monitored environments in 3.4.5. DexROV project which the slightest unexpected disturbance, technical malfunction, The DexROV project focuses on ROV operations and on how to or lack of attention can have catastrophic consequences. They ma- effectively reduce their time and costs. Operating ROV usually re- neuver in complex 3D environments and carry cumbersome equip- quires significant off-shore dedicated manpower, while the project

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 13 aims at mainly gathering manned effort for operations in a ad hoc search. This is because heterogeneous robots have higher chances control room on-shore. This is possible through a real-time simula- to successfully achieve complex missions; such networks strongly tor able to both exploit ROV sensor data to model the environment, leverage heterogeneity to perform their assigned tasks. Particularly, and respond to operators’ commands. marsupial systems exploit the so called ”marsupial relationship” Interaction with human operator is foreseen through a double Hourani, Wolters, Hauck, and Jeschke (2013) , the physical interac- advanced arm and hand force feedback exoskeleton, which can en- tion occurring among a carrier robot and its one or more passenger able dexterous manipulation. robots : the carrier, beside making available its own capabilities to the overall robotic system, can provide faster deployment of pas- 3.4.6. IceClimaLizers project sengers. Thanks to their high flexibility, marsupial robots can be The just started IceClimaLizers project aims to identify biocon- exploited for complex missions in harsh and dangerous environ- structional areas in Terranova Bay, since they are responsible for ments but, in any case, they need new methodologies and brand- the increasing in Antarctic biodiversity, and to investigate the re- new concepts in perception, control and communication, being this lation between climate changes and varying properties of biocon- a big still open challenge. structors (i.e. organisms that builds a structure that survives the Navigation in unconfined environments (beyond the coverage death of the organism itself). of acoustic transponder networks) remains one of the milestone The novelty the proposed approach consists in directly corre- problems yet to be solved. Terrain based navigation Carreo, Wil- lating the biomineral characteristics of the species with the en- son, Ridao, and Petillot (2010) ; Melo, and Matos (2017) , with vironmental parameters experienced during the last year species so many implementations already reported in the literature has growth. not found its path towards routinary application, because it In such a way to be able to handle such fragile and precious requires accurate a priori available maps which are not al- organisms in a harsh and remote Polar environment, the required ways available. SLAM arises as a key technology to solve this robotic manipulation activity will be performed exploiting classical problem during the next years. Many SLAM implementations teleoperation technique by a human expert operator. have been recently reported in the literature using bathyme- tries Barkby, Williams, Pizarro, and Jakuba (2012) ; Palomer, Ri- 4. Challenges dao, and Ribas (2016) , occupancy maps Fairfield, Kantor, and Wet- tergreen (2007) ; Vallicrosa and Ridao (2018) , forward looking Marine robots fall into two major categories; remotely oper- sonar imagery Hurtós, Ribas, Cufí, Petillot, and Salvi (2015) , vi- ated and autonomous. The first include Remotely Operated Ve- sual SLAM Johnson-Roberson, Pizarro, Williams, and Mahon (2010) ; hicles (ROVs), while a representative group of the latter con- Nicosevici, Gracias, Negahdaripour, and Garcia (2009) ; Pizarro, Eu- sists of Autonomous Underwater Vehicles (AUVs), often referred to stice, and Singh (2004) ; Williams and Mahon (2004) ; Zhang and as Unmanned Underwater Vehicles (UUVs). In the last 20 years, Negahdaripour (2010) , etc... Nevertheless, very few of them have ROVs and AUVs have steadily become the work-horses of scien- been employed in realtime to control AUVs Fairfield et al. (2007) . tific/commercial underwater exploration and exploitation, leaving SLAM algorithms require that the trajectory excuted by the robot the use of manned submersibles for very particular and specialised goes through an area of the environment where the local obser- tasks. ROVs and AUVs have significantly increased their presence vations are informative enough to discriminate its pose. For in- in the market since they became more affordable. More recently, stance, even the best terrain based algorithm will fail if the robot new categories of autonomous marine vehicles have appeared with flies all the time through a uniformly flat bottom. For this rea- great success. Gliders have become the oceanographic tool per son it is necessary to develop active localization algorithms to al- excellence and Autonomous Surface Vehicles (ASCVs), also known low the robot complete their mission traversing informative re- as Autonomous Surface Craft (ASC), have become relevant for hy- gions of the environment in order to bound the drift. Of partic- drographic and surveillance mission and to work in tandem with ular interest are those SLAM methods where the map represen- AUVs, playing the role of navigation aids and communication re- tation allows for an easy categorization of the space into ‘free’, lays. Long Range AUVs have demonstrated the capability to travel ‘occupied’ and ‘unknown’ Fairfield et al. (2007) ; Vallicrosa and Ri- thousands of kilometers. The marine robotics community has also dao (2018) . These methods are easily integrated with path plan- witnessed the appearance of new vehicle concepts such as HROVs, ning algorithms allowing the robot to trace safe routes between which may perform either as ROVs or AUVs depending on the way points through the free-space. It is necessary to research the needs, underwater and wave gliders, intervention AUVs, micro- best metrics to be applied for motion planning depending on the AUVs, precursors of AUV swarms, and cooperative multiple-vehicle applications needs. Should the robot trace the short distance route teams. In the upcoming years, the flexibility of hybrid vehicles, towards a goal way point or the one that would allow it to reach scuh as HROVs, with multifaceted applications, will increase their the target with the smallest uncertainty in its pose? Of course the visibility and protagonism in the marine robotics scene. Small and answer is application-dependent. micro AUVs will also strengthen their presence in the oceans due Another important challenge is related to achieve 3D mapping to their increasing affordability, making them accessible to a large capabilites of high interest for the scientific and industrial appli- community of end users. This will naturally lead to an increase in cations. While during the last decade there has been a significant multiple vehicle operations beyond those in defense areas. Nev- advance in the techniques for 3D mapping (stereo, structure from ertheless, there still remain significant challenges in the way of motion, visual SLAM) very little work has been done on the de- making AUVs increasingly more autonomous with a view to widen velopment of the algorithms and methodologies required to bring their spectrum of applications. the AUVs close enough to the 3D structures in order to gather op- Also, marsupial robotics and morphology-changing modular ve- tical imagery Galceran and Carreras (2013) . In most of the 3D op- hicles are quite new trends in marine robotics applications, ex- tical maps reported in the literature the data has been acquired ploiting their suitable and unique capability to transform and with ROVs, since state of the art AUVs are not able to navigate adapt to missions and the environment, and to carry heteroge- close to areas with strong relieves. Nevertheless, recent results in neous and complementary payloads and sensors in order to meet a motion planning for AUVs have demonstrated experimental results variety of scientific and commercial mission requirements. Indeed, circunavigating an small ireland at a constant depth while gather- in exploration and environment monitoring applications, the em- ing optical imagery Hernández et al. (2016) . Explicitly knowing the ployment of robotic networks is at the cutting-edge of today re- boundary between the ’mapped’ and ’unknown’ area allows for the

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

14 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 use of view planning algorithms Vidal, Hernndez, Isteni, and Car- of power consumption and losses, optimization of required tasks reras (2017) to expand the horizon of the ’known’ area as well as and robot lifetime, generation of power from the working environ- to ensure full coverage of complex 3D structures. It is worth noting ment), to decisional autonomy avoiding human intervention (ca- the requirement to simultaneously solving the online path plan- pability to conveniently plan and re-plan missions, to react and ning and the SLAM problems, since they are actually coupled. adapt to changes in mission goals and environment conditions, au- There are also formidable challenges in the general area of Co- tonomous management of failures), till the capability to store per- operative Motion Planning, Navigation and Control using a Net- ception about both the world and the robotic system itself, pro- worked Systems Approach. The motivation for this theme stems cess and propagate such knowledge in such a way that learning from the fact that worldwide, there is a tremendous surge of inter- behaviours and construction of a semantic mapping and represen- est in the development of the methodologies and technologies re- tation of the working environment can thrive. quired to enable groups of robotic vehicles linked via communica- All the mentioned achievements should be included within a tion networks to collectively inspect, survey, and map challenging multi-robot logic: to accomplish long and complex missions, also underwater environments, while affording humans access to the facing changing conditions and failure, heterogeneous vehicles car- data collected as a cooperative mission unfolds. From a theoreti- rying complementary payloads and abilities are to be employed, cal standpoint, this entails the study of algorithms for distributed being able to react to bad situation and guaranteeing robustness cooperative motion planning, navigation, and control in the pres- for the overall system. Huge coordination and cooperation abilities ence of external disturbances, time-varying communication topolo- should be developed, both among vehicles and in a mixed human- gies, and stringent communication constraints imposed by the wa- robot team framework (with all the concerning safety issues). ter medium Olfati-Saber, Fax, and Murray (2007) , Aguiar and Pas- Significant advancements in all these aspects will strengthen coal (2012) , Bayat, Crasta, Li, and Ijspeert (2016) , Crasta, Moreno- robotic deployment and its effectiveness in scientific, social and Salinas, Bayat, Pascoal, and Aranda (2016) , Häusler, Saccon, Aguiar, industrial applications. One example among many others is repre- Hauser, and Pascoal (2016) , Aguiar et al. (2017) . Many of these is- sented by the intervention domain: a robust and reliable system sues have been the subject of intensive research addressing ex- performing an intervention or inspection mission would require tremely interesting problems in networked systems theory, con- skills such as dual-arm manipulation, cooperative behaviours and trol, filtering, and optimization. A representative example is the decisions, ad hoc motion planning and semantic mapping. problem of combined surface and underwater vehicle opera- Marsupial robotics is earning great interest, for its feature of tions, leading to algorithms capable of making the vehicles fol- allowing heterogeneous collaboration among different robots in low predetermined spatial paths while keeping a desired geomet- charge of different tasks, able to nicely adapt even to harsh and ric formation and executing compliant formation control in reac- complex environments (for instance Polar regions). Moreover, the tion to unexpected obstacles or episodic events detected on line possibility to further change the system morphology through mod- Ghabcheloo et al. (2009) . See also Kaminer et al. (2017) for in- ular design and reconfiguration pushes the marine robotics frontier teresting connections to research in similar themes in the area beyond what seemed not achievable just a few years ago. of autonomous air vehicles. In this context, a research topic that One of the emerging and most intriguing future trends in the has recently come to the fore is the development of cooperative robotic community consists in the development of effective robotic control strategies that are robust against temporary communica- teams to be deployed in harsh and remote environments for com- tion losses and have the potential to reduce drastically the amount plex autonomous operations to be cooperatively performed by of data exchanged among the vehicles by exploiting techniques agents. This goal completion strongly depends on achievements in that have recently come to the fore (e.g., event triggered and all the topics above mentioned. Indeed, many challenges have to be self-triggered control and communications) Almeida, Silvestre, and addressed to obtain a robotic colony able to autonomously survive Pascoal (2017) , Hung and Pascoal (2018) , Kaminer et al. (2017) . in the environment: persistence, in terms of both decisional auton- From a practical standpoint, besides the requirements for in- omy and ability to gather energy from environment; cognitive abil- creasingly sophisticated sensors, actuators, and embedded com- ity to be able to adapt to changes in both environment and mission puter systems, there is a need to enhance the technology for un- objectives; ability to evolve suitably to survive in the environment derwater data exchange among mobile and/or stationary network and to be able, at the same time, to perform useful tasks... nodes that may include autonomous surface vehicles (ASVs), au- Recently, some EU-funded projects have dealt with the de- tonomous underwater vehicles (AUVs), remotely operated vehicles velopment of smart teams of heterogeneous robots, focusing on (ROVs), and benthic stations. The data exchanged are crucial in a different aspects and adopting various points of view. An excel- number of applications that include cooperative, distributed multi- lent example is the CoCoRo (Collective Cognitive Robots) project ple vehicle navigation and control, mission status assessment, and Schmickl et al. (2011) , aiming at creating a swarm of inter- environmental sensing Kebkal et al. (2019) , Chitre, Shahabudeen, acting, cognitive, autonomous underwater vehicles (AUVs) for and Stojanovic (2008) . Meeting the above goals will require the the execution of tasks such as ecological monitoring, searching, exploitation of the underwater acoustic and optical channels si- maintaining, exploring and harvesting resources in underwater multaneously and the development of strategies to dynamically habitats. Agents in the swarm, by interaction and information ex- adapt the topology of the communications network and the geo- change, resulted in a cognitive system aware of the surround- metric configuration of the group of vehicles in real-time. This ex- ing environment, as well as of goals and threats (both local indi- citing avenue of research is being made possible by the availabil- vidual and global at swarm level). Moreover, also the emergence ity of new types of optical modems for communications at short of artificial collective pre-consciousness was investigated, enabling range Góis et al. (2016) , Chitre et al. (2008) , Doniec et al. (2010) , self-identification and improvement of collective performance; this Farr et al. (2005) and networks of high performance acoustic represents a key step for improving the robustness, flexibility and modems and positioning devices equipped with high precision efficiency of such systems and empowering their actual deploy- atomic clocks Kebkal et al. (2019) , Kebkal et al. (2017) . ment and exploitation in real world applications. Another essential issue consists of developing a system capa- Another essential (and still on-going) project on robotic ble of executing long-range missions, eventually reaching the stage colonies is SubCULTron (Submarine Cultures Perform Long-Term where it can be permanently deployed in a particular site or area Robotic Exploration of Unconventional Environmental Niches) (sustained presence at sea). To this end, many different achieve- Subcultron website (2018) , whose main purpose consists in ments are needed: from energetic considerations (minimization creating an artificial society underneath the water-surface to

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 15 the service of a human society above the water. In particular, Mesobot will use a combination of thrusters and a variable buoy- challenges concern the achievement of long-term autonomy in a ancy system to follow the animals with minimal disturbance. Like learning, self-regulating, self-sustaining underwater society/culture its targets, Mesobot will be nearly Lagrangian. Mesobot will dis- of robots. place about 200 kg and can be launched from a variety of vessels. Results achievable by these pioneering research activities will enable future robotic systems able to self-organize, survive and evolve as independent societies of individuals sharing a common 5.2. The C-Bot project, Pramod Maurya, CSIR-NIO, Goa, India sense and joint life goals. Given the reality of climate change, with the consequent warm-

5. Future trends ing effects in India, there exists an urgent need in the country to develop the proper means to monitor, detect, and predict in

This section is a brief summary of four extremely innovative, a timely fashion local phenomena that may be reliable indicators forward looking projects in the USA, India, Norway, and Korea, that of this trend. Coral reef monitoring is considered by most climate hold considerable promise for the development of cutting edge scientists as a reliable proxy indicator of climate change because technologies in marine robotics. corals are sensitive to small changes in temperature. Recent stud- ies published by the India National Curriculum Framework (NCF) have revealed that nearly 50% of the Indian reefs exhibit bleach-

5.1. The Mesobot project, Dana Yoerger, WHOI, USA ing, an irreversible whitening process where the reefs begin to die. Thus the question: how does one monitor and survey large areas

The Woods Hole Oceanographic Institution, the Monterey Bay of coral beds in an efficient manner?

Aquarium Research Institute, Stanford University, and the Univer- Present day methods employ an experienced diver and buddy sity of Texas Rio Grande Valley are developing an autonomous un- with camera equipment to survey coral reef beds along straight derwater robot, Mesobot, with new capabilities for understanding line transects and halting at locations along the transects to image the unique and abundant life in the midwater ocean or “twilight any corals undergoing suspected bleaching. Given the high cost and zone”. The twilight zone, which extends from about 200 m to strenuous human effort involved, only a few straight line transects

1000 m depth, may harbor more fish biomass than all other fish- a year are considered adequate under current monitoring proto- eries worldwide. Many twilight zone animals undergo diel or daily cols. The data thus acquired are not adequate to truly assess the migration, spending daylight hours hundreds of meters deep and impact of climate change on the quality of living living in coastal rising to near surface waters in the evening to feed. While largely areas and often the policies adopted to address this problem are invisible to us, this daily worldwide movement of animals is by far very conservative. The wildlife wardens are looking for a solution the largest migration on our planet and likely a major mechanism that will allow then to collect high resolution images of the coral for moving organic material from near-surface waters to the deep reefs in a given area periodically with a view to obtain and accu- ocean, thereby playing an important role in our planet’s climate by rate information upon which to base government policies. sequestering carbon. A larger number of transects a year is desirable, and this is best

Mesobot will use its stereo cameras to follow midwater animals addressed by the new technology of low flying autonomous un- as they migrate, documenting their behavior for periods exceed- derwater vehicles with cameras and sensors as payloads. For ex- ing a full diel cycle. Mesobot missions will begin using a tether, ample, a low flying reef robot cruising at 0.5 m/s will be able allowing a human pilot on the surface to identify targets, after to image suspect corals in a mere 33 min ute mission to cover a which the tether will be released and Mesobot will track the tar- 1 km line transect. The conventional diver approach would proba- get autonomously. In addition to the monochrome stereo cameras, bly take more than 2 h ours to accomplish the job, with extra time

Mesobot will carry a highly sensitive color 4K video and still cam- to resurface, change air tanks, and resume the mission. The start of era. Mesobot will be equipped with white lights for high-quality our millennium has witnessed a paradigm shift in oceanographic scientific imagery and red lights to minimize both avoidance and observations that began with the use of Autonomous Underwa- attraction. Simultaneously, Mesobot will be able to obtain up to a ter Vehicles and profiling robots for spatial and depth based sam- dozen samples of filtered seawater, allowing researchers to charac- pling respectively at various targeted locations in the seas. Over terize the environment from geochemical and genetic perspectives. the past 15 years, the Marine Instrumentation Group at CSIR-NIO has acquired expertise and field experience in building underwater robots. The roadmap offered by these available technological tools reduces both cost and human intervention. The focus of the Coral Bot (C-bot) project is to build a robot to monitor coral reefs in shallow waters. A C-Bot is a much needed development that will fulfill an important objective embodied in the United Nations proclamation of a Decade of Ocean Science for Sustainable Development (2021–2030) using new technologies. The challenges in the design and development of the C-Bot are several. The C-Bot is planned to replace human divers for moni- toring work and will only involve coral reef personnel to plan and program a robot mission (including the definition of the transects) and to launch and retrieve the robot. The C-Bot will be dropped on top of the coral reefs, after which it will find bu itself a suit- able sand patch location to land. Thereafter, based on the mission specifications. the C-Bot will be in the water for approximately 6 months repeating the transects every months and sleeping on the seabed during the intervals between the transects. The main com- Fig. 12. Mesobot: an AUV to study life in the midwater ocean. Photo Courtesy of D. ponents of the project are to design, implement, and assess the Yoerger, WHOI. performance of the systems required to:

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

16 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Fig. 13. Model testing of YARA Birkeland, the worlds first autonomous ship, in SINTEF Ocean’ basin, Norway. Photo courtesy of Ole Martin Wold, SINTEF.

• Keep the C-Bot at selected places in the seabed even in the 5.3. Projects on Autonomous Ships, Vahid Hassani, NTNU, Norway presence of currents. • Enable the C-Bot to find suitable locations for landing and exe- One of the earliest research projects on Autonomous Ships cute landing maneuvers. was the European project named “Maritime Unmanned Navigation • Geo-locate the C-bot underwater. through Intelligence in Networks (MUNIN)” MUNIN project (2018) . • Control the C-Bot in its vertical and horizontal motion, the lat- MUNIN, co-funded by the European Commission under its Sev- ter along desired. enth Framework Programme, put forward a new concept for an • Record and transmit images and environmental data. autonomous ship with the potential to tackle some of the most challenging problems in the field of autonomous marine trans- The following functionalities are envisioned for the C-Bot: portation such as the significant increase in transport volume, • The vehicle will belong to a new generation of one-man de- growing environmental requirements, and a shortage of seafarers ployable/retrievable robot which can be dropped in the water in the future. Autonomous Shipping allows for more efficient and by one person. competitive ship operation and expected to yield a significant • It will be able to sit on the seabed for long periods of time and decrease in the environmental footprint marine vessels. The con- perform the preprogrammed transects saving on manpower, cept proposed in the scope of MUNIN received praise from the cost , with the added the benefit of acquiring large datasets academia, industries, and civilian authorities Jokioinen (2016) , over larger sampling areas in a single month (this would yield Sames (2018) . The autonomous shipping concept not only brought detailed high resolution maps of the reef beds all tagged with new challenges to both industry and academia but also redefined oceanographic properties of the water column). the shipping industry by bringing new players into the picture. • The vehicle will be controlled to maintain a height of 1 m above The first industrial Autonomous ship project was initiated by the coral reef beds while recording high resolution images. YARA AS, a chemical company that ordered the vessel YARA • After each mission transect, the C-Bot will resurface and trans- Birkeland, the worlds first fully electric and autonomous container mit the data acquired using Satellite Modem/Radio/GSM, after ship, with zero emissions Skredderberget (2018) . The vessel will which C-Bot will again dive and sit at the bottom and wait for be delivered 2020, and will gradually move from manned op- the time to start the next transect. eration to fully autonomous operation by 2022. Another recent The use of C-Bot is not limited to coral applications. In fact, it initiative in the field of autonomous shipping is the “Autoferry holds potential to be used It can be as coastal surveillance robot project” coordinated by the Norwegian University of Science and to monitor all types of noise sources, both natural as well as man- Technology (NTNU), aimed at the development of autonomous made. This opens up the technology to other useful applications. all-electric passenger ferries for urban water transport

Fig. 14. The Aragon USV (left); Automatic Collision Avoidance Test (right). Photo courtesy of Jinwhan Kim, KAIST.

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 17

Autonomous all-electric passenger ferries for urban water trans- Allotta, B. , Costanzi, R. , Ridolfi, A. , Colombo, C. , Bellavia, F. , Fanfani, M. , et al. (2015). port (2018) . The recent European Commission call for proposal The ARROWS project: adapting and developing robotics technologies for under- water archaeology. IFAC-papers online, 48 (2), 194–199 . on the topic of autonomous ship aims to develop and demon- Almeida, J. , Silvestre, C. , & Pascoal, A. (2017). Synchronization of multiagent systems strate integrated automation technologies in a real environment using event-triggered and self-triggered broadcasts. IEEE Transactions on Auto- European commission - the autonomous ship topic (2018) . matic Control, 62 (9), 4741–4746 . Argo programme website. (2018). http://www.argo.ucsd.edu/ . Arrows website. (2018). http://www.arrowsproject.eu/ .

5.4. Development of a multi-purpose autonomous surface vehicle, Autonomous all-electric passenger ferries for urban water transport. (2018). https: Jinwhan Kim, KAIST, Korea //www.ntnu.edu/autoferry . Autonomous ocean sampling network (aosn) website. (2018). https://www3.mbari.

The project aims to develop an unmanned surface vehicle (USV) org/aosn/. Barkby, S. , Williams, S. B. , Pizarro, O. , & Jakuba, M. V. (2012). Bathymetric particle platform and intelligent algorithms for autonomous navigation. A filter slam using trajectory maps. The International Journal of Robotics Research, 8-m long USV, called Aragon, was designed and built, focusing on 31 (12), 1409–1430 . nearshore and coastal applications. Aragon can reach the maxi- Bayat, B., Crasta, N., Li, H., & Ijspeert, A. (2016). Optimal search strategies for pol- lutant source localization. In Intelligent robots and systems (iros), 2016 ieee/rsj mum speed of 45 knots and equipped with various sensors such international conference on (pp. 1801–1807). Ieee . as a camera, lidar and radar for environmental perception. The ve- Bibuli, M. , Bruzzone, G. , Bruzzone, G. , Caccia, M. , Giacopelli, M. , Petitti, A. , hicle was integrated with intelligent algorithms for high-level ve- et al. (2012). Marc: Magnetic autonomous robotic crawler development and ex- ploitation in the minoas project. In Proc. 11th international conference on com- hicle autonomy and a number of field tests were performed in puter and it applications in the maritime industries, compit: 2012 . real-sea environments. Aragon can be controlled in either remote Bingham, B. , Foley, B. , Singh, H. , Camilli, R. , Delaporta, K. , Eustice, R. , et al. (2010). control mode or fully autonomous mode. In the fully autonomous Robotic tools for deep water archaeology: Surveying an ancient shipwreck with an autonomous underwater vehicle. J. Field Robotics, 27 (6), 702–717 . mode, the vehicle is capable of automatically detecting nearby ob- Birk, A. , Pascoal, A. , Antonelli, G. , Caiti, A. , Casalino, G. , Indiveri, G. , et al. (2012). stacles and performing collision avoidance maneuvers while adher- Cooperative cognitive control for autonomous underwater vehicles (co3auvs): ing to maritime traffic rules (i.e., COLREGs). The research project overview and progresses in the 3rd project year. IFAC Proceedings Volumes, 45 (5), 361–366 . has been led by Korea Research Institute of Ships and Ocean En- Bowen, A. D., Jakuba, M. V., Farr, N. E., Ware, J., Taylor, C., Gomez-Ibanez, D., et al. gineering (KRISO) and funded by the Ministry of Oceans and Fish- (2013). An un-tethered rov for routine access and intervention in the deep sea. eries, Korea. The Korean Advanced Institute for Science and Tech- In 2013 oceans - san diego (pp. 1–7). doi: 10.23919/OCEANS.2013.6741383 . nology (KAIST) has been in charge of developing autonomous per- Bridges website. (2018). http://www.bridges-h2020.eu/. Brignone, L., Raugel, E., Opderbecke, J., Rigaud, V., Piasco, R., & Ragot, S. (2015). First ception algorithms fusing various sensor data from INS/GPS, cam- sea trials of HROV the new hybrid vehicle developed by IFREMER. In Oceans era, lidar, and radar systems 2015 - genova (pp. 1–7). doi: 10.1109/OCEANS- Genova.2015.7271682 . Bruzzone, G. , Bibuli, M. , Zereik, E. , Ranieri, A. , & Caccia, M. (2017). Cooperative adap-

6. Conclusions tive guidance and control paradigm for marine robots in an emergency ship towing scenario. International Journal of Adaptive Control and Signal Processing, 31 (4), 562–580 . The paper gave an overview of some of the most relevant do- Caddy website. (2018). http://www.caddy-fp7.eu/ . mains in marine robotics with far reaching scientific, commercial, Carreo, S., Wilson, P., Ridao, P., & Petillot, Y. (2010). A survey on terrain based naviga- tion for auvs, in: OCEANS 2010 MTS/IEEE SEATTLE (pp. 1–7). doi: 10.1109/OCEANS. and societal impact. The first part focused on selected pioneering 2010.5664372 . projects in the field and traced the course of the main objectives Carrera, A., Palomeras, N., Ribas, D., Kormushev, P., & Carreras, M. (2014). An accomplished. In the second part, many of the emerging challenges intervention-auv learns how to perform an underwater valve turning. In Oceans 2014 - taipei (pp. 1–7). doi: 10.1109/OCEANS-TAIPEI.2014.6964483 . were discussed, highlighting their importance and role in advanc- Casalino, G., Angeletti, D., Bozzo, T., & Marani, G. (2001). Dexterous underwater ob- ing research and development in the field of marine robotics. Some ject manipulation via multi-robot cooperating systems. In Proceedings 2001 icra. of the primary trends involving cutting edge methodologies and ieee international conference on robotics and automation (cat. no.01ch37164): 4 (pp. 3220–3225 vol.4). doi: 10.1109/ROBOT.2001.933114 . technologies in robotics were presented, together with a broad vi- Chatzichristofis, S. , Kapoutsis, A. , Kosmatopoulos, E. , Doitsidis, L. , Rovas, D. , & de sion of the next steps to be taken. There has been tremendous Sousa, J. B. (2012). The noptilus project: Autonomous multi-auv navigation progress field, both from a theoretical and practical standpoint. The for exploration of unknown environments. IFAC Proceedings Volumes, 45 (5), road ahead is certainly long, but definitely thrilling and challeng- 373–380. Chiarella, D. , Bibuli, M. , Bruzzone, G. , Caccia, M. , Ranieri, A. , Zereik, E. , et al. (2015). ing. Gesture-based language for diver-robot underwater interaction. In Oceans 2015-genova (pp. 1–9). IEEE . Acknowledgement Chitre, M. , Shahabudeen, S. , & Stojanovic, M. (2008). Underwater acoustic commu- nications and networking: recent advances and future challenges. Marine tech- nology society journal, 42 (1), 103–116 . The authors greatfully acknowledge the contributions of Prof. Choi, S. , Takashige, G. , & Yuh, J. (1994). Experimental study on an underwater Vahid Hassani, Dr. Pramod K. Maurya, Dr. Dana Yoerger, and Prof. robotic vehicle: ODIN. AUV’94. Proceedings of the 1994 Symposium Autonomous

Jinhwan Kim and extend a warm thanks to them for having shared Underwater Vehicle Technology, 79–84. Chrobocinski, P. , Makri, E. , Zotos, N. , Stergiopoulos, C. , & Bogdos, G. (2012). their personal perspectives on new challenging projects in marine Darius project: Deployable sar integrated chain with unmanned systems. In robotic systems. Telecommunications and multimedia (temu), 2012 international conference on (pp. 220–226). IEEE . References Cieslak, P., Ridao, P., & Giergiel, M. (2015). Autonomous underwater panel operation by girona500 uvms: A practical approach to autonomous underwater manip-

Abreu, P. , Antonelli, G. , Arrichiello, F. , Caffaz, A. , Caiti, A. , Casalino, G. , Volpi, N. C. , ulation. In Robotics and automation (icra), 2015 ieee international conference on

et al. (2016). Widely scalable mobile underwater sonar technology: an overview (pp. 529–536). doi:10.1109/ICRA.2015.7139230.

of the h2020 wimust project. Marine Technology Society Journal, 50 (4), 42–53 . Copernicus website. (2018). http://www.copernicus.eu/.

Aguiar, A. P. , Bayer, F. A. , Hauser, J. , Häusler, A. J. , Notarstefano, G. , Pascoal, A. M. , Crasta, N., Moreno-Salinas, D., Bayat, M., Pascoal, A., & Aranda, J. (2016). Optimal

et al. (2017). Constrained optimal motion planning for autonomous vehicles motion planning for range-based marine vehicle positioning in the presence of

using pronto. In Sensing and control for autonomous vehicles (pp. 207–226). unknown currents. IFAC-PapersOnLine, 49(23), 41–47.

Springer . DexROV website. (2018). http://www.dexrov.eu/.

Aguiar, A. P. , & Pascoal, A. (2012). Cooperative control of multiple autonomous Domingues, C., Essabbah, M., Cheaib, N., Otmane, S., & Dinis, A. (2012). Hu-

marine vehicles: Theoretical foundations and practical issues. Further Advances man-robot-interfaces based on mixed reality for underwater robot teleopera-

in Unmanned Marine Vehicles, The Institution of Engineering and Technology , tion. In 9th ifac conference on manoeuvring and control of marine craft (mcmc

255–282 . 2012): 9 (pp. 212–215).

Al-Khatib, H. , Antonelli, G. , Caffaz, A. , Caiti, A. , Casalino, G. , de Jong, I. B. , Doniec, M., Detweiler, C., Vasilescu, I., Chitre, M., Hoffmann-Kuhnt, M., &

et al. (2015). Navigation, guidance and control of underwater vehicles within Rus, D. (2010). Aquaoptical: A lightweight device for high-rate long-range

the widely scalable mobile underwater sonar technology project: An overview. underwater point-to-point communication. Marine Technology Society Journal,

In Proc. 4th ifac workshop on navigation, guidance and control of underwater ve- 44(4), 55–65.

hicles (NGCUV2015): 48 (pp. 189–193). Elsevier . Escartín, J., García, R., Delaunoy, O., Ferrer, J., Gracias, N., Elibol, A., et al. (2008).

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

18 E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19

Globally aligned photomosaic of the Lucky Strike hydrothermal vent field time underwater vehicle positioning. In Proceedings of the underwater acoustics (Mid-Atlantic Ridge, 37 °18.5’N): Release of georeferenced data, mosaic construc- conference and exhibition (uace) . tion, and viewing software. Geochem. Geophys. Geosyst., 9 (12) . Kebkal, K., Kebkal, O., Kebkal, V., Pascoal, A., Ribeiro, M., Rufino, M., et al. (2019). Eumarinerobots website. (2018). https://www.eumarinerobots.eu/ . Hydro-acoustic communications and networking in contemporary underwater Eustice, R. , Singh, H. , & Leonard, J. J. (2006). Exactly sparse delayed-state filters for robotics: Instruments and case studies. The Institution of Engineering and Tech- view-based SLAM. IEEE Transactions on Robotics, 22 (6), 110 0–1114 . nology. Editors Sanjay Sharma and Bidyadhar Subudhi. To appear. Eurofleets project website. http://www.eurofleets.eu . Khatib, O., Yeh, X., Brantner, G., Soe, B., Kim, B., Ganguly, S., et al. (2016). Ocean one: Euro-argo european research infrastructure consortium (eric) website. (2018a). http: A robotic avatar for oceanic discovery. IEEE Robotics Automation Magazine, 23 (4), //www.euro- argo.eu/About- us/The- Research- Infrastructure . 20–29. doi: 10.1109/MRA.2016.2613281 . European commission - the autonomous ship topic. (2018). http://ec.europa. Kurowski, M. , & Lampe, B. P. (2014). Agapas: A new approach for search-and-res- eu/research/participants/portal/desktop/en/opportunities/h2020/topics/ cue-operations at sea. Proceedings of the Institution of Mechanical , Part mg- 3- 2- 2018.html . M: Journal of Engineering for the Maritime Environment, 228 (2), 156–165 . European global ocean observing system (eurogoos) website. (2018b). http:// La Gala, F. , Dubbioso, G. , Ortolani, F. , & Sellini, M. (2012). Preliminary evaluation of eurogoos.eu/ . control and manoeuvring qualities for the autodrop-uuv vehicle. IFAC Proceed- Evans, J. , Redmond, P. , Plakas, C. , Hamilton, K. , & Lane, D. (2003). Autonomous dock- ings Volumes, 45 (27), 132–137 . ing for intervention-AUVs using sonar and video-based real-time 3D pose esti- Lane, D. , O’Brien, D. J. , Pickett, M. , Davies, J. , Robinson, G. , Jones, D. , et al. (1997). mation. OCEANS 2003, 4 , 2201–2210 . AMADEUS: advanced manipulation for deep underwater sampling. IEEE Robotics Excellabust website. (2018). http://excellabust.fer.hr/ . and Automation Magazine, 4 (4), 34–45 . Fairfield, N. , Kantor, G. , & Wettergreen, D. (2007). Real-time slam with octree ev- Lane, D. M., Maurelli, F., Kormushev, P., Carreras, M., Fox, M., & Kyriakopoulos, K. idence grids for exploration in underwater tunnels. Journal of Field Robotics, (2012). Persistent autonomy: the challenges of the pandora project. 24 (1–2), 03–21 . Letier, P. , Rodriguez, G. , Fau, G. , Govindaraj, S. , Siedel, T. , Gancet, J. , et al. (2017). Farr, N. , Chave, A. , Freitag, L. , Preisig, J. , White, S. , Yoerger, D. , et al. (2005). Optical 3D printed arm exoskeleton for teleoperation and manipulation applications. In modem technology for seafloor observatories. In Oceans, 2005. proceedings of Wearable robotics: Challenges and trends (pp. 385–389). Springer . mts/ieee (pp. 928–934). IEEE . Lopes, L. , Zajzon, N. , Bodo, B. , Henley, S. , Žibret, G. , & Dizdarevic, T. (2017). UN- Fornai, F. , Bartaloni, F. , Ferri, G. , Manzi, A. , Ciuchi, F. , & Laschi, C. (2012). An au- EXMIN: developing an autonomous underwater explorer for flooded mines. En- tonomous water monitoring and sampling system for small-sized asv opera- ergy Procedia, 125 , 41–49 . tions. In Oceans, 2012 (pp. 1–6). IEEE . Marani, G. , Choi, S. , & Yuh, J. (2009). Underwater autonomous manipulation for in- Galceran, E., & Carreras, M. (2013). A survey on coverage path planning for robotics. tervention missions AUVs. Ocean Engineering. Special Issue: AUV, 36 (1), 15–23 . Robotics and Autonomous Systems, 61 (12), 1258–1276. doi: 10.1016/j.robot.2013. Marine uas project website. http://www.marineuas.eu/ . 09.004 . Mars network website. (2018). http://www.marinestations.org/ . Gancet, J., Weiss, P., Antonelli, G., Pfingsthorn, M. F., Calinon, S., Turetta, A., et al. MUNIN project. (2018). http://www.unmanned-ship.org/munin/ . (2016a). Dexterous undersea interventions with far distance onshore super- Melo, J., & Matos, A. (2017). Survey on advances on terrain based navi- vision: the DexROV project. IFAC-PapersOnLine, 49 (23), 414–419. doi: 10.1016/j. gation for autonomous underwater vehicles. Ocean Engineering, 139 , 250– ifacol.2016.10.439 . 10th IFAC Conference on Control Applications in Marine Sys- 264. doi: 10.1016/j.oceaneng.2017.04.047 . http://www.sciencedirect.com/science/ temsCAMS 2016 article/pii/S002980181730241X Gancet, J. , Weiss, P. , Antonelli, G. , Pfingsthorn, M. F. , Calinon, S. , Turetta, A. , Miškovi c,´ N. , Pascoal, A. , Bibuli, M. , Caccia, M. , Neasham, J. A. , Birk, A. , et al. (2017). et al. (2016b). Dexterous undersea interventions with far distance onshore su- Caddy project, year 3: The final validation trials. In Oceans 2017-aberdeen pervision: The dexrov project. IFAC-PapersOnLine, 49 (23), 414–419 . (pp. 1–5). IEEE . Ghabcheloo, R. , Aguiar, A. P. , Pascoal, A. , Silvestre, C. , Kaminer, I. , & Hes- Nicosevici, T. , Gracias, N. , Negahdaripour, S. , & Garcia, R. (2009). Efficient three- panha, J. (2009). Coordinated path-following in the presence of communication -dimensional scene modeling and mosaicing. Journal of Field Robotics, 26 (10), losses and time delays. SIAM journal on control and optimization, 48 (1), 234–265 . 759–788 . Góis, P. , Sreekantaswamy, N. , Basavaraju, N. , Rufino, M. , Sebastião, L. , Botelho, J. , OCEAN ONE project. (2018a). https://cs.stanford.edu/groups/manips/ocean-one.html . et al. (2016). Development and validation of blue ray, an optical modem for Oceanrings website. (2018b). http://www.mmrrc.ul.ie/dotnetnuke/mmrrc/ the medusa class auvs. In Underwater communications and networking conference ResearchProjects/OceanRINGS.aspx . (ucomms), 2016 ieee third (pp. 1–5). IEEE . Olfati-Saber, R. , Fax, J. A. , & Murray, R. M. (2007). Consensus and cooperation in Global climate observing system (gcos) website. (2018). https://public.wmo.int/en/ networked multi-agent systems. Proceedings of the IEEE, 95 (1), 215–233 . programmes/global- climate- observing- system . Omerdic, E. , Toal, D. , & Vukic, Z. (2016). User interface for interaction with hetero- Global earth observation system of systems (geoss) website. (2018). http://www. geneous vehicles for cyber-physical systems. In Control, automation, robotics and geoportal.org/ . vision (icarcv), 2016 14th international conference on (pp. 1–5). IEEE . Global ocean observing system (goos) website. (2018). http://www.goosocean.org/ . Paduan, J. B. , Caress, D. W. , Clague, D. A. , Paull, C. K. , & Thomas, H. (2009). High- Häusler, A. J. , Saccon, A. , Aguiar, A. P. , Hauser, J. , & Pascoal, A. M. (2016). Energy-op- resolution mapping of mass wasting, tectonic, and volcanic hazards using the timal motion planning for multiple robotic vehicles with collision avoidance. MBARI Mapping AUV. International Conference on seafloor mapping for geohazard IEEE Transactions on Control Systems Technology, 24 (3), 867–883 . assessmen, 7 , 181–186 . Hernández, J. D., Isteni c,ˇ K., Gracias, N., Palomeras, N., Campos, R., Vidal, E., et al. Palomer, A., Ridao, P., & Ribas, D. (2016). Multibeam 3d underwater slam with prob- (2016). Autonomous underwater navigation and optical mapping in unknown abilistic registration. Sensors, 16 (4). doi: 10.3390/s16040560 . natural environments. Sensors, 16 (8), 1174–1200. doi: 10.3390/s16081174 . Palomeras, N., Pealver, A., Massot-Campos, M., Negre, P. L., Fernndez, J. J., Ridao, P., Hourani, H. , Wolters, P. , Hauck, E. , & Jeschke, S. (2013). A marsupial relationship in et al. (2016). I-AUV docking and panel intervention at sea. Sensors, 16 (10). robotics: A survey. In Automation, communication and cybernetics in science and doi: 10.3390/s16101673 . engineering 2011/2012 (pp. 667–679). Springer . Pandora website. (2018). http://persistentautonomy.com/ . Hung, N. , & Pascoal, A. (2018). Constrained cooperative path following of multiple Pizarro, O. , Eustice, R. , & Singh, H. (2004). Large area 3d reconstructions from un- autonomous vehicles with model predictive control and event triggered com- derwater surveys. In Oceans’04. mtts/ieee techno-ocean’04: 2 (pp. 678–687). IEEE . munications. 6th ifac conference on nonlinear model predictive control . Porathe, T. , Burmeister, H. , & Rdseth, O. (2013). Maritime unmanned navigation Hurtós, N. , Ribas, D. , Cufí, X. , Petillot, Y. , & Salvi, J. (2015). Fourier-based registration through intelligence in networks: The munin project. In Proc. of the 12 th in- for robust forward-looking sonar mosaicing in low-visibility underwater envi- ternational conference on computer and it applications in the maritime industries ronments. Journal of Field Robotics, 32 (1), 123–151 . (compit). Cortona (Italy) . (2018). Icarus website. http://www.fp7-icarus.eu/ . Prats, M. , García, J. , Fernandez, J. , Marín, R. , & Sanz, P. (2011). Advances in the IceClimaLizers project. (2018). https://researchportal.port.ac.uk/portal/en/projects/ specification and execution of underwater autonomous manipulation tasks. IEEE antartic- bio- constructional- benthic- organisms- as- proxies- for- climate- Oceans 2011 , 10361–10366 . change(8305228d- a9f5- 427e- bb83- 6c597102c1dc).html . Ramp, S. R. , Davis, R. E. , Leonard, N. E. , Shulman, I. , Chao, Y. , Robinson, A. , Johnson-Roberson, M. , Pizarro, O. , Williams, S. B. , & Mahon, I. (2010). Generation et al. (2009). Preparing to predict: the second autonomous ocean sampling net- and visualization of large-scale three-dimensional reconstructions from under- work (AOSN-II) experiment in the Monterey Bay. Deep Sea Research Part II: Top- water robotic surveys. Journal of Field Robotics, 27 (1), 21–51 . ical Studies in Oceanography, 56 (3–5), 68–86 . Jokioinen, E. (2016). Redefining shipping: Remote and autonomous ship the next Ribas, D., Palomeras, N., Ridao, P., Carreras, M., & Mallios, A. (2012). Girona 500 auv: steps. AAWA whitepaper, Ship Intelligence Marine , 4–5 . From survey to intervention. , IEEE/ASME Transactions on, 17 (1), 46– Kalwa, J. , Pascoal, A. , Ridao, P. , Birk, A. , Eichhorn, M. , Brignone, L. , et al. (2012). The 53. doi: 10.1109/TMECH.2011.2174065 . european r&d-project morph: Marine robotic systems of self-organizing, logi- Ribas, D., Ridao, P., Turetta, A., Melchiorri, C., Palli, G., Fernandez, J., et al. cally linked physical nodes. IFAC Proceedings Volumes, 45 (27), 226–231 . (2015). I-Auv mechatronics integration for the trident fp7 project. Mechatron- Kalwa, J. , Tietjen, D. , Carreiro-Silva, M. , Fontes, J. , Brignone, L. , Gracias, N. , ics, IEEE/ASME Transactions on, PP (99), 1–10. doi: 10.1109/TMECH.2015.2395413 . et al. (2016). The european project morph: Distributed uuv systems for multi- Ridao, P. , Carreras, M. , Ribas, D. , & García, R. (2010). Visual inspection of hydro- modal, 3d underwater surveys. Marine Technology Society Journal, 50 (4), 26–41 . electric dams using an autonomous underwater vehicle. J. Field Robotics, 27 (6), Kaminer, I. , Pascoal, A. M. , Xargay, E. , Hovakimyan, N. , Cichella, V. , & Do- 759–778 . brokhodov, V. (2017). Time-Critical cooperative control of autonomous air vehicles . Rigaud, V. , Coste-Maniere, E. , Aldon, M. , Probert, P. , Perrier, M. , Rives, P. , et al. (1998). Butterworth-Heinemann . UNION: underwater intelligent operation and navigation. Robotics & Automation Kebkal, K. , Kebkal, O. , Glushko, E. , Kebkal, V. , Sebastiao, L. , Pascoal, A. , et al. (2017). Magazine, IEEE, 5 (1), 25–35 . Underwater acoustic modems with integrated atomic clocks for one-way travel- Robocademy project website. (c). http://www.robocademy.eu . Robust website. (2018). http://eu-robust.eu/ .

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002 ARTICLE IN PRESS JID: JARAP [m5G; October 12, 2018;16:5 ]

E. Zereik et al. / Annual Reviews in Control 0 0 0 (2018) 1–19 19

Sames, P. C. (2018). Unmanned ships on the horizon. https://www.dnvgl.com/article/ Unexmin website. (2018). http://www.unexmin.eu/ . unmanned- ships- on- the- horizon- 94273 . Vallicrosa, G., & Ridao, P. (2018). H-SLAM: Rao-Blackwellized particle filter SLAM Sanz, P. , Marín, R. , Sales, J. , Oliver, G. , & Ridao, P. (2012). Recent advances in under- using Hilbert maps. Sensors, 18 (5). doi: 10.3390/s18051386 . water robotics for intervention missions. Soller harbor experiments. Low Cost Vasilijevic, A. , Vukic, Z. , & Miskovic, N. (2016). Teleoperated trajectory tracking of Books, Spain . remotely operated vehicles using spatial auditory interface. IFAC-PapersOnLine, Schmickl, T. , Thenius, R. , Moslinger, C. , Timmis, J. , Tyrrell, A. , Read, M. , et al. (2011). 49 (23), 97–102 . Cocoro–the self-aware underwater swarm. In Self-adaptive and self-organizing Vidal, E., Hernndez, J. D., Isteni, K., & Carreras, M. (2017). Online view planning for systems workshops (sasow), 2011 fifth ieee conference on (pp. 120–126). IEEE . inspecting unexplored underwater structures. IEEE Robotics and Automation Let- Serrano, D. , De Cubber, G. , Leventakis, G. , Chrobocinski, P. , Moore, D. , & Govin- ters, 2 (3), 1436–1443. doi: 10.1109/LRA.2017.2671415 . daraj, S. (2015). Icarus and darius approaches towards interoperability. Iarp rise Vgele, T., Wehbe, B., Nascimento, S., Kirchner, F., Ferreira, F., Ferri, G., et al. (2016). workshop, at lisbon, portugal. proceedings of the nato sto lecture series sci-271 . Robocademy a european initial training network for underwater robotics. In Citeseer . Oceans 2016 - shanghai (pp. 1–5). doi: 10.1109/OCEANSAP.2016.7485731 . Shoal website. (2018). https://www.roboshoal.com/ . Wang, H. H. , Rock, S. M. , & Lees, M. J. (1995). Experiments in automatic retrieval Simetti, E., Casalino, G., Torelli, S., Sperind, A., & Turetta, A. (2014). Floating un- of underwater objects with an AUV. OCEANS ’95. MTS/IEEE. Challenges of Our derwater manipulation: Developed control methodology and experimental val- Changing Global Environment. Conference Proceedings, 1 , 366–373 . idation within the trident project. J. Field Rob., 31 (3), 364–385. doi: 10.1002/rob. Williams, S. , & Mahon, I. (2004). Simultaneous localisation and mapping on the 21497 . great barrier reef. In Robotics and automation, 2004. proceedings. icra’04. 2004 Simetti, E. , Wanderlingh, F. , Casalino, G. , Indiveri, G. , & Antonelli, G. (2017). Robust ieee international conference on: 2 (pp. 1771–1776). IEEE . project: Control framework for deep sea mining exploration. In Oceans 2017 - Wimust website. (2018). http://www.wimust.eu/ . anchorage (pp. 1–5) . Wilson, P. (2012). Freesubnet a collaborative research program. 4th international con- Skredderberget, A. (2018). The first ever zero emission, autonomous ship. https:// ference on underwater system technology: Theory and applications 2012 (usys’12) . www.yara.com/knowledge-grows/game-changer-for-the-environment/ . Yoo, S. y., Jun, B. H., Shim, H., Park, J. Y., Baek, H., Kim, B. H., et al. (2015). Pre- Strongmar project website. (d). http://www.strongmar.eu . liminary water tank test of a multi-legged underwater robot for seabed explo- Subcultron website. (2018). http://www.subcultron.eu/ . rations. In Oceans 2015 - mts/ieee washington (pp. 1–6). doi: 10.23919/OCEANS. Swarms website. (2018). http://www.swarms.eu/ . 2015.7404409 . Tang, C., Wang, Y., Wang, S., Wang, R., & Tan, M. (2018). Floating autonomous ma- Youakim, D., Ridao, P., Palomeras, N., Spadafora, F., Ribas, D., & Muzzu- nipulation of the underwater biomimetic vehicle-manipulator system: Method- pappa, M. (2017). Moveit!: Autonomous underwater free-floating manipula- ology and verification. IEEE Transactions on Industrial Electronics, 65 (6), 4861– tion. IEEE Robotics Automation Magazine, 24 (3), 41–51. doi: 10.1109/MRA.2016. 4870. doi: 10.1109/TIE.2017.2772148 . 2636369 . Toal, D. , Omerdic, E. , & Dooly, G. (2011). Precision navigation sensors facilitate full Zhang, H. , & Negahdaripour, S. (2010). Ekf-based recursive dual estimation of struc- auto pilot control of smart rov for ocean energy applications. In Sensors, 2011 ture and motion from stereo data. IEEE Journal of Oceanic Engineering, 35 (2), ieee (pp. 1897–1900). IEEE . 424–437 .

Please cite this article as: E. Zereik et al., Challenges and future trends in marine robotics, Annual Reviews in Control (2018), https://doi.org/10.1016/j.arcontrol.2018.10.002