<<

The underwater environment: a challenge for planning ∗

Pedro Patron´ and Yvan R. Petillot Systems Laboratory, Heriot-Watt University, Scotland {p.patron, y.r.petillot}@hw.ac.uk

Abstract • : Scientists are faced with the need of gaining access to the most remote parts of the , This paper reviews the applications and challenges of robotic from deep trenches to fresh under the polar ice systems in the underwater domain. It focuses on the chal- lenges for achieving embedded , adaptive caps. They have to collect information in order to be able trajectory planning and adaptive mission planning. These are to understand issues such as change, the melting required elements for providing true autonomy for delegation of the polar ice caps and to forecast conditions, of tasks to unmanned underwater vehicles. The paper analy- hurricanes and tsunamis. ses approaches to tackling these challenges and how • Energy industry: In current offshore oil fields the tasks planning plays a vital role in overcoming them. It includes a description of some key applications and future concepts of of Inspection, Repair and Maintenance (IRM) comprise operations. up to 90% of the related field activity. This inspection is dictated by the vessels availability and the weather con- ditions. Additionally, the deep is still un-exploited. Introduction Gaining access to these deeper levels can provide access In the last few decades, increasing interest in oceans has re- to new sources of minerals and energy. sulted in unprecedented attention being focussed on them. • Military: A priority to current Navy operations is to Although they cover 71% of the ’s surface, humankind maintain clear access to ship passages and to protect ves- has sent more astronauts to the Moon than scientists to the sels, harbours and coastal . Achieving these capa- deepest parts of our . It was almost 10 years after reach- bilities without compromising personnel safety due to foe ing the surface of the Moon, that the deepest parts of the actions is still unsolved. oceans were finally reached. Since then, goverments and industry have become more and more interested in under- For all these disciplines, robotic platforms are proven to standing and managing our and they have realised be very useful in de-risking activity in the hostile how important the underwater regions, two thirds of the to- underwater environment. The main challenges that robotic tal Earth’s surface, are. Nowadays, it is not only the need systems have to deal with underwater are: to discover, but also to observe, map and protect our oceans • Power : Robots are highly dependant on their battery that motivates further exploration of underwater regions. in a domain without possibility of extending it from other Unfortunately, access to these regions is not straightfor- external sources. ward. The underwater environment is a hostile environment for and human technology. It can challenge some of • Communication : is the media use for sensing and the capabilities that are now taken for granted in other do- communicating underwater. Low bandwidth, long delays mains such as the Earth’s surface, the atmosphere or outer and high-power requirements impose many restrictions. space. Some of the most representative and specific chal- • Perception : Visual methods are poor while acoustic lenges underwater are high , corrosion and signal methods come with many false positives. They are af- processing issues related to data transmission and sensing. fected by , pressure and making them Even though the underwater domain presents such chal- very noisy. Range is inversely related to the frequency lenges, several maritime disciplines still require access to and normally quite reduced (see Fig. 1). Additionally, raw this environment. The most relevant ones are: sensor data has to be ultimately processed into conceptual ∗The study reported in this paper is partly funded by the knowledge in order to build the awareness of the environ- Project RT/COM/5/059 from the Competition of Ideas and by ment. the Project SEAS-DTC-AA-012 from the Systems Engineering for Autonomous Systems Defence Technology Centre, both estab- • Navigation : The underwater environment is a GPS- lished by the UK Ministry of Defence. denied area. Existing underwater maps are still quite in- Copyright c 2008, Association for the Advancement of Artificial nacurate. Together, these make localization and orienteer- Intelligence (www.aaai.org). All rights reserved. ing for navigation a very hard problem. Figure 1: Acoustic image of 50m range of a WWI U-boat sunk in Hoxa Sound, (courtesy of SeeByte Ltd.).

• Delegation: Autonomous adaptation of different tasks Figure 2: Typical ROV inspection operation of a riser with a to changes in the environment has not yet been fully fluorometer sensor. achieved. Without it, it is necessary that the operator re- mains in the loop, observing and taking decisions. Au- tonomous adaptation to sensed changes is necessary to gain the operator’s trust and acceptance and for them to delegate tasks to the robotic platform (Johnson, Patron,´ and Lane 2007). Although new are already being developed to extend power autonomy and communication requirements, the other three issues (perception, navigation and delega- tion) are still a real challenge for achieving true autonomy in robotics in the underwater environment. This paper de- scribes each of these challenges and provides an overview on how reasoning tools and autonomous planning approaches can contribute to overcoming them. Figure 3: AUV recovery after finishing a mission (courtesy of SeeByte Ltd.). Robotic platforms Unmanned underwater vehicles can be classified in Remote existing ROVs. However, when the communication is poor, Operated Underwater Vehicles (ROVs) (see Fig. 2), Au- unreliable or not allowed, the operator tries, based only on tonomous Underwater Vehicles (AUVs) (see Fig. 3) and the initial orientation or expertise, to include all possible be- Underwater Gliders. They differ on the power capability, haviours to cope with execution alternatives. This has unpre- power endurance and the task complexity that they have dictable consequences, in which unexpected situations can been designed for. cause the mission to abort and might even cause the loss of Underwater vehicles have become a standard tool for data the vehicle. Examples of this architecture are current imple- gathering for Maritime applications. In these environments, mentations for AUVs and gliders. mission effectiveness directly depends on vehicle’s oper- ability. Operability underlies the vehicle’s final availability, affordability and acceptance. Two main vehicle characteris- Towards adaptive autonomy tics can improve the vehicle’s operability: reliability relates Autonomous adaptation can release the operator from deci- to vehicle failures due to the internal hardware components sion making tasks at the trajectory and mission planning lev- of the vehicle, and survivability relates to vehicle failures els. These, in consequence, can require less communication due to external factors or damages. with the consequent power saving. Adaptation plays an im- Each of these characteristics can be improved by pro- portant role in providing autonomy. The aim is to be effec- viding autonomous adaptation of the mission plan and au- tive and efficient and a plan costs time to prepare. This time tonomous adaptation of the trajectory plan respectively. has been already invested once (to compute the plan that is Both require access to the correspondent levels of percep- now failing), so it might be more efficient to try to reuse pre- tion in order to build their own situation awareness. vious efforts by repairing it. Also, commitments might have In current implementations, the human operator consti- been made to the current plan: trajectory reported to other tutes the decision making phase. When high-bandwidth intelligent agents, assignment of resources or assignment of communication links exist, the operator remains in the loop part of mission plan to executors, etc. Repairing an existing during the mission execution. Examples of this approach are plan ensures that as few commitments as possible are inval- INTERACTIONABSTRACTION LEVEL CONTROL LEVEL Situation Awareness Human SA Both UXV SA Delegation Instructions Mission Mission State Instructions Goal-based

Mission Acceptance Management Trajectory Beliefs Execution Waypoint-based State Demands Low Level of Autonomy High Desires Trust Trajectory Management Intentions Vehicle Control Figure 4: Human and AUV SA across the levels of auton- State Demands omy UNMANNED Vehicle OPERATOR VEHICLE Control idated. Finally, several planners (usually autonomous and Figure 5: Levels of control related to the level of abstraction human planners combined) could be performing together to of knowledge for operator’s delegation of tasks to unmanned achieve the goals. In such cases, it is more likely that a sim- vehicles. ilar mission plan will be accepted by the operator than one that is potentially completely different. information to be stored, accessed and shared efficiently by Autonomous adaptation requires an autonomous under- the deliberative agents while performing a mission. These standing of the environment. The human capability of deal- agents, providing different capabilities, might even be dis- ing and understanding highly dynamic and complex envi- tributed among the different platforms working in collabo- ronments is known as situation awareness (SAH ). SAH ration. breaks down into perception of the environment, compre- Semantic frameworks have recently raise interest provid- hension of the situation and projection of the future status. ing hierarchical distributed representation of knowledge for Decision making occurs in a cycle of observe-orient-decide- multidisciplinary agent interaction (Patron´ et al. 2008a). act (OODA) (Boyd 1995). The Observation component They provide with a common machine understanding rep- corresponds to the perception level of SAH . The Orienta- resentation of knowledge between embedded agents that is tion component contains the previously adquired knowledge generic and extendable. They also include a reasoning inter- and understanding of the situation. The Decision component face for inferring new knowledge from the observed data and represents the SAH levels of comprehension and projection. knowledge stability by checking for inconsistencies. These This last stage is the central mechanism enabling adaptation frameworks improve local (machine level) and global (sys- before closing the loop with the final Action stage. Note that tem level) situation awareness and context for mission and it is possible to take decisions by looking only at orientation trajectory behavior. They can therefore act as enablers for inputs without making any use of observations. autonomy and on-board decision making. Based on the autonomy levels and environmental char- There are currently several institutions and consortiums acteristics, SAH definitions can be directly applied to developing standards for knowledge representation under the notion of unmanned vehicle situation awareness these frameworks. Particular attention is taking the effort (SAV ) (Adams 2007). Increasing the levels of situation describing the concepts and relationships for the domains of awareness for individual unmanned vehicle systems (SAS) unmanned platforms (jau 2008) and the underwater environ- can help the transfer from current full human control to fully ments (mmi 2008). An example is shown in Fig. 6. autonomous unmanned capabilities (see Fig. 4). This knowl- edge representation is the focus of the next section. Trajectory planning Knowledge representation and transfer Navigation and mapping At present, knowledge representation is embryonic and tar- Existing geographical information for trajectory planning gets simple mono-platform and mono-domain applications, can be represented using knowledge-based frameworks. therefore limiting the potential of multiple coordinated ac- However, mapping of the environment depends on the un- tions between agents. Consequently, the main application certainty in the position of the vehicle when the obstacles for autonomous underwater vehicles is information gather- are observed and mapped. Navigation in unknown under- ing from sensor data. In a standard mission flow, data is water environments entails high levels of uncertainty. collected during mission and then post-processed off-line. Geolocating a vehicle on the World’s surface can be accu- However, in order to be able to let decision making tech- rately performed by using Global Positioning System (GPS) nologies evolve towards providing higher levels of auton- receivers. But GPS does not work underwater as the radio omy and control, embedded service-oriented agents require signals on which it depends cannot pass through water. Dead access to higher levels of knowledge representation or ab- reckoning is the standard technique used underwater and in- straction (see Fig. 5). These higher levels will be required to volves use of Inertial Measurement Units (IMUs), a combi- provide knowledge representation for contextual awareness, nation of accelerometers and gyroscopes. Abbe error, mag- temporal awareness and behavioural awareness. nification of angular error over distance, can be detrimental Two sources can provide this type of information: the do- to dead reckoning. Inertial Navigation Systems (INS) in- main knowledge extracted from the original expert (orien- tegrate accelerations and rates to provide a Kalman filtered tation) or the inferred knowledge from the processed sensor navigation . They use inputs from acoustic transmit- data (observation). In both cases, it will be necessary for the ters and receivers to pin-point the platform’s location. How- Core Ontology T Box/ABox for MCM Mission • CAD Module - hasRequirement: Sidescan - isCapableOf: Mine-like objects detection, • CAC Module - hasRequirement: Mine-like objects detection - isCapableOf: Mine-like objects classification, • CAD/CAC Payload - hasSoftware: CAD/CAC Module, • Platform - hasPayload: Payload, ... ? MarineSonic ∈ Sidescan, ? SBCAC ∈ CAC, ? SBCAD ∈ CAD, ? SB337 ∈ CAD/CAC Payload - hasSoftware: SBCAD & SBCAC, ? Remus337 ∈ Platform - hasHardware: MarineSonic Figure 7: Original, Kalman filtered and RTS smoothed tra- - hasPayload: SB337,... jectory of an underwater vehicle. Planning Application Ontology T Box/ABox for MCM • Action - hasRequirement:, hasPlatform:, • Mission - hasRequirement:, hasPlatform:, ... ? Explore ∈ Action - hasRequirement: Sidescan driver, ? Detect ∈ Action - hasRequirement: Mine-like objects detection, ? Classify ∈ Action - hasRequirement: Mine-like objects classification, ? Clearance ∈ Mission - hasRequirement: Mine-like object classification, ...

Figure 6: Example of platform domain and mission planning application description for a mine counter measure (MCM) Figure 8: Top: Net avoidance trajectories obtained with the underwater scenario. dynamic model simulator. Bottom : Three sequential obser- vations of the local map with trail showing planned forward trajectory to achieve the waypoint in a real scenario. ever, the range of these systems is limited to no more than a few nautical miles thus restricting the vehicles autonomy. A better approach involves aiding the INS with a Doppler Ve- Obstacle avoidance locity Log (DVL) sensor that measures the displacement rate Once the navigation and mapping error has been bounded, over the seabed. No matter how accurate the sensors are, the an adaptation of the trajectory and waypoints is required errors in these systems grow with time and the platform be- during mission when unexpected events on the planned tra- comes progressively lost unless it is able to obtain external jectory are sensed. Collision avoidance and escape is a key references from acoustic devices or from a GPS receiver on capability for underwater vehicle navigation. the surface. This uncertainty in the vehicle’s location gets Traditional approaches to collision avoidance and escape passed to the geolocation of the observed elements in the are purely reactive and usually involve an algorithmic for- environement during the mapping process. mulation of response dictated by the objects geometries and A promising alternative is Simultaneous Localisation And locations and the relative location of the vehicle. Recent ap- Mapping (SLAM). Using SLAM a platform maps the envi- proaches in rules of collision (Benjamin et al. 2006) and ronment and uses the map to localise itself in it. The map can obstacle avoidance and escape scenarios (Evans et al. 2007) be georeferenced if the platform maintains an estimate of its have focused on reducing susceptibility by looking at the absolute position when the process of mapping is started. adaptation of the vehicle’s trajectory plan. These delibera- A recent development has shown that it is possible to post- tive behaviours provide the defined and bounded event re- process and smooth the SLAM solution using the Rauch- sponses that link to geometric methods of trajectory plan- Tung-Striebel smoother (see Fig.7). This new technique, ning. coined SLAM-RTS, has been used to create better maps of At the trajectory planning level, lifelong planning incre- the environment and to help the trajectory planning systems mental search methods have been found to decrease com- to accurately locate the sensed obstacles in the map (Patron´ putation time while still locating the shortest trajectory be- and Tena-Ruiz 2006). tween vehicle and goal (Koenig, Likhachev, and Furcy begin_dummy 1 1 remus337 wpStart sarea1 wpStart rarea2 wpStart wpEnd wpEnd wpStart wpEnd sarea1 wpEnd rarea2 sarea1 wpStart ... 0

462:?from_327_50=sarea1 (at remus337 ?from_603_50) 603:?from_462_50=rarea2 111:?from_603_50=wpStart navigate 2 1 remus337 ?from_603_50 rarea2 0

(at remus337 ?from_462_50) (at remus337 rarea2)

navigate 2 reacquire 3 1 1 remus337 ?from_462_50 sarea1 0 remus337 rarea2 0

(at remus337 sarea1) (at remus337 ?from_327_50)

survey 1 navigate 2 1 1 (reacquired rarea2) remus337 sarea1 0 remus337 ?from_327_50 wpEnd 0

(surveyed sarea1) (at remus337 wpEnd)

end_dummy 1 1 sarea1 rarea2 remus337 wpEnd

Figure 10: Partial plan representation of an underwater mis- sion.

In a similar way, fault-tolerant mission planning adap- tation can also contribute towards providing more mission flexibility and robustness. When active and passive mea- sures fail to protect the vehicle, or unexpected hardware fail- Figure 9: AUV survey of two seabed areas with an adaptive ures occur, the focus of the mission should shift to ’reconfig- mission planner capable of reacting to water currents and ure’ itself to use alternative combinations of the remaining sensor faults. resources (see Fig. 9). In the underwater environment, au- tonomous embedded recoverability, is a key capability for vehicle’s endurance. This can be achieved via adaptation of 2004). Instead of starting from scratch every time a tra- the vehicle’s mission plan (Patron´ et al. 2008c). The aim jectory must be adapted, they reuse data found in previous is to provide with a mission plan as close as possible to the searches to save on computation time. Wave propagation original. In such case, plan optimality during the adaptation techniques can also provide with smoother and shorter tra- process can be sacrified for plan stability (Fox et al. 2006). jectories than classic discrete search approaches. This fast This level of control can also benefit from the use of marching methods are capable of dealing with uncertainty, knowledge frameworks. Adaptation is limited to the quality dynamic objects and kinematics of the vehicle during the and scope of the available information. Therefore, to adapt adaptation process (Petrˆ es` et al. 2007). A real application of mission plans due to unforeseen and incipient faults, it is these techniques in the underwater environment is shown in required that accurate information is available, to recognize Fig. 8. that a fault has occurred and deduce the root cause of the Mission planning failure. Current robotic solutions are generally equipped with Single platform Failure Diagnosis and Detection (FDD) systems based on Current mission plan solutions for underwater platforms damage control that results in the vehicle resurfacing in are procedural and static (Hagen 2001). If behaviors are the event of any fault in the system. But future operations added (Pang et al. 2003), they are only to cope with pos- will require long-endurance unattended systems that operate sible changes that are known a-priori by the operator. In or- even while being partially damaged or while having con- der to achieve higher levels of autonomy, plan adaptability strained capabilities. Hence, it is important to develop sys- should be available not only to procedural waypoint-based tem which not only detect failure in the component but also approaches on trajectory planning but also to a declarative provide mission plan modules capable of adapting and re- goal-based solution for adaptive mission planning. covering from these failures. This exchange of meaningful On a goal-oriented command and control, decision tools and reliable knowledge between FDDs and mission planners can be developed providing support for adaptive data sam- can leverage on the use of semantic knowledge frameworks. pling, optimization of resources and fault recovery capa- Once the knowledge has been transferred from the FDD, bilities of the platform (Bellingham, Kirkwood, and Rajan the adaptation approach combines robust execution and mis- 2006). sion plan repair in order to maximize system performance The potential benefits of the planning capabilities for and response time. Two levels of repair are possible. If the adaptive data sampling have been studied by Rajan (Rajan et fault coming from the FDD is incipient or non-critical, a re- al. 2007) and Fox (Fox et al. 2007). An example of this ap- pair at the executive level is performed. This entails adapt- plication is the T-Rex system, an adaptive planning architec- ing the intances and parameters of the action performing the ture with notions of timing and onboard resource manage- task without changing the action itself. If a critical fault on ment responsiveness to opportunistic science events (Mc- a component is diagnosed, a repair at the plan level is per- Gann et al. 2007). formed that changes the action requiring of the component Conclusion Robotic platforms are helping marine applications to gain routine and permanent access to the underwater environ- ment. However, challenges related to this domain require the development and integration of more evolved embed- ded tools that can raise the platform’s autonomy levels while maintaining the trust of the operator. This paper shows how knowledge representation, reasoning and planning tools can Figure 11: Fleet of unmanned underwater vehicles perform- help to overcome these challenges. The study describes cur- ing a survey pattern task in collaboration for an Autonomous rent approaches to situation awareness, trajectory planning Target Recognition (ATR) scenario. and mission planning for underwater vehicles. It finishes by highlighting the long-term scenarios that can also benefit from planning tools. and the constraints on the action. During this decision mak- ing process, a combination of refinement and unrefinement References phases of the constraints of a partial ordered mission plan Adams, J. A. 2007. Unmanned vehicle situation awareness: can be used (Patron´ et al. 2008b) (see Fig. 10). A path forward. In Human Systems Integration Symposium. Bellingham, J.; Kirkwood, B.; and Rajan, K. 2006. Tutorial Collaborative planning on issues in underwater robotic applications. In ICAPS. Benjamin, M.; Curcio, J.; Leonard, J.; and Newman, P. Mission plan adaptation can be extended to multiple plat- 2006. Navigation of unmanned marine vehicles in ac- forms. The potential benefits of multi-vehicle operations cordance with the rules of the road. Int. Conference on include -multiplier effects, avoidance and Robotics and Automation (ICRA). the utilisation of heterogeneous vehicle configurations to re- Boyd, J. 1995. Ooda loop. duce risk to expensive assets. But to achieve the full bene- fits, suitable architectures that facilitate true cooperative au- Cartwright, J.; Patron,´ P.; Evans, J.; and Lane, D. 2007. tonomous planning for task splitting and allocation must be Distributed ontological world model for autonomous multi realised (Evans et al. 2006). vehicle operations. In Systems Engineering for Au- tonomous Systems Defence Technology Centre. In this case, it is necessary to extend the single vehicle mission plan recovery to a mission plan recovery for a group Evans, J.; Sotzing, C.; Patron,´ P.; and Lane, D. 2006. or team of vehicles performing a collaborative mission. A Cooperative planning architectures for multi-vehicle au- shared situation awareness is required for the team of vehi- tonomous operations. In Conference of Systems Engineer- ing for Autonomous Systems Defence Technology Centre cles (SAT ) to which every team member possess the SAS . required for its responsibilities (Cartwright et al. 2007). The Evans, J.; Patron,´ P.; Smith, B.; and Lane, D. 2007. De- main challenge in this case is to deal with the acoustic com- sign and evaluation of a reactive and deliberative collision munication limitations associated to the underwater environ- avoidance and escape architecture for autonomous robots. ment (Sotzing, Evans, and Lane 2007). Journal of Autonomous Robots. Fox, M.; Gerevini, A.; Long, D.; and Serina, I. 2006. Plan Sensing networks and beyond stability: Replanning versus plan repair. In Proceedings of International Conference on AI Planning and Scheduling The elements previously described are the most immediate (ICAPS). requirements for unmanned platforms in the underwater do- Fox, M.; Long, D.; Py, F.; Rajan, K.; and Ryan, J. 2007. main. However, other long-term subsea applications are ap- In situ analysis for intelligent control. In IEEE OCEANS pearing posing other problems and challenges. The planning Conference, Vancouver. community can help to overcome them. Hagen, P. 2001. Auv/uuv mission planning and real time Ocean observatories in oceanology, all year round sub- control with the hugin operator system. In IEEE OCEANS sea field inspection for the energy industry and continous 2001, volume 1. harbour and coast patroling for the Navy are emerging, re- 2008. Society of automotive engineers as-4 joint architec- quiring a more permanent presence of robotic and sensing ture for unmanned systems. http://www.jauswg.org/. tools underwater. These applications are demanding under- Johnson, N.; Patron,´ P.; and Lane, D. 2007. The impor- water networks of fixed sensors in combination with fleets tance of trust between operator and auv: Crossing the hu- of AUVs and gliders. These sensing webs require decision man/computer language barrier. In IEEE Oceans Europe. making algorithms in order to be able to optimize the man- agement of heterogeneous assets and resources, to couple Koenig, S.; Likhachev, M.; and Furcy, D. 2004. Lifelong observation systems and ocean models, to minimize error planning a*. Artificial Intelligence 155(1-2):93–146. in the reconstruction of ocean fields and to provide fast dy- McGann, C.; Py, F.; Rajan, K.; Thomas, H.; Henthorn, R.; namic response to events. and McEwen, R. 2007. T-rex: A model-based architecture for auv control. In ICAPS, Workshop in Planning and Plan J. 2008b. Adaptive mission plan diagnosis and repair for Execution for Real-World Systems. fault recovery in autonomous underwater vehicles. In IEEE 2008. Marine metadata interoperability. Oceans Quebec. http://www.marinemetadata.org/. Patron,´ P.; Miguelanez, E.; Petillot, Y.; and Lane, D. Pang, S.; Farrell, J.; Arrieta, R.; and Li, W. 2003. Auv 2008c. Fault tolerant adaptive mission planning with se- reactive planning: deepest point. In IEEE OCEANS 2003, mantic knowledge representation for autonomous under- volume 4. water vehicles. In IEEE IROS Nice. Patron,´ P., and Tena-Ruiz, I. 2006. A smooth simulta- Petrˆ es,` C.; Pailhas, Y.; Patron,´ P.; Petillot, Y.; Evans, J.; and neous localisation and mapping solution to improve situ- Lane, D. 2007. Path planning for autonomous underwater ational awareness, mission planning and re-planning for vehicles. IEEE Transactions on Robotics 23(2):331–341. auvs. In World Maritime Technology Conference - Ad- Rajan, K.; McGann, C.; Py, F.; and Thomas, H. 2007. Ro- vances in Technology for Underwater Vehicles. bust mission planning using deliberative autonomy for au- Patron,´ P.; Miguelanez, E.; J.Cartwright; and Petillot, Y. tonomous underwater vehicles. In ICRA Robotics in chal- 2008a. Semantic knowledge-based representation for im- lenging and hazardous environments. proving situation awareness in service oriented agents of Sotzing, C.; Evans, J.; and Lane, D. 2007. A multi-agent autonomous underwater vehicles. In IEEE Oceans Que- architecture to increase coordination efficiency in multi- bec. auv operations. In Proceedings of IEEE Oceans. Patron,´ P.; Miguelanez, E.; Petillot, Y.; Lane, D.; and Salvi,