VISIONS TO REALITY Scaling Up Marine Science and Conservation 2018 VISIONS TO REALITY
VISIONS TO REALITY 2018
VISIONS TO
REALITY 2018
VISIONS TO REALITY
COVER Main Image: In early March (two months before Falkor departed for the same mission), two saildrones were deployed from San Francisco to be a part of the "Voyage to the White Shark Café" expedition.They transmitted data in real-time since their departure, listening for the acoustic tags that were attached to sharks, while also scanning with a sonar to detect the deep scattering layer. Hexagon 1: A cirrate octopus has ear-like fins that they use for propulsion. Hexagon 2: Dr. Camilli directs the delicate deployment of a glider from Falkor's aft deck. Hexagon 3: A tall chimney in a new hydrothermal vent field discovered in 2018. Hexagon 4: Trent Lukaczyk prepares a Flightwave Edge for a test flight from the storage deck of the R/V Falkor.
THIS PAGE Researchers and ship crew inspect an AUV at the beginning of the "Pescadero Vent" expedition. REPO REPO
2018 2018 2018 REPOR REPOR ANNUAL ANNUAL ANNUAL ANNUAL R R Falkor sailsatsunsetinHawaiianwaters. T T
2018 CONTENTS T T Table of
4 accelerate marinescience and clouddataanalytics Visions comingtrue Visions Artificial Intelligence Artistic endeavors INSPIRING INSPIRING DIGITIZING MARINE LIFE DIGITIZING MARINELIFE ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCE AND ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCEAND CLOUD DATA ANALYTICS CLOUD DATAANALYTICS TECHNICAL INNOVATION TECHNICAL INNOVATION AND SEAFLOORHABITATS SCALING UP MARINE CONSERVATION WITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH AND SEAFLOORHABITATS SCALING UPMARINECONSERVATIONWITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH AND SHARING ARTISTIC AND SHARING ARTISTIC ENDEAVORS ENDEAVORS 55 29 7 supply airventilationfancapacity. Implemented upgradestoincreasemainbusscapacityandthe Eme gen Gene ato Replaced allofthecoolerplates. Sea Wate Coole Conducted majoroverhaul. Po t MainEngineCl t h Performed majoroverhaulof14cylinderheads. Main Engine FALKOR ENGINEERINGDEPARTMENT ROV SUBASTIAN interactive researchandanalysisoftheseafloor. automated linefollowingcapabilitytocombinetheseimagesetsintodetailed3Dand2Dmodelsfor stereo-imagery oftheseaflooraroundseeps,vents,andwhalefalls.ThisskidutilizesSuBastian'snew SOI's engineersdevelopedaphotomosaicingskidmountedunderSuBastiantocollecthighresolution Seafloo Ste eoImage Capa ilit land-based operatingstation. Designed andtestedin-housearchitectureallowingcontrolofSuBastiantetheredtoFalkorfroma Remote Ope ationofROVS Ba tian providing historicaldataforfuturestudies. saved inarepositoryallowingtheirusebyscientistsaroundtheglobeand better exposuretotheskyandcollectionofimportantnewdata. Data are Falkor's suiteofsunlightsensorswererelocatedandexpanded,allowingfor I adian e Sen o information allowsreviewbyshoresidecollaboratorsandstaff. time stampingandgeoofROVscienceevents.Onlineaccesstothis operations aswellscientificROVoperations,allowingforeasyannotation, Developed softwareloggingsystemtotrackvehicletechnicalandscientific ROV E entLogge FALKOR SCIENCEDEPARTMENT Numbers andmetrics technical innovation Scaling upmarine conservation with Improvements & developments targets, anddirectingtheROVtokeystudysites. using reconnaissancemappingtopinpointsubsea and diveefficienciesworkingsimultaneouslywithAUVs Added newoperationalprocedurestomaximizeshiptime Ope ational P o ed e waypoints areexecuted. line following and control overthespeedat which Added new waypoint execution mode for much tighter Bette Vehi leCont ol A stepahead: unauthorized computersorusers. implementation ofasophisticatedsoftwaresystemthatprotectstheentirenetworkfrom Redesigned theenrollmentprocessforwirelessandwirednetworksthrough C e e it al o Net o En ollment vessel first! system tosupportscientists'andresearchers'newemergingtechnologies.Aresearch Installed GraphicsProcessingUnitpowertoFalkor'sHighPerformanceComputer High Pe fo man eComp ting (2013-2018) FALKOR AUDIOVISUAL/INFORMATIONTECHNOLOGYELECTRONICS INSPIRING DIGITIZING MARINELIFE ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCEAND CLOUD DATAANALYTICS TECHNICAL INNOVATION AND SEAFLOORHABITATS SCALING UPMARINECONSERVATIONWITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH Ship-to-Sho e VideoEnhan ement ARTISTIC AND SHARING ENDEAVORS By usingthecorevideomatrixandcuttingedgeaudio distribution Falkorcrewmemberscannowroutereal-time events totheencodersandpushthemstraightinternet over thesatelliteconnection. 12 58 35 SuBastain onasingledive. including the integration of 19 new pieces of equipment onto Expanded growinginventoryofscientificinstrumentation, E ipment provide lowervoltagerange(i.e5v,6v,12v&24v). integration (i.e.110v-220v)andaddedvoltageregulatorsto instruments tohaveagreaterpowerrangeforsensor Installed asciencetransformertoallowresearchers' Mo e Po e Option Above Above Table 5.0 Table Start : 3D Overviewthe proposed of
Shallow to Deep to Shallow : Profi Profile Line North
–
le l le
Profile line shallowestProfile intersecting the and deepest poi
ine
A researchvesselfirst! packages between the modemsandserviceproviders. shipboard systemusesfourinternalmodemstothe speed ratesarenowupto160Mbps.Thenew using 4Gdataserviceupto 25 nauticalmilesoffshore; Commissioned hardwareandsoftwareaboardFalkorfor a te Inte net shoreside technicalteams. devices aboardFalkorwillsendproblemalertsto functionality ofshipboardcriticalsystems.Soonall network sensors were added to ensure proper monitoring, fromserverstotheHVACsystems.New All shipboardnetworkdevicesareinconstant24/7 Ad an ed Ship oa dMonito ing
through both 10306m Length
Indy Maru Seamount the shallowestand deepest theproposed pointof [ [ Indy Maru Seamount Supporting Image 006.tif Image Supporting Seamount Maru Indy 005.tif Image Supporting Seamount Maru Indy E 134E 45.395 N 12 07.251, Start
12 02.2758561N 134 47.448084 E 134 46.375966 E 12 04.708669N 3546m Min Depth
E 134E 47.459 N 12 02.040, feature withfeature 1974m
End
both the 134 46.375966 E Shallowest Point 12 04.708669N 1974m nt of the proposed summitdeepest and locationhighlighted
134 46.375966 E 12 04.708669N
] ] 1974m Indy MaruIndy Seamount
12 02.2758561N 134 47 134
Deepest Point
3546m .448084 E .448084 North
Indy Seamount Maru
END
Total Relief 1482m .
[Fladermaus]
12 02.2758561N 134 47.448084 E Max Depth
3546m [CARIS]
START
End
operations. deployment andrecovery the floatsduringvehicle method ofstowingandinstalling ergonomic, safeandefficient Deck toallowforamore fabricated a float rack for the Aft Falkor's EngineDepartment Um ili al Catena loatRa o
FALKOR FALKOR Above Above Table 5.0 Table Start : 3D Overviewthe proposed of
Shallow to Deep to Shallow : Profi Profile Line North
–
le l le
Profile line intersecting line shallowestProfile intersecting the and deepest poi
ine
through both 10306m Length
Indy Maru Seamount the shallowestand deepest theproposed pointof [ [ Indy Maru Seamount Supporting Image 006.tif Image Supporting Seamount Maru Indy 005.tif Image Supporting Seamount Maru Indy E 134E 45.395 N 12 07.251, Start
12 02.2758561N 134 47.448084 E 134 46.375966 E 12 04.708669N 3546m Min Depth
E 134E 47.459 N 12 02.040, feature withfeature 1974m
End
both the 134 46.375966 E Shallowest Point 12 04.708669N 1974m nt of the proposed summitdeepest and locationhighlighted
134 46.375966 E 12 04.708669N
] ] 1974m Indy MaruIndy Seamount
12 02.2758561N 134 47 134
Deepest Point
3546m .448084 E .448084 North
Indy Seamount Maru
END
Total Relief 1482m .
[Fladermaus]
12 02.2758561N 134 47.448084 E Max Depth
3546m [CARIS]
START
End
FALKOR 09 07 06 Above Above Table 5.0 Table Start : 3D Overviewthe proposed of
Shallow to Deep to Shallow : Profi Profile Line North
–
le l le
Profile line shallowestProfile intersecting the and deepest poi
ine
through both 10306m Length Noteworthy updates
Indy Maru Seamount the shallowestand deepest theproposed pointof Where wehavebeen [ [ Indy Maru Seamount Supporting Image 006.tif Image Supporting Seamount Maru Indy 005.tif Image Supporting Seamount Maru Indy E 134E 45.395 N 12 07.251, Start
12 02.2758561N 134 47.448084 E 134 46.375966 E 12 04.708669N 3546m What wefound Min Depth
E 134E 47.459 N 12 02.040, feature withfeature 1974m
End
both the 134 46.375966 E Shallowest Point 2013-2018 12 04.708669N 2018 Map 1974m nt of the proposed summitdeepest and locationhighlighted 60
134 46.375966 E 12 04.708669N
] ] 1974m Indy MaruIndy Seamount
12 02.2758561N 134 47 134
Deepest Point 14
3546m .448084 E .448084 North
40 Indy Seamount Maru
09
END 07 06
Total Relief 1482m .
[Fladermaus]
12 02.2758561N 134 47.448084 E Max Depth
3546m [CARIS]
START
End
FALKOR Scientific publicationsand Digitalizing marinelife and seafloorhabitats 2018 Highlights Making waves presentations INSPIRING DIGITIZING MARINELIFE ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCEAND CLOUD DATAANALYTICS TECHNICAL INNOVATION AND SEAFLOORHABITATS SCALING UPMARINECONSERVATIONWITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH AND SHARING ARTISTIC ENDEAVORS 43 2018 16 62 Scalable oceanresearch with autonomousrobots
5 Inspiring and Photo credits INSPIRING INSPIRING DIGITIZING MARINELIFE DIGITIZING MARINELIFE ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCEAND CLOUD DATAANALYTICS ACCELERATE MARINESCIENCE ARTIFICIAL INTELLIGENCEAND CLOUD DATAANALYTICS TECHNICAL INNOVATION AND SEAFLOORHABITATS SCALING UPMARINECONSERVATIONWITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH TECHNICAL INNOVATION AND SEAFLOORHABITATS SCALING UPMARINECONSERVATIONWITH AUTONOMOUS ROBOTS SCALABLE OCEANRESEARCHWITH AND SHARING ARTISTIC ENDEAVORS AND SHARING ARTISTIC ENDEAVORS Above Above Table 5.0 Table Start : 3D Overviewthe proposed of sharing
Shallow to Deep to Shallow : Profi Profile Line North
–
le l le
Profile line shallowestProfile intersecting and the deepest poi
ine
through both 10306m Length 21
Indy Maru Seamount the shallowestand deepest theproposed pointof [ [ Indy Maru Seamount Supporting Image 006.tif Image Supporting Seamount Maru Indy 005.tif Image Supporting Seamount Maru Indy E 134E 45.395 N 12 07.251, Start
12 02.2758561N 134 47.448084 E 134 46.375966 E 12 04.708669N 3546m Min Depth
E 134E 47.459 N 12 02.040, feature withfeature 1974m
End
48
both the 134 46.375966 E Shallowest Point 12 04.708669N 1974m nt of the proposed 67 summitdeepest and locationhighlighted
134 46.375966 E 12 04.708669N
] ] 1974m Indy MaruIndy Seamount
12 02.2758561N 134 47 134
Deepest Point
3546m .448084 E .448084 North
Indy Seamount Maru
END
Total Relief 1482m .
[Fladermaus]
12 02.2758561N 134 47.448084 E Max Depth
3546m [CARIS]
START
End
FALKOR
2018 A workingplatform Front andcenter Collaborators REALITY REALITY VISIONS TO VISIONS TO 26 53 09 68 07 06 REALITY REALITY VISIONS TO VISIONS TO 09 07 06
2018 REPO REPO
2018 2018 2018 REPOR REPOR ANNUAL ANNUAL ANNUAL ANNUAL R R autonomous robot's deployment. Opah off R/VFalkor'saftdeckduringthe University ofHawaiiManoa,guideLRAUV (MBARI), andGabeForeman, of Bay AquariumResearch Institute andBrianKieft,ofMonterey John Ryan T T
2018 T T
6 Artificial Intelligence andRobotics Begin to Transform Ocean Conservation andResearch remotely operatedvehicleSuBastian onboard. sea supporting11selectresearch projects, including135dayswith productive yearin2018.Research vesselFalkorspent243daysat innovation, SchmidtOceanInstitutecompleteditsbusiestandmost Established nearlyadecadeagotoadvanceoceanresearch with research, conservation,andmanagementatscale. technology frontiers canoffer effective toolstoaccelerateocean The developmentsinrobotics, artificialintelligence(AI),andother in our ability to understand,foresee, andaverttheirharmful effects. Global scaleandfuriousrateofchangecallfordramaticacceleration quarter ofallknownoceanicspeciesare losingaplacetocallhome. overexploitation push marine life to the edge of survival. More than a Rapid oceanwarming,acidification,deoxygenation,pollution,and activity intherecent decades. nutrients andresources -despitetheglobaldisturbances from human the oxygenwebreathe, regulated ourweather, andsuppliedcritical part in sustaining it. For millennia, the seas have produced most of earliest emergenceoflifeonEarth,theoceanhasplayedacrucial water istheprincipalhabitabilitycriterioninastrobiology. From the The oceangiveslife.Itisnosurprisethattheabundanceofliquid VISIONS COMINGVISIONS TRUE - Wendy Schmidt. research. we canpushtheexistingboundariesofmarine Falkor willcomeupwith,andhow, together, scientists whoconductresearch onboard are alwaysexcitedandcurioustoseewhat the new ways oceanography will be done. We At SOI,weare gearingupforthefuture, and
7 to oceanographicresearchers around theworld. This shiftwillmakecriticalelementsofmarinefieldscienceaccessible excellent observationaldatacanreduce operationalcostsandrisks. where operational flexibility, endurance, low environmental impact, and how theSaildrones can be appliedtofuture seagoingoceanography, next project acouplethousand milesaway. Theseexamplesshow the Saildrones dutieswere extendedtotrackanoceanicfront forSOI’s why thesharksmay be drawntothisarea. Followingthe expedition, closer tothesurfaceenhancebiologicalproduction; agoodreason rich sensordatathatshowedhowsmall-scaleeddiesdrawnutrients Their earlyentranceinformedthescientificsamplingplans,gathering arrival. Saildrones surveyedtheregion foramonthaheadofFalkor’s Traversing thousands ofmileshalfwaybetweenHawaiiandCalifornia, Shark Cafétostudywhythisremote area attracts white sharks. wind and solarpowered vehicles,were launched to theWhite took placeinFebruarywhentwoSaildrones, unmannedsurface and betterconserveourocean.Oneexampleofthistransformation in 2018toillustratehowwecanscaleourcapacityunderstand discuss aseriesoftransformativeinnovationsdemonstratedbySOI numbers isthetrueimpactofprogram. Inthisreport, we These are allrecords forSOI.However, whathidesbehindthese Co-founders EricandWendy Schmidt.
2018 REALITY REALITY VISIONS TO VISIONS TO REALITY REALITY VISIONS TO VISIONS TO
2018 REPO REPO
2018 2018 2018 to find and sample within the cruise timeframe. to findandsamplewithinthecruise timeframe. rapidly changingseafloorthat would otherwisebevirtuallyimpossible atseatoquicklyfindtheareas learning of scientificinterest andstudy Ridge off thecoastofOregon. Theyusedunsupervisedmachine deep seafloorfrom 1.3millionphotosacquired onsiteatHydrate compiled thelargestknowncentimeter-resolution color3Dmapof In July, teamsfrom theUniversitiesofSouthamptonandTokyo, Falkor’s sciencecontrol room. robotic oceansurveyswhilerequiring onlyonehumanobserverin resolution and3D.Theadvancedsoftware managedsuccessfulmulti- as theymappedthedynamicsubtropical pacificoceanfront inhigh automatically guidedozensofaerial,surface,andsubmarinerobots developed OceanSpaceCentersoftware thatwasusedinMayto progressed. SOI,incollaborationwiththeUniversityofPorto,also time planningofoperationstocollectvaluabledataasthesurvey high performancecomputer. Themodelwasanalyzedtoinformreal multi-vehicle oceansurveysoftware from aboard FalkorusingSOI’s (MIT) andUniversityofSydneytestedartificialintelligence(AI)-based time. InJanuary, teamsfrom MassachusettsInstituteofTechnology toolstosupportmarinescienceandmanagementinnearreal learning Several projects this yearfocused on developingAI and machine REPOR REPOR ANNUAL ANNUAL ANNUAL ANNUAL R R T T
2018 T T
8 to connectscientistswithgreater numbersofpeopleonshore. the SmithsonianMuseumandAquarium ofthePacifichaveallowedus and featured in15documentariesthisyear. Newcollaborationswith in real timeonourYouTube channelbymore thanhalfamillionpeople groups. High-resolution imageryfrom ROVSuBastianhasbeenviewed people intheircommunities,schools,workplaces,andrecreation discovery and development, SOI continues to bring the ocean to workplaces, andrecreation of theseuniquejourneys groups. With continues tobringtheoceanpeopleintheircommunities,schools, ofdiscoveryanddevelopment,SOI theseuniquejourneys With future ofoceanography. areand machinelearning onthepathtobecomeindispensablefor intelligently surveyedwithinninedays.Highlightedbytheseprojects, AI annotations. In a successful demo, 11,000 square miles of ocean were thespecificsofsuchtasksfromto learn diverseoceandataandexpert hotspots" withoutbeingexplicitlyprogrammed todosoandbyhaving could "locategasseeps","find rock formations",and"surveybiological researchers testednon-deterministicoceansurveying,where robots deep spacethatwilltoleratelargecommunicationslatencies.The developing advancedAIforautonomousplanetaryexplorationin During thefinalexpeditionofyear, Falkorhostedateamofroboticists for theexperimentalArtificialIntelligencesoftware todecipher. AUVs withdifferent mappingcapabilitiesandspecialties togatherthebathymetrydata AUVs andprocessed byunsupervisedalgorithms.Theexpeditionusedasuiteof expedition inR/VFalkor'scontrol room, usingthemapsandimagesacquired bythe Dr. guidesoneofROVSuBastian'sdivesduringthe"AdaptiveRobotics" BlairThornton one oftheTop 10OceanInfluencers. one ofthereasons SOIwasnamedbyMarineTechnology Reporteras joy andexcitementofourdiscoveriesachievements.Thisisjust 2018 wasa remarkably productive year for science,and for sharing the anyone canread thedetailsfrom research doneatsea. And SOIhelpstomakeFalkor-related scientificarticlesopenaccessso sediments ontheseafloor, allowingthedetectionoflayerswithinsediments,faults,anddepthtobasement rock. (analogous to topography on land), the sidescan sonars produce imagery based on the intensity of the sound energy’s reflections, and the sub-bottom profiler penetrates simultaneously duringamission:swathmultibeamsonar, twosidescansonars,andasub-bottomprofiler. Themultibeamsonarproduces high-resolution bathymetry Crew ofthe"Pescadero Vent" expeditionrecover themappingAUVD.AllanB.Thisautonomousunderwatervehicleisequippedwithfoursonarsthatoperate
9 marine discoveriesthathavemarked2018. projects andresearch teams,technicalinnovations,andwondrous hope youwillbeinspired asmuchwehavebeenbyoursupported sharing ourincredible footage,andconnectingwiththepublic.We we are contributing to the arts,advancingROV SuBastian’s capabilities, foundation of success for the future. Readers will finddetailson how This yearourreport isorganizedbythemesthatare buildinga
2018 REALITY REALITY VISIONS TO VISIONS TO REALITY REALITY VISIONS TO VISIONS TO
2018 VISIONS TO REALITY
ANNUAL VISIONS TO 2018 REPORT REALITY
ANNUAL 2018
REPORT 2018
VISIONS TO 2018 REALITY 2018
ANNUAL
REPORT 2018
VISIONS TO REALITY
ANNUAL REPORT
AE2000f was the "Adaptive Robotics" expedition's scout. It would cruise at about 20km/h, collecting preliminary images of the seafloor: this data was then used to determine where the rest of the robots should focus their efforts.
10 11 VISIONS TO REALITY
ANNUAL VISIONS TO
2018 REPORT REALITY
ANNUAL 2018
REPORT 2018
VISIONS TO 2018 2018 REALITY
ANNUAL 8 REPONUMBERSRT 2018 AND METRICS 2013-2018