Exploring Fronts with Multiple Robots

When you build a house, you do not use only a hammer, but a variety of specialized tools in an organized and collaborative manner to construct a complex structure. The same idea holds true in oceanography, and as such, Principal Investigator João Tasso de Figueiredo Borges de Sousa of the Laboratório de Sistemas e Tecnologias Subaquáticas (LSTS) from Porto University and his team are working to construct a network that manages multiple autonomous vehicles simultaneously. At the Subtropical Front, located approximately 1,000 nautical miles off the coast of Southern California, the multidisciplinary team will work towards establishing a new method for observing dynamic, constantly changing ocean systems and processes with autonomous vehicles that are constantly in contact with themselves and a remote control center.

In oceanography, “Fronts” are sites where drastic changes occur within the properties of waters, such as areas where warm masses of water meet cold currents. In this area of vastly different conditions, the team will deploy several autonomous vehicles to find, track, and sample various physical, chemical, and biological features of the ocean, on time-space scales not previously possible by ship or aircraft studies alone.

The planned course of action builds on innovative open-source communication and autonomy software developed by LSTS that enables networked vehicle systems to operate independently while still working towards a common goal. A major component is on-board Artificial Intelligence (AI) based planning and execution control, which will be used to coordinate with autonomous underwater vehicles (AUV), unmanned air vehicle vehicles (UAV), and autonomous surface vehicles (ASV) to perform complex sampling tasks. At times, multiple vehicles will work in a combined effort.

A diagram of anticipated communication systems for multiple autonomous vehicles working at the same time.

The international team will be made up of researchers from LSTS and CIIMAR from Porto University in Portugal, Technical University of Cartagena in Spain, Norwegian University of Science and Technology, in Norway, and Harvard, University of Rhode Island, and Lamond-Doherty Observatory in the United States.

Research vessel Falkor will be an important part of the expedition as well, not just a passive launch pad. A serious obstacle in ocean robotics work is sending instructions and receiving feedback over long distances underwater – delays and disruptions are common using traditional transmission methods. Therefore, another goal is to develop more effective means of correspondence in such communications-challenged environments.

The Flightwave Edge Aerial Unmanned Vehicle (AUV) has a visible light camera, an infrared camera as well as running time of two hours. It also can achieve Vertical Take-Off and Landing (VTOL).

Falkor will act as a “nerve center” permitting mixed initiative planning and execution control by having human operators in the planning and execution of the control loops. This will happen by extending Falkor’s communications systems with underwater and radio communications (including satellite communications) to form networks over a wide area of operations. A shipboard Ocean Space Center (OSC) will be interfaced with Falkor as part of a ship-based integrated networked vehicle system (SINVS). This will allow several capabilities, such as real time updates of coordination and communication software and opportunities for the High Performance Computing System (HPCS) to be used for data assimilation and modeling. Last, there will be communications “nodes” formed by robotic vehicles that route data dynamically to other nodes based on network connectivity and the routing algorithm in use. The aerial, surface, and underwater vehicles will periodically connect these local networks to Falkor using Disruptive Tolerant Network (DTN) protocols.

Bruno Loureiro and Kanna Rajan getting ready to launch the Xplore -1 and -2 in a previous study, called Rapid Environment Picture (REP).

Unique to this mission, an anthropologist will be onboard looking at how best to organize the interactions among the engineers, scientists, and vehicles as the robots gain higher levels of intelligence and autonomy. This expedition will foster a deeper interdisciplinary understanding of oceanic fronts, eddies, and other hydrographic features on temporal-spatial scales not previously possible by using autonomous tools. Additionally, the team will be able to document, digest and report changes using vehicles with deliberative planning capabilities to accommodate intermittent communications in the field.

 

 

Special thanks and acknowledgment goes to these partners and collaborators:

MBARI – Provided technical support for the launch and recovery of a Wave Glider from Monterey bay and for in-water testing of all AUVs to be used in the cruise.
Portuguese Navy – Provided logistics support for at sea testing taking place in Portugal during the first five months of 2018.
Universidade de Aveiro – Contributed modeling and analysis techniques.
SINTEF – In-situ particle images from the top 100m of the water column were obtained by profiling the SINTEF SilCam.
NASA-Ames – Contributed a Dimethyl sulfide (DMS) sensor for airborne measurement of concentrations of this gas.

Ripples is a software tool we are using to monitor and control our underwater, surface, and air vehicles.

Ripples provides a web-based interface to interact with a team of autonomous vehicles. Ripples can be accessed by any compatible device (laptops, tablets or phones) and provides realtime information from all deployed assets.

By using Ripples, scientists (both on Falkor and on shore) can follow a mission’s execution. Researchers can monitor data being collected by the vehicles and other assets, in addition to data coming in from remote sensing and/or computer models. This simplified version of Ripples enables public access to all the data and plans in realtime.

Universidad Politecnica De Cartagena
Harvard_University

Data & Publications

Wave Glider and Saildrone data, hosted by University of Porto, can be accessed here.

Waveglider data hosted by NOAA’s ERRDAP server can be accessed here.

Saildrone data hosted by NOAA’s ERRDAP server can be accessed here.

  • Tasso de Figueiredo Borges de Sousa, J. (2018).  Mobile connectivity and mobile locality in networked vehicle systems: are we missing something? Oral Presentation at Control 2018, Sheffield, UK.

In the News

Navio científico Falkor já está na zona de estudo

Jornalda Economia do Mar • June 5th, 2018

U.Porto participa em campanha mundial inovadora de robótica marinha

Notícias Universidade do Porto • June 7th, 2018

Live from the Ocean Exploration Ship Falkor

Smithsonian National Museum of Natural History • June 13th, 2018

Falkor já chegou aos Estados Unidos

Jornal da Economia Do Mar • July 1st, 2018

FlightWave Edge deployed for international ocean research project

UAS (Unmanned Aerial Systems) Magazine • July 16th, 2018

Unmanned Aircraft Explores Ocean Health off California Coast

Unmanned Aerial Online • July 16th, 2018

Mapping ocean fronts with robotic fleets

RockSeven • July 23rd, 2018

Campanha no Pacífico recorre a tecnologia portuguesa germinada nos EEA Grants

Direção-Geral de Política do Mar • August 7th, 2018

Fleet of robots maps ocean fronts

Scuba Travel • August 15th, 2018

Porto researchers study Pacific with “an unprecedented detail”

TSF Radio Noticas • August 29th, 2018

Plenary Speaker

Control 2018 12th UKACC International Conference on Control • September 5-7th, 2018

Flightwave Demonstrates Edges Capabilities During Three Week Voyage in Pacific Ocean

The Association for Unmanned Vehicle Systems International (AUVSI) • September 11th, 2018