Research Ideas and Outcomes :
Grant Proposal
|
Corresponding author: Silvia Paoletti (spaoletti@naturalsciences.be)
Received: 10 Oct 2023 | Published: 27 Nov 2023
© 2023 Silvia Paoletti, Bob Rumes, Nino Pierantonio, Simone Panigada, Romain Jan, Thomas Folegot, Anita Schilling, Nicolas Riviere, Vincent Carrier, Antoine Dumoulin, David Van Hamme, Gildas Marquis-Laisné, François-Antoine Bruliard, Félix Petitpierre, Damien Demoor
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Citation:
Paoletti S, Rumes B, Pierantonio N, Panigada S, Jan R, Folegot T, Schilling A, Riviere N, Carrier V, Dumoulin A, Van Hamme D, Marquis-Laisné G, Bruliard F-A, Petitpierre F, Demoor D (2023) SEADETECT: developing an automated detection system to reduce whale-vessel collision risk. Research Ideas and Outcomes 9: e113968. https://doi.org/10.3897/rio.9.e113968
|
|
With the continuous intensification of marine traffic worldwide, whale-vessel collisions at sea (or “ship strikes”) have become one of the primary causes of mortality for cetaceans and a widely recognised cause of concern for human safety and economic losses. The Mediterranean Sea is a global hotspot for whale-vessel collisions, with one of the highest rates involving large cetaceans, especially the endangered fin whales (Balaenoptera physalus) and sperm whales (Physeter macrocephalus). Evidence indicates that both species are experiencing higher chances of a fatal collision than what predictions have estimated so far, with ship strikes being the main human-induced threat in the area. Regional and international organisations have stressed the need to address the issue by investigating the projected impacts of ship strikes on whale populations and by identifying possible mitigation measures to reduce chances of collision. Amongst the most popular and feasible options, there is the improvement of animal detection during navigation. Here, we present SEADETECT, a LIFE project that aims at developing an automated detection system to reduce vessel collision risk with marine mammals and unidentified floating objects (UFOs), combining state-of-the-art and novel technologies with existing approaches in the study of large whale ecology. This detection system consists of three elements; an automated onboard detection system composed of several sensors, a real-time passive acoustic monitoring (PAM) network at sea and a real-time detection-sharing and alert system (REPCET®). In this paper, we propose the development of a mitigation measure framework tailored for the issue of collision with fin and sperm whales in the north-western Mediterranean Sea, but that has the transferability features necessary for its application in other high-risk areas for ship strikes worldwide.
marine traffic, whale-vessel collision, cetaceans, endangered species, conservation, mitigation measures
Worldwide marine traffic is projected to significantly intensify (
Ship strikes are recognised as a global threat (
The Mediterranean Sea is another global hotspot, with one of the highest rates of collisions involving large cetaceans, estimated to be 3.5 times higher than other areas (
Fin whales occur across the entire Mediterranean Region with animals' abundance being higher in the western sector (
Sperm whales’ summer occurrence and distribution in the north-western Mediterranean Basin reflects the general sexual segregation scheme found in the open oceans, with animals, primarily adult males, generally observed in loose aggregations and mostly engaging in feeding activity (
In Fig.
Exemplificatory comparison between shipping routes of the two vessel types mainly contributing to collision (passenger and cargo vessels) shown as Automatic Identification System data points (top panels) and modelled summer maps of fin whale and sperm whale contact rates shown as number of sightings/km (middle panels). The interplay of the vessel routes and whale distribution and movements lead to a spatially variable map of whale-vessel collision risk (bottom panels), shown as number of Near Miss Events/km (NME i.e. surprise encounter at < 80 m distance). The figure is adapted from
Collision risk depends on the behaviour of the whale and the whale’s reaction to an approaching vessel, with the time spent at or near the surface as an important factor determining the susceptibility to a strike (
In this context, the International Whaling Commission (IWC) has stressed the need to address the effects of ship strikes on large whale populations. In conjunction with the International Maritime Organisation (IMO), other relevant international, governmental- and non-governmental organisations, industry and the scientific community, the IWC is focussing on identifying high risk species and areas, as well as mitigation measures to reduce collision risk in a way that causes minimum disruption to shipping (
While the dynamics of whale–vessel collisions are not fully understood, several underlying factors have been identified (e.g.
Here, we present the outline and objectives of the ongoing LIFE SEADETECT project (https://life-seadetect.eu/), developed to integrate state-of-the-art and novel technologies with existing approaches in the study of large whale ecology to mitigate and reduce sperm and fin whales’ collisions with vessels in the region, in collaboration with major Mediterranean shipping companies. The project aims at developing a mitigation measure that is tailored for the issue in the north-western Mediterranean Sea, but with the transferability for application in other high-risk areas for ship strikes worldwide.
SEADETECT is a 4-year project of the LIFE programme, financed by the European Climate, Infrastructure and Environment Executive Agency (CINEA), which aims at developing an automated detection system to reduce vessel collision risk with marine mammals and unidentified floating objects (UFOs), combining state-of-the-art technologies. The project brings together eleven partners from Belgium, France and Italy with the objectives to: i) create an innovative, low-cost and effective solution, that, ii) can positively impact the environment by reducing collisions by 80% with vulnerable species, while, iii) improving safe navigation conditions required by current and future regulations. The system intends to detect and identify cetaceans up to 1 km from the vessel and alert the crew in time for responding accordingly. To design such system, the project articulates in the development of the following elements, visualized in Fig.
Element 1: Onboard Cetacean Detection System (OCDS)
The automated OCDS is composed of multiple highly sensitive complementary sensors that are processed and then fused thanks to artificial intelligence algorithms in order to allow equipped vessels to self-detect cetaceans (Fig.
Schematic representation of the three technologies (three of the four elements of the project objectives) that compose the full system functioning and data flow that will be developed by the LIFE SEADETECT project to reduce whale-vessel collision risk, starting from sensor detection until alert distribution to the network of navigating vessels.
The RADAR system is composed of a coherent 12 KW scanner using a gyro-stabilised antenna. Thanks to this capability, it enables an immediate and stable 360° scan of the environment regardless of sea condition. The Doppler Based Signal Processing implemented in the Radar Processing unit will allow an efficient filtering of the traditional environmental clutter (sea, rain) and will optimise the detection of objects of interest (e.g. cetaceans, other UFOs). A multi-dimensional filtering segmentation is implemented to further isolate cetaceans. The plot and video output will then be sent to the fusion box for correlating data coming from the radar with data from other sensors. The radar will be controlled by the ASTERIX protocols.
The 3D-LiDAR is an active sensing technique using a laser in the infrared range-band (eye-safe system) and delivering an immediate and accurate 3D representation (high resolved telemetry) of the surveyed environment in its field of view. The resulting information is a 3D point cloud that is subsequently processed to differentiate between water and objects of interest in the scanned scene. This sensing technique provides a locally higher resolution than the RADAR and is largely independent of environmental factors like, for example, natural lighting. The COTS-based 3D-LiDAR 3D prototype to be installed has a wide field of view of 120° and a range of up to 500 m. In addition, a high-performance prototype with a longer range, but more restricted field of view, will be tested for a short period of time during the project.
The optronic sensors system is in turn composed of: i) an on-sea object detection and classification video camera with 180° panoramic view and a panoramic dual band (thermal infrared LWIR 1920x480 + visible band 12Kx4K) customised from https://nexvision.fr/products/panoramic-camera/panomix-panoramic-vision/; ii) a cetacean recognition and tracking zoom camera equipped with a long range view, a gyro-stabilised gimbal with zoom optics (continuous magnification x10, 4° - 40°) and triple band (thermal longwave infrared LWIR 1280x1024 vision + visible-near infrared VNIR 4Kx4K quarter moon night vision + visible colour band 4Kx4K), customised from https://nexvision.fr/products/gsg9-gsg11-gyrostabilized-gimbal/; iii) a vision calculator to analyse images and detect cetaceans by an artificial intelligence algorithm, customised from https://nexvision.fr/evpu-embedded-vision-processing-unit/; and iv) a command and control Human-Machine Interface with 24 in 4 K tactile display.
Dedicated detection algorithms on each of these sensors will identify and locate objects of interest, which are then sent to a data fusion module for comparison and analysis. Based on this analysis, candidate detections are then prioritised and sent to the steerable optronics system, which has a much higher zoom factor, but limited field of view, to confirm and recognise the candidate targets. The analysis of the multi-sensor data depends strongly on the conditions: the ability of the sensors to distinguish marine mammals in the water varies with light conditions, weather conditions and sea state. One of the research tasks is, therefore, to quantify the performance of the subsystems in a variety of conditions in order to calibrate the data fusion. In case of cetacean recognition confirmed by the on-board shift supervisor, alerts are communicated in real time to the vessel network.
The detection box will undergo several testing and validation phases on board four different vessels. The first testing phase will be done on board the whale-watching vessel of the organisation Découverte du Vivant (https://www.decouverteduvivant.org/). For six months, the optronic component of the system will be trained and tested in capturing images and videos and identifying targeted cetaceans. Learning from the results from this testing phase, the optronic component will undergo enhancement and optimisation towards a second prototype. The second and third testing phase will take place on board two high-speed passenger ferries from the company La Méridionale, the Piana and Kalliste, having an average length, beam and draft of 173 m, 30 m and 6.3 m, respectively and an average speed of 17.5 knots. The two testing phases will work in parallel for one year, testing the complete set of sensors composing the automated detection box along the shipping routes within the Pelagos Sanctuary. The results of the second phase will be used to optimise the detection box tested during the third phase. A fourth testing and validation phase will take place on board the RV Belgica, the national research vessel of Belgium having a length, beam and draft of 71.4 m, 16.8 m and 4.8 m, respectively. The detection box will be tested navigating in the North Sea or the Arctic Sea under different environmental and meteorological conditions, targeting different marine mammals species. The objective of this phase will be to test and validate the complete set of sensors on different species, on board a different type of vessel and in a different environment, to demonstrate the transferability and replicability of the project.
Element 2. PAM network
The PAM hydrophones system is composed of a network of hydrophones connected to autonomous energy buoys that are able to record the presence of cetaceans, based on the sounds they emit (i.e. echolocating ‘clicks’ of sperm whales and vocal calls of fin whales) (Fig. 3). Networks of hydrophones will be deployed in key areas important for the species ecology or witnessing high density of marine mammals, such as corridors for cetacean passage which overlap or not with highly-trafficked shipping lanes. Hydrophones will be able to detect sounds and identify the species, geolocate the animal by triangulation and alert in real time navigating vessels by sharing the detection on the network. A testing and validation phase will take place for a period of one year in which explicatory networks will be deployed in important areas in the north-western Mediterranean Basin.
Element 3: Detection sharing network
Both detection elements developed within the project will provide accurate alerts that will be transmitted to navigating vessels through a sharing detection network (Fig. 3). This share detection network will rely on the REPCET® system (https://www.repcet.com) which allows to report, share and receive in real time cetaceans’ positions within a network of subscribers. Today, 39 vessels are equipped with the system and five institutions are also equipped with the shore interface. Each cetacean detected by both detection elements is transmitted in real time by satellite to a server located on land. The server centralises the data and issues an alert to ships equipped with REPCET® and likely to encounter the cetacean on their route. The alerts are then mapped on board on a dedicated screen and listed 24 hours on the screen.
Element 4: Cetaceans behaviour and ecological impacts
A deeper understanding of marine mammal behaviour in the presence of a vessel is one of the fundamental elements in the effort to reduce whale-vessel collision. In this project, data on cetacean behaviour near high-speed vessels will be collected from four sources: 1) from the analysis of data collected from a variety of sensors, including acoustic tags equipped with accelerometer and pressure sensors that will be placed on individual animals using non-invasive suction cups and satellite transmitters (
The data collected from tags, field observations, PAM and testing phases onboard vessels will provide information on species distribution, species behaviour - including time spent at the surface and reaction to vessels - and detection system efficiency, including number and type of detections acquired. Such data will be used to investigate the full system capability and effectiveness and to project the potential impact that the wide-scale implementation of the full system would have on targeted whale populations. To assess such impact, the potential consequences on the Mediterranean subpopulations of sperm and fin whales will be quantified using multiple statistical and modelling tools. Stochastic predictive modelling methods that include the use of estimates of population size, age-or stage-specific birth and death rates to simulate population responses will be used. The PCoD (Population Consequences of Disturbance) is a theoretical framework that evaluates how changes in behaviour due to a specific or cumulative disturbance may influence population dynamics (
The LIFE SEADETECT project builds on previous research to upscale marine mammal detection and alerting systems to avoid whale-vessel collisions. The integration of several state-of-the-art sensor technologies in one OCDS optimised for cetacean detection is a novel approach that will be applied in this project. By integrating the sensors with a data fusion and processing system, the OCDS is expected to detect and identify UFOs, with a focus on cetaceans species, at large distances with high accuracy (at least 80%) and, hence, be able to send alerts in time for their avoidance. The detection of UFOs with a minimum of 1 m², of individual large cetaceans or of groups of them will be possible in most weather conditions, both at day and night, between 100 m and 1 km distance from the front of the ship and at the surface, covering 140° in Azimuth. Concurrently, the PAM hydrophones network will be optimised for the detection, identification and triangulation of fin and sperm whales in real time. Their combined use offers unique opportunities for significantly reducing NME with marine mammals, as both systems will provide detections and identifications of cetaceans at distances sufficient for the vessel to be alerted, reduce its speed or detour, at a combined false alarm rate lower than 2%. The use of the alert sharing system through the existing REPCET® network is expected to allow vessels to communicate promptly and efficiently. This will enhance the existing limitations of REPCET®, which has yet to prove its effectiveness due to its strong dependency on observations (therefore, active engagement from users) and weather conditions. The validation of the boosted REPCET® tool amongst the currently-engaged 39 users has the aim to make the system appealing for other end users and promote its diffusion to a larger vessel network.
The OCDS will be robust and expected to withstand and work with severe weather conditions, overcoming some limitations that other systems have experienced, such as the LIFE WHALESAFE project (LIFE13 NAT/IT/001061). The project is less prone to receive opposition from the industry as it works in cooperation with it. The full system proposed by the project provides a low-effort, cost-effective and environmentally-friendly alternative to common mitigation measures, including re-routing and speed reduction. Despite speed limitations being recognised as efficient in reducing collision-risk, they are also not applicable nor welcomed from mariners and business owners, as they are not suited for certain vessel types, such as passenger ferries. Speed restriction measures, as may be adopted within a PSSA, are difficult to implement as they require the agreement of all IMO Member States. Instead, the implementation of the full system will require speed reduction only in case of a close detection. Once validated and distributed to the vessel network, the system is automated and, therefore, requires lower human effort in comparison to other projects that rely on crew and volunteer observations and reporting or aerial surveys (e.g. Whale Safe in US; https://whalesafe.com/). Data acquisition is passive and silent; therefore, the system does not introduce additional underwater noise, nor disturbance to the environment. The OCDS is a small investment that becomes economically profitable as it certainly reduces chances for vessel and transported goods damage and immobilisation times, which may also lower insurance premiums. Finally, for those vessels that will not be equipped with an OCDS, the installation of a PAM hydrophones network in areas of intense traffic or critical corridor areas for the cetaceans (e.g. migratory routes, feeding grounds, aggregation hotspots) will be complementary in reducing collision risk and, therefore, offering additional economical convenience and profitability. The combined implementation of a network of vessels equipped with the OCDS with the installation of PAM hydrophones networks has potential for large spatial coverage, making the project suited for large-scale applications.
Given the knowledge on collision-influencing factors including vessel and trajectory features and whale behaviour (
Whale-vessel collisions are one of the principal causes of mortality for several whale populations and species worldwide. The LIFE SEADETECT project was conceived to directly target the complexity of the collision issue and the demand of regional and international actors for better solutions. By creating an integrated automated detection and anti-collision system, this project provides an alternative solution to existing mitigation measures and will significantly reduce collision risks and protect highly-vulnerable species, while minimising shipping disruption. This is in alignment with international strategic plans (e.g.
Funding for this work was provided by the European Climate, Infrastructure and Environment Executive Agency (CINEA) through the EU Project LIFE21-NAT-FR-LIFE-SEADETECT with grant agreement n° 101070722. The authors would like to thank the associated partner La Méridionale S.A. for the collaboration in the implementation of the project, the ferries provided for the validation phases and the contribution for public dissemination, the stakeholder La Découverte du Vivant, for the use of their vessel during the first validation phase and the stakeholders Denis Ody and WWF France, for their collaboration in data collection and interpretation.