arrow
返回

Trajectory-based fish event classification through pre-training with diffusion models

delete2024-09-01
delete2
delete
OA
AI
N
Noemi Canovi
B
Benjamin A. Ellis
T
Tonje Knutsen Sørdalen
V
Vaneeda Allken
K
Kim Tallaksen Halvorsen
K
Ketil Malde
C
Cigdem Beyan *
DOI:10.1016/j.ecoinf.2024.102733delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This study contributes to advancing the field of automatic fish event recognition in natural underwater videos, addressing the current gap in studying fish interaction and competition, including predator-prey relationships and mating behaviors. We used the corkwing wrasse (Symphodus melops) as a model, a marine species of commercial importance that reproduces in sea-weed nests built and cared for by a single male. These nests attract a wide range of visitors and are the focal point for behavior such as spawning, chasing, and maintenance. We propose a deep learning methodology to analyze the movement trajectories of the nesting male and classify the associated events observed in their natural habitat. Our approach leverages unsupervised pre-training based on diffusion models, leading to improved feature learning. Additionally, we introduce a dataset comprising 16,937 trajectories across 12 event classes, making it the largest in terms of event class diversity. Our results demonstrate the superior performance of our method compared to several deep architectures. The code for the proposed method and the trajectories can be found at https://github.com/NoeCanovi/Fish_Behaviors_Generative_Models.
Keyword:
Fish behavior
Underwater videos
Event recognition
Trajectory
Generative models
Autoencoder
Diffusion model
Corkwing wrasse
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Ecological Informatics 封面图
Ecological Informatics
IF:
7.3
论文数:
3.8K
被引数:
1.3W

机构

U
University of Trento
学者数:
8.8K
论文数: 9.0K
被引数: 1.2W
U
University of Verona
学者数:
1.9W
论文数: 1.4W
被引数: 1.5W
U
University of Agder
学者数:
2.1K
论文数: 2.3K
被引数: 3.4K
U
University of Plymouth
学者数:
7.2K
论文数: 6.8K
被引数: 9.3K
I
institute of marine research - norway
学者数:
2.3K
论文数: 2.0K
被引数: 2
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Modified motion influence map and recurrent neural network-based monitoring of the local unusual behaviors for fish school in intensive aquaculture
err2018-08-01
err63
PREAI
errZhao, Jian; Bao, Weijun; Zhang, Fengdeng; Zhu, Songming; Liu, Ying; Lu, Huanda; Shen, Mingwei; Ye, Zhangying
err分享
err收藏
Machine learning methods for imbalanced data set for prediction of faecal contamination in beach waters
err2021-09-01
err41
PREAI
errBourel, Mathias; Segura, Angel M.; Crisci, Carolina; Lopez, Guzman; Sampognaro, Lia; Vidal, Victoria; Kruk, Carla; Piccini, Claudia; Perera, Gonzalo
err分享
err收藏
err分享
err收藏
学者 查看更多内容