返回
Trajectory-based fish event classification through pre-training with diffusion models
DOI:10.1016/j.ecoinf.2024.102733.png)
摘要
En 中文
This study contributes to advancing the field of automatic fish event recognition in natural underwater videos, addressing the current gap in studying fish interaction and competition, including predator-prey relationships and mating behaviors. We used the corkwing wrasse (Symphodus melops) as a model, a marine species of commercial importance that reproduces in sea-weed nests built and cared for by a single male. These nests attract a wide range of visitors and are the focal point for behavior such as spawning, chasing, and maintenance. We propose a deep learning methodology to analyze the movement trajectories of the nesting male and classify the associated events observed in their natural habitat. Our approach leverages unsupervised pre-training based on diffusion models, leading to improved feature learning. Additionally, we introduce a dataset comprising 16,937 trajectories across 12 event classes, making it the largest in terms of event class diversity. Our results demonstrate the superior performance of our method compared to several deep architectures. The code for the proposed method and the trajectories can be found at https://github.com/NoeCanovi/Fish_Behaviors_Generative_Models.
Keyword:
Fish behavior
Underwater videos
Event recognition
Trajectory
Generative models
Autoencoder
Diffusion model
Corkwing wrasse
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.3
论文数:
3.8K
被引数:
1.3W
机构
引用论文
Graph Laplacian-Improved Convolutional Residual Autoencoder for Unsupervised Human Action and Emotion Recognition
IEEE ACCESS
IF3.6
Modified motion influence map and recurrent neural network-based monitoring of the local unusual behaviors for fish school in intensive aquaculture
AQUACULTURE
IF3.9
Data integration standards in model organisms: from genotype to phenotype in the laboratory mouse
TARGETS
IF0
Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening使用测试数据锐化的基于分而治之的一维CNN人体活动识别
SENSORS
IF3.5
Classifying imbalanced data sets using similarity based hierarchical decomposition
PATTERN RECOGNITION
IF7.6
Machine learning methods for imbalanced data set for prediction of faecal contamination in beach waters
WATER RESEARCH
IF12.4
Unleashing the Transferability Power of Unsupervised Pre-Training for Emotion Recognition in Masked and Unmasked Facial Images释放无监督预训练的可传递性,以在掩蔽和未掩蔽的面部图像中进行情感识别
IEEE ACCESS
IF3.6

