arrow
Return

Using a convolutional neural network for fingerling counting: A multi-task learning approach

delete2022-08-01
delete6
PRE
AI
D
Diogo Nunes Gonçalves
P
Plabiany Rodrigo Acosta
A
Ana Paula Marques Ramos *
L
Lucas Prado Osco
D
Danielle Elis Garcia Furuya
M
Michelle Taís Garcia Furuya
J
Jonathan Li
J
José Marcato
H
Hemerson Pistori
W
Wesley Nunes Gonçalves
DOI:10.1016/j.aquaculture.2022.738334delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Fingerling counting is an important task for decision-making in the aquaculture context. The counting is usually performed by a human, which is time-consuming and prone to errors. Artificial intelligence methods applied to image interpretation can be a great strategy for solving this task automatically. However, applying machine learning to attend to aquaculture issues is an underexplored field that requires novel investigations, especially of methods that explore temporal information in videos. In this study, we propose a new method to locate and count fingerlings in a sequence of images using convolutional neural networks. The proposed method estimates three tasks in a multi-task approach. The first task consists of predicting the probability of a fingerling occurring in each pixel of the frame, while the second and third tasks estimate the movement performed by the fingerlings. Motion prediction is used as a complement to fingerling detection, including relevant information especially when two or more fingerlings are in contact. Experimental results indicated that the use of temporal information considerably increases the results, reaching F1 of 97.89. The proposed method was evaluated in frames with different numbers of fingerlings (from 0 to 10) and all obtained relevant results, with an F1 of 95.42 or higher. The study also showed that, in most cases, the proposed method can detect the contact of two or more fingerlings, which is considered the main challenge of the detection and counting of fingerlings.
Keywords:
Fingerlings count
Multi-task learning
Convolutional neural network

Journal

Aquaculture cover
Aquaculture
IF:
3.9
Papers:
2.0W
Citations:
6.1W

Organization

Universidade Federal de Mato Grosso do Sul cover
Universidade Federal de Mato Grosso do Sul
Scholars:
4.5K
Papers: 2.6K
Citations: 2.1K
U
University of Waterloo
Scholars:
2.2W
Papers: 2.3W
Citations: 3.3W
U
Universidade do Oeste Paulista
Scholars:
675
Papers: 355
Citations: 332
researcher View more organizations