arrow
Return

3D convolution for multidate crop recognition from multitemporal image sequences

delete2021-10-01
delete3
PRE
AI
M
Marcos Rogozinski *
J
Jorge Andres Chamorro Martinez
R
Raul Queiroz Feitosa
DOI:10.1080/01431161.2021.1976876delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The increasing food demand is regarded as the main threat to nature today. In this scenario, Remote Rensing is an essential technology to assess and monitor the extent and productivity of cultivated land. However, most work on crop mapping from remote sensing imagery so far focused on temperate areas, where a single crop prevails throughout the year. This paper explores different Convolutional Neural Network architectures for multi-temporal crop recognition in tropical areas, with highly complex crop dynamics and many crops per year. The proposed models are a U-Net with bidirectional ConvLSTM added to its skip connections, a U-Net with 3D convolutions, and a U-Net with 3D convolutions and Atrous Temporal Pyramid Pooling. The paper also assesses the gain of a post-processing step based on fully connected conditional random fields (CRF) as a second look at the spatial context to improve the networks' predictions. In an extensive experimental analysis conducted on two public multitemporal datasets of tropical areas with complex crop dynamics, all proposed models achieved better results than state-of-the-art methods based on recurrent networks in terms of Overall Accuracy and Average F1-Score. The 3D convolution with the Atrous Temporal Pyramid Pooling model stood up as the best performing architecture, with gains up to 4.3% over the baseline. The proposed CRF post-processing also proved beneficial for all tested architectures, bringing improvements of up to 2.7% in terms of average F1-score.

Journal

International Journal of Remote Sensing cover
International Journal of Remote Sensing
IF:
2.6
Papers:
1.2W
Citations:
2.7W

Organization

P
pontificia universidade catolica do rio de janeiro
Scholars:
2.2K
Papers: 1.7K
Citations: 0
Cited Papers

Cited Papers

Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
err2017-05-01
err1.3K
PREAI
errKussul, Nataliia; Lavreniuk, Mykola; Skakun, Sergii; Shelestov, Andrii
errShare
errSave
About the benzotriazole tautomerism: an ab initio study
err2003-12-01
err0
PREAI
errLeonardo T Ueno; Rodrigo O Ribeiro; Milton S Rocha; Maria E.V Suárez-Iha; Koshun Iha; Francisco B.C Machado
errShare
errSave
Deep learning in remote sensing applications: A meta-analysis and review
err2019-06-01
err1.4K
errOAAI
errMa, Lei; Liu, Yu; Zhang, Xueliang; Ye, Yuanxin; Yin, Gaofei; Johnson, Brian Alan
errShare
errSave
researcher View more