arrow
返回

Constrained-CNN losses for weakly supervised segmentation

delete2019-05-01
delete193
delete
OA
AI
H
Hoel Kervadec *
J
José Dolz
M
Meng Tang
É
Éric Granger
Y
Yuri Boykov
I
Ismail Ben Ayed
DOI:10.1016/j.media.2019.02.009delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Weakly-supervised learning based on, e.g., partially labelled images or image-tags, is currently attracting significant attention in CNN segmentation as it can mitigate the need for full and laborious pixel/voxel annotations. Enforcing high-order (global) inequality constraints on the network output (for instance, to constrain the size of the target region) can leverage unlabeled data, guiding the training process with domain-specific knowledge. Inequality constraints are very flexible because they do not assume exact prior knowledge. However, constrained Lagrangian dual optimization has been largely avoided in deep networks, mainly for computational tractability reasons. To the best of our knowledge, the method of Pathak et al. (2015a) is the only prior work that addresses deep CNNs with linear constraints in weakly supervised segmentation. It uses the constraints to synthesize fully-labeled training masks (proposals) from weak labels, mimicking full supervision and facilitating dual optimization. We propose to introduce a differentiable penalty, which enforces inequality constraints directly in the loss function, avoiding expensive Lagrangian dual iterates and proposal generation. From constrained-optimization perspective, our simple penalty-based approach is not optimal as there is no guarantee that the constraints are satisfied. However, surprisingly, it yields substantially better results than the Lagrangian-based constrained CNNs in Pathak et al. (2015a), while reducing the computational demand for training. By annotating only a small fraction of the pixels, the proposed approach can reach a level of segmentation performance that is comparable to full supervision on three separate tasks. While our experiments focused on basic linear constraints such as the target-region size and image tags, our framework can be easily extended to other non-linear constraints, e.g., invariant shape moments (Klodt and Cremers, 2011) and other region statistics (Lim et al., 2014). Therefore, it has the potential to close the gap between weakly and fully supervised learning in semantic medical image segmentation. Our code is publicly available. (C) 2019 Elsevier B.V. All rights reserved.
Keyword:
Deep learning
Semantic segmentation
Weakly-supervised learning
CNN constraints
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Medical Image Analysis 封面图
Medical Image Analysis
IF:
11.8
论文数:
3.8K
被引数:
2.4W

机构

E
ecole de technologie superieure - canada
学者数:
1.5K
论文数: 1.6K
被引数: 1
U
university of quebec
学者数:
2.0W
论文数: 1.9W
被引数: 19
引用论文

引用论文

Catalysts effect on single-walled carbon nanotube branching
err2007-08-01
err0
PREAI
errJun Huang; Do Hyun Kim; Raghunandan Seelaboyina; Banglore K. Rao; Dake Wang; Minseo Park; WonBong Choi
err分享
err收藏
err分享
err收藏
Segmentation with area constraints
err2013-01-01
err10
errOAAI
errNiethammer, Marc; Zach, Christopher
err分享
err收藏
A survey on deep learning in medical image analysis深度学习在医学图像分析中的应用综述
err2017-12-01
err8.0K
errOAAI
errLitjens, Geert; Kooi, Thijs; Bejnordi, Babak Ehteshami; Setio, Arnaud Arindra Adiyoso; Ciompi, Francesco; Ghafoorian, Mohsen; van der Laak, Jeroen A. W. M.; van Ginneken, Bram; Sanchez, Clara I.
err分享
err收藏
DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks
err2017-02-01
err222
errOAAI
errRajchl, Martin; Lee, Matthew C. H.; Oktay, Ozan; Kamnitsas, Konstantinos; Passerat-Palmbach, Jonathan; Bai, Wenjia; Damodaram, Mellisa; Rutherford, Mary A.; Hajnal, Joseph V.; Kainz, Bernhard; Rueckert, Daniel
err分享
err收藏
Conditional Random Fields Meet Deep Neural Networks for Semantic Segmentation Combining probabilistic graphical models with deep learning for structured prediction
err2018-01-01
err93
errOAAI
errArnab, Anurag; Zheng, Shuai; Jayasumana, Sadeep; Romera-Paredes, Bernardino; Larsson, Mans; Kirillov, Alexander; Savchynskyy, Bogdan; Rother, Carsten; Kahl, Fredrik; Torr, Philip H. S.
err分享
err收藏
Leadership Behavior of Project Managers in Sustainable Construction Projects
err2016-01-01
err0
errOAAI
errAmin Akhavan Tabassi; Maria Argyropoulou; Kamand M. Roufechaei; Rachel Argyropoulou
err分享
err收藏
Constrained Deep Weak Supervision for Histopathology Image Segmentation
err2017-11-01
err171
errOAAI
errJia, Zhipeng; Huang, Xingyi; Chang, Eric I-Chao; Xu, Yan
err分享
err收藏
没有更多内容