arrow
Return

Expectation maximisation pseudo labels

delete2024-05-01
delete0
delete
OA
AI
M
Moucheng Xu *
周
周瑜琨 (Yukun Zhou)
C
Chen Jin
M
Marius de Groot
D
Daniel C. Alexander
N
Neil P. Oxtoby
Y
Yipeng Hu
J
Joseph Jacob
DOI:10.1016/j.media.2024.103125delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we study pseudo -labelling. Pseudo -labelling employs raw inferences on unlabelled data as pseudolabels for self -training. We elucidate the empirical successes of pseudo -labelling by establishing a link between this technique and the Expectation Maximisation algorithm. Through this, we realise that the original pseudolabelling serves as an empirical estimation of its more comprehensive underlying formulation. Following this insight, we present a full generalisation of pseudo -labels under Bayes' theorem, termed Bayesian Pseudo Labels. Subsequently, we introduce a variational approach to generate these Bayesian Pseudo Labels, involving the learning of a threshold to automatically select high -quality pseudo labels. In the remainder of the paper, we showcase the applications of pseudo -labelling and its generalised form, Bayesian Pseudo -Labelling, in the semi -supervised segmentation of medical images. Specifically, we focus on: (1) 3D binary segmentation of lung vessels from CT volumes; (2) 2D multi -class segmentation of brain tumours from MRI volumes; (3) 3D binary segmentation of whole brain tumours from MRI volumes; and (4) 3D binary segmentation of prostate from MRI volumes. We further demonstrate that pseudo -labels can enhance the robustness of the learned representations. The code is released in the following GitHub repository: https://github.com/moucheng2017/EMSSL.
Keywords:
Pseudo labels
Bayesian deep learning
Expectation-maximisation
Semi-supervised learning
Segmentation
Generative models
Robustness

Journal

Medical Image Analysis cover
Medical Image Analysis
IF:
11.8
Papers:
3.9K
Citations:
2.4W

Organization

U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
Cited Papers

Cited Papers

errShare
errSave
Automatic Pulmonary Artery-Vein Separation and Classification in Computed Tomography Using Tree Partitioning and Peripheral Vessel Matching
err2016-03-01
err44
errOAAI
errCharbonnier, Jean-Paul; Brink, Monique; Ciompi, Francesco; Scholten, Ernst T.; Schaefer-Prokop, Cornelia M.; van Rikxoort, Eva M.
errShare
errSave
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
errShare
errSave
The Medical Segmentation Decathlon
err2022-07-15
err371
errOAAI
errAntonelli, Michela; Reinke, Annika; Bakas, Spyridon; Farahani, Keyvan; Kopp-Schneider, Annette; Landman, Bennett A.; Litjens, Geert; Menze, Bjoern; Ronneberger, Olaf; Summers, Ronald M.; van Ginneken, Bram; Bilello, Michel; Bilic, Patrick; Christ, Patrick F.; Do, Richard K. G.; Gollub, Marc J.; Heckers, Stephan H.; Huisman, Henkjan; Jarnagin, William R.; McHugo, Maureen K.; Napel, Sandy; Pernicka, Jennifer S. Golia; Rhode, Kawal; Tobon-Gomez, Catalina; Vorontsov, Eugene; Meakin, James A.; Ourselin, Sebastien; Wiesenfarth, Manuel; Arbelaez, Pablo; Bae, Byeonguk; Chen, Sihong; Daza, Laura; Feng, Jianjiang; He, Baochun; Isensee, Fabian; Ji, Yuanfeng; Jia, Fucang; Kim, Ildoo; Maier-Hein, Klaus; Merhof, Dorit; Pai, Akshay; Park, Beomhee; Perslev, Mathias; Rezaiifar, Ramin; Rippel, Oliver; Sarasua, Ignacio; Shen, Wei; Son, Jaemin; Wachinger, Christian; Wang, Liansheng; Wang, Yan; Xia, Yingda; Xu, Daguang; Xu, Zhanwei; Zheng, Yefeng; Simpson, Amber L.; Maier-Hein, Lena; Cardoso, M. Jorge
errShare
errSave
Uncertainty-guided mutual consistency learning for semi-supervised medical image segmentation
err2023-04-01
err35
errOAAI
errZhang, Yichi; Jiao, Rushi; Liao, Qingcheng; Li, Dongyang; Zhang, Jicong
errShare
errSave
no more