arrow
返回

Deep supervised dictionary learning by algorithm unrolling-Application to fast 2D dynamic MR image reconstruction

delete2023-01-17
delete5
delete
OA
AI
A
Andreas Kofler *
M
Marie‐Christine Pali
T
Tobias Schaeffter
C
Christoph Kolbitsch
DOI:10.1002/mp.16182delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
BackgroundUnrolled neural networks (NNs) have been extensively applied to different image reconstruction problems across all imaging modalities. A key component of the latter is that they allow for physics-informed learning of the regularization method, which is parametrized by the NN. However, due to the lack of understanding of deep NNs from a theoretical point of view, unrolled NNs are still black-boxes when the regularizers are given by deep NNs, for example, U-Nets. PurposeDictionarylearning (DL) is a well-established regularization method, which is based on learning a transform to sparsely approximate the signals of interest. Typically, DL-based image reconstruction either employs a dictionary, which was pretrained on a set of patches which were extracted from ground-truth images or a dictionary which is jointly trained during the reconstruction. However, in both cases, the used DL-algorithms are not designed to take into account the reconstruction problem or the underlying physical model, which describes the imaging process. In this work, we propose a DL-algorithm based on unrolled NNs to overcome these limitations. MethodsWe construct an unrolled NN, which corresponds to an unrolled DL-based reconstruction algorithm and train the unrolled NN to optimize its weights, that is, the atoms of the dictionary, by back-propagation in a supervised manner. Further, we propose a new way to employ a 2D dictionary in the spatio-temporal domain. We tested and evaluated the method on an accelerated cardiac cine MR image reconstruction problem using 216/36/36 dynamic images for training, validation, and testing and compared it to two well-known state-of-the-art approaches for cardiac cine MRI based on deep iterative CNNs. Further, we analyze the obtained dictionaries in terms of dictionary-coherence and structure of the atoms. Last, we compare the reported methods in terms of stability by applying them to an entirely different dataset consisting of 49 different test images. ResultsThe investigated physics-informed DL-approach yields significantly more accurate reconstructions compared to the DL-method, which uses dictionaries obtained by decoupled pretraining, thereby providing an improvement of up to 4.90 dB in terms of PSNR and 5% in terms of SSIM. Further, the proposed spatio-temporal 2D dictionary outperforms the 1D and 3D dictionaries by preventing smoothing of image details while still accurately removing undersampling artifacts and noise resulting in an increase of up to 1.10 dB in terms of PSNR and 4% in terms of SSIM. Although being surpassed by the CNNs on the first dataset, the proposed NNs-based DL method is more stable compared to the latter approach and yields comparable results on the second dataset. Last, it has the advantage of being entirely interpretable in each component. ConclusionsThe presented physics-informed NN can be used as training algorithm for a classical and interpretable data-driven regularization method based on a learned dictionary, which can then not only be linked to the considered data but also to the reconstruction method that the NN defines.
Keyword:
cardiac cine MRI
deep learning
dictionary learning
neural networks

期刊

Medical Physics 封面图
Medical Physics
IF:
3.2
论文数:
3.7W
被引数:
3.2W

机构

U
University of Innsbruck
学者数:
9.8K
论文数: 8.6K
被引数: 8
P
physikalisch-technische bundesanstalt (ptb)
学者数:
2.1K
论文数: 1.6K
被引数: 0
引用论文

引用论文

Protein purification by affinity binding to unilamellar vesicles
err2004-02-18
err0
PREAI
errJohnny D. Powers; Peter K. Kilpatrick; Ruben G. Carbonell
err分享
err收藏
Learning a variational network for reconstruction of accelerated MRI data学习用于重建加速MRI数据的变分网络
err2017-11-08
err1.2K
errOAAI
errHammernik, Kerstin; Klatzer, Teresa; Kobler, Erich; Recht, Michael P.; Sodickson, Daniel K.; Pock, Thomas; Knoll, Florian
err分享
err收藏
Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?用于自动MRI心脏多结构分割和诊断的深度学习技术: 问题解决了吗?
err2018-11-01
err1.1K
errOAAI
errBernard, Olivier; Lalande, Alain; Zotti, Clement; Cervenansky, Frederick; Yang, Xin; Heng, Pheng-Ann; Cetin, Irem; Lekadir, Karim; Camara, Oscar; Gonzalez Ballester, Miguel Angel; Sanroma, Gerard; Napel, Sandy; Petersen, Steffen; Tziritas, Georgios; Grinias, Elias; Khened, Mahendra; Kollerathu, Varghese Alex; Krishnamurthi, Ganapathy; Rohe, Marc-Michel; Pennec, Xavier; Sermesant, Maxime; Isensee, Fabian; Jaeger, Paul; Maier-Hein, Klaus H.; Full, Peter M.; Wolf, Ivo; Engelhardt, Sandy; Baumgartner, Christian F.; Koch, Lisa M.; Wolterink, Jelmer M.; Isgum, Ivana; Jang, Yeonggul; Hong, Yoonmi; Patravali, Jay; Jain, Shubham; Humbert, Olivier; Jodoin, Pierre-Marc
err分享
err收藏
学者 查看更多内容