arrow
Return

Magnetic source imaging registration based on self-supervised learning and multi-view differentiable rendering

delete2025-05-13
delete0
PRE
AI
X
Xingwen Fu
Y
Yuqing Yang
Y
Yidi Cao
H
Han, Qiuyu
X
X. Qian T. Zhang W. Guo
Y
Yu Xu
X
Xiaolin Ning *
DOI:10.1016/j.inffus.2025.103161delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
High-sensitivity miniature optically pumped magnetometers (OPMs) and magnetoencephalography (MEG) technologies enable precise localization of brain magnetic field sources and their activity. Magnetic source imaging (MSI) relies on the accurate registration of MEG with Magnetic Resonance Imaging (MRI) to achieve high localization precision. Current registration algorithms typically depend on head point clouds reconstructed by optical scanners, which are then used to compute the coordinate transformation matrix between MEG and MRI. However, the complex process of reconstructing head point clouds not only increases the operational difficulty and the complexity of automation but also results in an unavoidable preparation time of 2-3 min, which is not user-friendly for non-expert operators or emergency patients. To address this, we propose a new MSI registration method based on self-supervised learning and multi-view differentiable rendering. This method eliminates the cumbersome head point cloud reconstruction process and instead achieves registration through several images taken from different angles. We treat the transformation matrix as an optimizable model parameter, and by comparing the differences between the captured images and the rendered images, we use differentiable rendering techniques to propagate gradients and optimize the transformation matrix, gradually bringing it closer to the true value. Experimental results show that this method reduces the preparation time to 30 s, significantly simplifies the operation, and achieves registration accuracy surpassing that of structured light scanners, approaching the precision of laser scanners. Furthermore, the required equipment cost is only 56% of that of a structured light scanner and 17% of a laser scanner. This advantage facilitates the widespread application of wearable OPM-MEG systems.
Keywords:
Magnetic source imaging
Magnetoencephalography
Registration
Differentiable rendering

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.3K
Citations:
2.7W

Organization

H
Hefei Natl Lab
Scholars:
231
Papers: 126
Citations: 60
Cited Papers

Cited Papers

EMS-Net: A Deep Learning Method for Autodetecting Epileptic Magnetoencephalography Spikes
err2020-06-01
err18
PREAI
errZheng, Li; Liao, Pan; Luo, Shen; Sheng, Jingwei; Teng, Pengfei; Luan, Guoming; Gao, Jia-Hong
errShare
errSave
Optical Co-registration of MRI and On-scalp MEG
err2019-04-02
err78
errOAAI
errZetter, Rasmus; Livanainen, Joonas; Parkkonen, Lauri
errShare
errSave
errShare
errSave
Pragmatic spatial sampling for wearable MEG arrays
err2020-12-10
err26
errOAAI
errTierney, Tim M.; Mellor, Stephanie; O'Neill, George C.; Holmes, Niall; Boto, Elena; Roberts, Gillian; Hill, Ryan M.; Leggett, James; Bowtell, Richard; Brookes, Matthew J.; Barnes, Gareth R.
errShare
errSave
Magnetoencephalography—theory, instrumentation, and applications to noninvasive studies of the working human brain
err1993-04-01
err0
errOAAI
errMatti Hämäläinen; Riitta Hari; Risto J. Ilmoniemi; Jukka Knuutila; Olli V. Lounasmaa
errShare
errSave
Instance Neural Radiance Field
err2023-10-01
err0
errOAAI
errYichen Liu; Benran Hu; Junkai Huang; Yu-Wing Tai; Chi-Keung Tang
errShare
errSave
Differentiable Surface Splatting for Point-based Geometry Processing
err2019-11-08
err84
errOAAI
errWang Yifan; Serena, Felice; Wu, Shihao; Oeztireli, Cengiz; Sorkine-Hornung, Olga
errShare
errSave
researcher View more