Reconstructing 3D Biomedical Architectural Order at Multiple Spatial Scales with Multimodal Stack Input

doi:10.1007/s42235-024-00557-9

2024-06-18

PRE

DOI：10.1007/s42235-024-00557-9

原文链接

原文求助

摘要

En 中文

Microscopy, crucial for exploring biological structures, often uses polarizing microscopes to observe tissue anisotropy and reconstruct label-free images. However, these images typically show low contrast, and while fluorescence imaging offers higher contrast, it is phototoxic and can disrupt natural assembly dynamics. This study focuses on reconstructing fluorescence images from label-free ones using a complex nonlinear transformation, specifically aiming to identify organelles within diverse optical properties of tissues. A multimodal deep learning model, 3DTransMDL, was developed, employing the Stokes vector to analyze the sample's retardance, phase, and orientation. This model incorporates isotropy and anisotropy to differentiate organelles, enhancing the input with structures' varied optical properties. Additionally, techniques like background distortion normalization and covariate shift methods were applied to reduce noise and overfitting, improving model generalization. The approach was tested on mouse kidney and human brain tissues, successfully identifying specific organelles and demonstrating superior performance in reconstructing 3D images, significantly reducing artifacts compared to 2D predictions. Evaluation metrics such as SSIM, PCC, and R2 score confirm the model's efficacy, with improvements observed in multi-modality input setups. This advancement suggests potential applications in molecular dynamics, aiming for further enhancements in future studies.

Keyword:

Image reconstruction

Deep learning

Computational imaging

Isotropic and anisotropic tissues

Multimodal input

期刊

Journal of Bionic Engineering

IF:

5.8

论文数:

2.0K

被引数:

4.8K

机构

暂无机构信息

引用论文

The Effects of Restraint Stress on the Neuropathogenesis of Theiler’s Virus-induced Demyelination: A Murine Model for Multiple Sclerosis

Neural and Neuroendocrine Mechanisms in Host Defense and Autoimmunity

IF0

2024-09-07

PREAI

C. Jane Welsh; Mi Wentao; Amy Sieve; Andrew Steelman; Robin R. Johnson; Colin R. Young; Thomas Prentice; Ashley Hammons; Ralph Storts; Thomas Welsh; Mary W. Meagher

Comparative investigation on wear properties of 3D-printed textured journal bearings

JOURNAL OF MANUFACTURING PROCESSES

IF6.8

2023-10-01

PREAI

Mourya, Vishal; Bhore, Skylab P.; Wandale, Parag G.

KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image and Volumetric Segmentation

IEEE TRANSACTIONS ON MEDICAL IMAGING

IF9.8

2022-04-01

121