Abstract
Long data acquisition time is an inherent disadvantage of magnetic resonance imaging (MRI). To accelerate the data acquisition speed of MRI, undersampling is required, which results in low imaging quality. Based on an iterative self-consistent parallel imaging reconstruction (SPIRiT) and improved complex convolutional neural networks, a deep SPIRiT fusion network (DSFNet) is proposed to improve the quality of reconstructed images. The DSFNet model first uses the SPIRiT model for the reconstruction of under-sampled k-space data. Subsequently, a cascaded complex convolutional neural network with dense connections is utilized for further reconstruction of the calibrated k-space data. Besides, a data consistency layer ensures the fidelity of the reconstructed image in both k-space and image domains. The final magnitude image is fused from the two parts of the reconstruction magnitude images by the sequentialized model-based Bayesian optimization fusion module at a certain ratio. Experimental results on different knee datasets show that DSFNet can bring about a substantial improvement in the visualization quality, peak signal-to-noise ratio and structural similarity of the reconstructed images compared to the SPIRiT, Deepcomplex and DONet models.
摘要
数据采集时间长是磁共振成像的固有缺点。为了加快磁共振成像的数据采集速度,就需要进行欠采样,而欠采样会造成成像质量低下。为提高重建图像的质量,基于迭代自一致性并行成像重建(SPIRiT)和复数卷积神经网络提出了一种深度SPIRiT融合网络(DSFNet)。具体来说,DSFNet模型首先将SPIRiT算法用于对欠采样的k空间数据进行重建,再将具有密集连接的级联复数卷积神经网络用于对校准后的k空间数据进行进一步重建;在k空间和图像域均使用数据一致性层对图像进行保真,最后将两部分重建得到的幅度图像通过基于序列化模型的贝叶斯优化融合模块按一定比例进行融合。在不同的膝盖成像数据集及不同的欠采样模式下进行实验验证。实验结果表明:DSFNet模型相比于SPIRiT、Deepcomplex和DONet模型,在视觉效果、峰值信噪比和结构相似度方面均有明显提高。
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
ZENG G S, GUO Y, ZHAN J Y, et al. A review on deep learning MRI reconstruction without fully sampled k-space [J]. BMC Medical Imaging, 2021, 21(1): 195.
GRISWOLD M A, JAKOB P M, HEIDEMANN R M, et al. Generalized autocalibrating partially parallel acquisitions (GRAPPA) [J]. Magnetic Resonance in Medicine, 2002, 47(6): 1202–1210.
PRUESSMANN K P, WEIGER M, SCHEIDEGGER M B, et al. SENSE: Sensitivity encoding for fast MRI [J]. Magnetic Resonance in Medicine, 1999, 42(5): 952–962.
LUSTIG M, PAULY J M. SPIRiT: Iterative self-consistent parallel imaging reconstruction from arbitrary k-space [J]. Magnetic Resonance in Medicine, 2010, 64(2): 457–471.
WELLER D S, RAMANI S, FESSLER J A. Augmented Lagrangian with variable splitting for faster non-Cartesian L1-SPIRiT MR image reconstruction [J]. IEEE Transactions on Medical Imaging, 2014, 33(2): 351–361.
DUAN J Z, LIU Y, JING P G. Efficient operator splitting algorithm for joint sparsity-regularized SPIRiT-based parallel MR imaging reconstruction [J]. Magnetic Resonance Imaging, 2018, 46: 81–89.
ZHANG X L, GUO D, HUANG Y M, et al. Image reconstruction with low-rankness and self-consistency of k-space data in parallel MRI [J]. Medical Image Analysis, 2020, 63: 101687.
PAN T, DUAN J Z, WANG J F, et al. Iterative self-consistent parallel magnetic resonance imaging reconstruction based on nonlocal low-rank regularization [J]. Magnetic Resonance Imaging, 2022, 88: 62–75.
DUAN J Z, LIU Y, WANG J F. Accelerated SPIRiT parallel MR image reconstruction based on joint sparsity and sparsifying transform learning [J]. IEEE Transactions on Computational Imaging, 2023, 9: 276–288.
DUAN J, QIAN Q. Fast parallel imaging reconstruction method based on sidwt and iterative self-consistency [J]. Journal of Shanghai Jiao Tong University, 2023, 57(5): 582–592 (in Chinese).
WANG S S, SU Z H, YING L, et al. Accelerating magnetic resonance imaging via deep learning [C]//2016 IEEE 13th International Symposium on Biomedical Imaging. Prague: IEEE, 2016: 514–517.
LEE D, YOO J, TAK S, et al. Deep residual learning for accelerated MRI using magnitude and phase networks [J]. IEEE Transactions on Bio-Medical Engineering, 2018, 65(9): 1985–1995.
HUANG Q Y, YANG D, WU P X, et al. MRI reconstruction via cascaded channel-wise attention network [C]//2019 IEEE 16th International Symposium on Biomedical Imaging. Venice: IEEE, 2019: 1622–1626.
SRIRAM A, ZBONTAR J, MURRELL T, et al. End-to-end variational networks for accelerated MRI reconstruction [M]// Medical image computing and computer assisted intervention–MICCAI 2020. Cham: Springer, 2020: 64–73.
YIASEMIS G, SONKE J J, SÁNCHEZ C, et al. Recurrent variational network: A deep learning inverse problem solver applied to the task of accelerated MRI reconstruction [C]//2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans: IEEE, 2022: 722–731.
HUANG J H, WU Y Z, WU H J, et al. Fast MRI reconstruction: How powerful transformers are? [C]//2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society. Glasgow: IEEE, 2022: 2066–2070.
GÜNGÖR A, DAR S U, ÖZTÜRK Ş, et al. Adaptive diffusion priors for accelerated MRI reconstruction [J]. Medical Image Analysis, 2023, 88: 102872.
CHUNG H, YE J C. Score-based diffusion models for accelerated MRI [J]. Medical Image Analysis, 2022, 80: 102479.
PARK S, PARK J. Global and local constrained parallel MRI reconstruction by exploiting dual sparsity and self-consistency [J]. Biomedical Signal Processing and Control, 2021, 70: 102922.
HAMMERNIK K, KLATZER T, KOBLER E, et al. Learning a variational network for reconstruction of accelerated MRI data [J]. Magnetic Resonance in Medicine, 2018, 79(6): 3055–3071.
AGGARWAL H K, MANI M P, JACOB M. MoDL: Model-based deep learning architecture for inverse problems [J]. IEEE Transactions on Medical Imaging, 2019, 38(2): 394–405.
SRIRAM A, ZBONTAR J, MURRELL T, et al. GrappaNet: Combining parallel imaging with deep learning for multi-coil MRI reconstruction [C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 14303–14310.
PRAMANIK A, AGGARWAL H K, JACOB M. Deep generalization of structured low-rank algorithms (deep-SLR) [J]. IEEE Transactions on Medical Imaging, 2020, 39(12): 4186–4197.
LEE C Y, HASEGAWA H, GAO S C. Complex-valued neural networks: A comprehensive survey [J]. IEEE/CAA Journal of Automatica Sinica, 2022, 9(8): 1406–1426.
MUCKLEY M J, RIEMENSCHNEIDER B, RADMANESH A, et al. Results of the 2020 fastMRI challenge for machine learning MR image reconstruction [J]. IEEE Transactions on Medical Imaging, 2021, 40(9): 2306–2317.
COLE E, CHENG J, PAULY J, et al. Analysis of deep complex-valued convolutional neural networks for MRI reconstruction and phase-focused applications [J]. Magnetic Resonance in Medicine, 2021, 86(2): 1093–1109.
AHMAD DEDMARI M, CONJETI S, ESTRADA S, et al. Complex fully convolutional neural networks for MR image reconstruction [M]//Machine learning for medical image reconstruction. Cham: Springer, 2018: 30–38.
WANG S S, CHENG H T, YING L, et al. DeepcomplexMRI: Exploiting deep residual network for fast parallel MR imaging with complex convolution [J]. Magnetic Resonance Imaging, 2020, 68: 136–147.
FENG C M, YANG Z Y, FU H Z, et al. DONet: Dual-octave network for fast MR image reconstruction [J]. IEEE Transactions on Neural Networks and Learning Systems, 2021. https://doi.org/10.1109/TNNLS.2021.3090303
OUCHI S, ITO S. Efficient complex-valued image reconstruction for compressed sensing MRI using single real-valued convolutional neural network [J]. Magnetic Resonance Imaging, 2023, 101: 13–24.
BERGSTRA J, BARDENET R, BENGIO Y, et al. Algorithms for hyper-parameter optimization [C]//25th Annual Conference on Neural Information Processing Systems. Granada: NIPS, 2011: 1–9.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest The authors declare that they have no conflict of interest.
Additional information
Foundation item: the National Natural Science Foundation of China (No. 61861023), and the Yunnan Fundamental Research Projects (No. 202301AT070452)
Rights and permissions
About this article
Cite this article
Duan, J., Ren, X. & Chen, S. DSFNet: Deep Fusion Parallel MRI Reconstruction Based on SPIRiT and Complex Convolution. J. Shanghai Jiaotong Univ. (Sci.) (2024). https://doi.org/10.1007/s12204-024-2778-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12204-024-2778-0
Keywords
- parallel magnetic resonance imaging (MRI)
- complex convolutional neural network
- iterative self-consistent parallel imaging reconstruction (SPIRiT)
- sequential model-based Bayesian optimization