SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstruction

Fang Liu, Alexey Samsonov, Lihua Chen, Richard Kijowski, Li Feng

Research output: Contribution to journalArticlepeer-review

79 Scopus citations

Abstract

Purpose: To develop and evaluate a novel deep learning–based reconstruction framework called SANTIS (Sampling-Augmented Neural neTwork with Incoherent Structure) for efficient MR image reconstruction with improved robustness against sampling pattern discrepancy. Methods: With a combination of data cycle–consistent adversarial network, end-to-end convolutional neural network mapping, and data fidelity enforcement for reconstructing undersampled MR data, SANTIS additionally utilizes a sampling-augmented training strategy by extensively varying undersampling patterns during training, so that the network is capable of learning various aliasing structures and thereby removing undersampling artifacts more effectively and robustly. The performance of SANTIS was demonstrated for accelerated knee imaging and liver imaging using a Cartesian trajectory and a golden-angle radial trajectory, respectively. Quantitative metrics were used to assess its performance against different references. The feasibility of SANTIS in reconstructing dynamic contrast-enhanced images was also demonstrated using transfer learning. Results: Compared to conventional reconstruction that exploits image sparsity, SANTIS achieved consistently improved reconstruction performance (lower errors and greater image sharpness). Compared to standard learning-based methods without sampling augmentation (e.g., training with a fixed undersampling pattern), SANTIS provides comparable reconstruction performance, but significantly improved robustness, against sampling pattern discrepancy. SANTIS also achieved encouraging results for reconstructing liver images acquired at different contrast phases. Conclusion: By extensively varying undersampling patterns, the sampling-augmented training strategy in SANTIS can remove undersampling artifacts more robustly. The novel concept behind SANTIS can particularly be useful for improving the robustness of deep learning–based image reconstruction against discrepancy between training and inference, an important, but currently less explored, topic.

Original languageEnglish
Pages (from-to)1890-1904
Number of pages15
JournalMagnetic Resonance in Medicine
Volume82
Issue number5
DOIs
StatePublished - Nov 2019
Externally publishedYes

Keywords

  • data augmentation
  • data cycle-consistent adversarial network
  • deep learning
  • image reconstruction
  • reconstruction robustness
  • sampling discrepancy

Fingerprint

Dive into the research topics of 'SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstruction'. Together they form a unique fingerprint.

Cite this