Multimodal Data Fusion Using Source Separation: Application to Medical Imaging

Tulay Adali, Yuri Levin-Schwartz, Vince D. Calhoun

Research output: Contribution to journalArticlepeer-review

86 Scopus citations


The joint independent component analysis (jICA) and the transposed independent vector analysis (tIVA) models are two effective solutions based on blind source separation (BSS) that enable fusion of data from multiple modalities in a symmetric and fully multivariate manner. The previous paper in this special issue discusses the properties and the main issues in the implementation of these two models. In this accompanying paper, we consider the application of these two models to fusion of multimodal medical imaging data-functional magnetic resonance imaging (fMRI), structural MRI (sMRI), and electroencephalography (EEG) data collected from a group of healthy controls and patients with schizophrenia performing an auditory oddball task. We show how both models can be used to identify a set of components that report on differences between the two groups, jointly, for all the modalities used in the study. We discuss the importance of algorithm and order selection as well as tradeoffs involved in the selection of one model over another. We note that for the selected data set, especially given the limited number of subjects available for the study, jICA provides a more desirable solution, however the use of an ICA algorithm that uses flexible density matching provides advantages over the most widely used algorithm, Infomax, for the problem.

Original languageEnglish
Article number7214354
Pages (from-to)1494-1506
Number of pages13
JournalProceedings of the IEEE
Issue number9
StatePublished - 1 Sep 2015
Externally publishedYes


  • Data fusion
  • electroencephalography (EEG)
  • functional magnetic resonance imaging (fMRI)
  • independent


Dive into the research topics of 'Multimodal Data Fusion Using Source Separation: Application to Medical Imaging'. Together they form a unique fingerprint.

Cite this