Skip to main navigation Skip to search Skip to main content

Triple Expert Adaptation Networks with Adaptive Prompt Selection for Multi-modal Medical Image Fusion

  • Cong Wang
  • , Kang Wang
  • , Yang Yang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Multi-modal medical image fusion seeks to integrate complementary information from heterogeneous imaging modalities to enhance clinical diagnostics. However, it faces challenges in reconciling channel-wise feature conflicts, spatial misalignments, and redundant feature propagation. In this paper, we propose a Triple Expert Adaptation Network (TEA-Net) to address these limitations through three domain-specific fusion mechanisms: Channel Expert Adaptation Fusion (CEAF), Low-Rank Expert Adaptation Fusion (LoR-EAF), and Spatial Expert Adaptation Fusion (SEAF). The CEAF employs globally dynamic channel attention to resolve intensity conflicts across different modalities. The LoR-EAF focuses on modulating the most relevant interactions between modalities in low-rank to compress extraneous information. The SEAF integrates large-kernel convolutions with cross-modality interactions to align features across different modalities. To boost fusion, we introduce an adaptive prompt selection module that utilizes learnable prompts to guide fusion among experts. Experiments on publicly available datasets demonstrate the superiority of our TEA-Net over state-of-the-art methods. The source codes are available at https://github.com/supersupercong/TEA-Net.

Original languageEnglish
Title of host publicationEfficient Medical Artificial Intelligence - 1st International Workshop, EMA4MICCAI 2025, Held in Conjunction with MICCAI 2025, Proceedings
EditorsTong Chen, Jinman Kim, Jinge Wu, Kun Yuan, Nassir Navab, Xiaohan Xing, Yuning Du, Nicolas Padoy, Hongliang Ren, Long Bai
PublisherSpringer Science and Business Media Deutschland GmbH
Pages133-142
Number of pages10
ISBN (Print)9783032139603
DOIs
StatePublished - 2026
Externally publishedYes
Event1st International Workshop on Efficient Medical Artificial Intelligence, EMA4MICCAI 2025, held in conjunction with MICCAI 2025 - Daejeon, Korea, Republic of
Duration: 23 Sep 2025 → 23 Sep 2025

Publication series

NameLecture Notes in Computer Science
Volume16318 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st International Workshop on Efficient Medical Artificial Intelligence, EMA4MICCAI 2025, held in conjunction with MICCAI 2025
Country/TerritoryKorea, Republic of
CityDaejeon
Period23/09/25 → 23/09/25

Keywords

  • Adaptive Prompt Selection
  • Channel Expert Adaptation Fusion
  • Low-rank Expert Adaptation Fusion
  • Medical Image Fusion
  • Spatial Expert Adaptation Fusion

Fingerprint

Dive into the research topics of 'Triple Expert Adaptation Networks with Adaptive Prompt Selection for Multi-modal Medical Image Fusion'. Together they form a unique fingerprint.

Cite this