Skip to main navigation Skip to search Skip to main content

ViT-CNN: Explainable Dual-Stream Cross-Attention for MRI Brain Tumor Screening on Consumer Edge Devices

  • Bakht Zada
  • , Juhua Pu
  • , Yar Muhammad
  • , Asmat Ullah
  • , Mona M. Jamjoom
  • , Zahid Ullah
  • , Ahmed Farouk
  • , Muhammad Adil*
  • *Corresponding author for this work
  • School of Computer Science
  • Beihang University
  • Department of Computer Sciences
  • Princess Nourah Bint Abdulrahman University
  • Department of Information Systems
  • Al-Imam Muhammad Ibn Saud Islamic University
  • Hurghada University
  • Department of Computer Science
  • Texas Southern University

Research output: Contribution to journalArticlepeer-review

Abstract

Brain tumors are among the most aggressive and life-threatening cancers, requiring accurate and timely diagnosis for effective treatment. Convolutional neural networks (CNNs) and vision transformers (ViTs) have been widely explored for MRI-based tumor classification. However, CNNs often struggle with long-range dependency modeling and background noise, while ViTs lack strong inductive biases such as translation invariance. Although CNN-ViT hybridization can improve performance, practical screening systems on consumer edge devices must satisfy strict constraints on compute, memory, and latency. To address these challenges, we propose ViT-CNN, an explainable dual-stream cross-attention model that integrates CNN and ViT representations in an efficiency-aware manner for brain tumor screening on consumer edge devices. The CNN branch captures tumor-specific local patterns such as edges, textures, and shapes, while the ViT branch models global anatomical context. A spatial attention module is applied to the CNN features to suppress background noise, and a self-attention refinement module is applied to the ViT representation to enhance informative global cues. The two streams are then fused through bidirectional cross-attention, enabling adaptive interaction between local and global features. Experiments on two public MRI datasets show that ViT-CNN achieves 93.86 \pm 0.40 % accuracy on the Kaggle multiclass dataset-v2 and 99.33% on the BR35H binary dataset. To strengthen interpretability, we perform both qualitative and quantitative XAI analysis using saliency maps and LIME, including fidelity and consistency evaluation. Deployment-oriented profiling further demonstrates real-time CPU inference at 29.36 ms/image (34.05 FPS) for the full model, while lightweight variants achieve up to 55.57 FPS on CPU with modest accuracy reduction, supporting flexible deployment across consumer edge devices. Code is available at https://github.com/bakhtzadaabshare/BTS-MRI.

Original languageEnglish
Pages (from-to)6988-6999
Number of pages12
JournalIEEE Transactions on Consumer Electronics
Volume72
Issue number3
DOIs
Publication statusPublished - 1 Aug 2026
Externally publishedYes

Keywords

  • Brain tumor classification
  • LIME
  • MRI
  • ViT-tiny
  • cross-attention fusion
  • feature fusion
  • saliency maps

Fingerprint

Dive into the research topics of 'ViT-CNN: Explainable Dual-Stream Cross-Attention for MRI Brain Tumor Screening on Consumer Edge Devices'. Together they form a unique fingerprint.

Cite this