Skip to main navigation Skip to search Skip to main content

Multimodal Deep Learning for Diabetic Retinopathy Grading: Integrating Linear-Radon Sinograms and Retinal Fundus Images

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Automated diabetic retinopathy (DR) grading is crucial for disease monitoring and personalized treatment, challenged by high intra-class variation and data imbalance. This paper presents a novel approach to enhancing DR grading detection by integrating linear-Radon sinogram-based images with original retinal images to provide a multimodal network using different convolutional neural network (CNN) architectures. Using the Kaggle Aptos dataset, we evaluated the performance of this multimodal integration. Our findings reveal a significant improvement in multi-class classification performance compared to unimodal retina-only images, underscoring our method's ability to detect subtle patterns among different DR grades.

Original languageEnglish
Title of host publication2024 IEEE 26th International Workshop on Multimedia Signal Processing, MMSP 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350387254
DOIs
Publication statusPublished - 4 Oct 2024
Event26th IEEE International Workshop on Multimedia Signal Processing, MMSP 2024 - West Lafayette, United States
Duration: 2 Oct 2024 → 4 Oct 2024

Publication series

Name2024 IEEE 26th International Workshop on Multimedia Signal Processing, MMSP 2024

Conference

Conference26th IEEE International Workshop on Multimedia Signal Processing, MMSP 2024
Country/TerritoryUnited States
CityWest Lafayette
Period2/10/24 → 4/10/24

Keywords

  • Convolutional neural networks
  • Feature extraction
  • Radon Transform
  • Retinopathy detection
  • Transfer learning

Fingerprint

Dive into the research topics of 'Multimodal Deep Learning for Diabetic Retinopathy Grading: Integrating Linear-Radon Sinograms and Retinal Fundus Images'. Together they form a unique fingerprint.

Cite this