TY - JOUR
T1 - UMD-NOIR
T2 - Unified Multiscale Diffusion Model for Navigation-Orientated Image Restoration
AU - Siddiqua, Maria
AU - Belhaouari, Samir Brahim
AU - Raza, Muneer
N1 - Publisher Copyright:
© 2025 The Author(s). IET Intelligent Transport Systems published by John Wiley & Sons Ltd on behalf of The Institution of Engineering and Technology.
PY - 2025/1/1
Y1 - 2025/1/1
N2 - Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.
AB - Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.
KW - Automated driving & intelligent vehicles
KW - autonomous aerial vehicles
KW - autonomous underwater vehicles
KW - computer vision
KW - environmental factors
KW - image restoration
KW - marine vehicles
KW - navigation
KW - neural nets
KW - satellite navigation
UR - https://www.scopus.com/pages/publications/105024003246
U2 - 10.1049/itr2.70110
DO - 10.1049/itr2.70110
M3 - Article
AN - SCOPUS:105024003246
SN - 1751-956X
VL - 19
JO - IET Intelligent Transport Systems
JF - IET Intelligent Transport Systems
IS - 1
M1 - e70110
ER -