TY - GEN
T1 - P-BiC
T2 - 32nd ACM International Conference on Multimedia, MM 2024
AU - Xiao, Zeyu
AU - Lu, Zhihe
AU - Wang, Xinchao
N1 - Publisher Copyright:
© 2024 Owner/Author.
PY - 2024/10/28
Y1 - 2024/10/28
N2 - People nowadays use smartphones to capture photos from multimedia platforms. The presence of moire patterns resulting from spectral aliasing can significantly degrade the visual quality of images, particularly in ultra-high-definition (UHD) images. However, existing demoireing methods have mostly been designed for low-definition images, making them unsuitable for handling moire patterns in UHD images due to their substantial memory requirements. In this paper, we propose a novel patch bilateral compensation network (P-BiC) for the demoire pattern removal in UHD images, which is memory-efficient and prior-knowledge-based. Specifically, we divide the UHD images into small patches and perform patch-level demoireing to maintain the low memory cost even for ultra-large image sizes. Moreover, a pivotal insight, namely that the green channel of an image remains relatively less affected by moire patterns, while the tone information in moire images is still well-retained despite color shifts, is directly harnessed for the purpose of bilateral compensation. The bilateral compensation is achieved by two key components in our P-BiC, i.e., a green-guided detail transfer (G2DT) module that complements distorted features with the intact content, and a style-aware tone adjustment (STA) module for the color adjustment. We quantitatively and qualitatively evaluate the effectiveness of P-BiC with extensive experiments. The code is publicly available at: https://github.com/zeyuxiao1997/P-BiC.
AB - People nowadays use smartphones to capture photos from multimedia platforms. The presence of moire patterns resulting from spectral aliasing can significantly degrade the visual quality of images, particularly in ultra-high-definition (UHD) images. However, existing demoireing methods have mostly been designed for low-definition images, making them unsuitable for handling moire patterns in UHD images due to their substantial memory requirements. In this paper, we propose a novel patch bilateral compensation network (P-BiC) for the demoire pattern removal in UHD images, which is memory-efficient and prior-knowledge-based. Specifically, we divide the UHD images into small patches and perform patch-level demoireing to maintain the low memory cost even for ultra-large image sizes. Moreover, a pivotal insight, namely that the green channel of an image remains relatively less affected by moire patterns, while the tone information in moire images is still well-retained despite color shifts, is directly harnessed for the purpose of bilateral compensation. The bilateral compensation is achieved by two key components in our P-BiC, i.e., a green-guided detail transfer (G2DT) module that complements distorted features with the intact content, and a style-aware tone adjustment (STA) module for the color adjustment. We quantitatively and qualitatively evaluate the effectiveness of P-BiC with extensive experiments. The code is publicly available at: https://github.com/zeyuxiao1997/P-BiC.
KW - image demoireing
KW - image restoration
KW - ultra-high-definition image
UR - https://www.scopus.com/pages/publications/85209812943
U2 - 10.1145/3664647.3681144
DO - 10.1145/3664647.3681144
M3 - Conference contribution
AN - SCOPUS:85209812943
T3 - MM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia
SP - 8365
EP - 8373
BT - MM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia
PB - Association for Computing Machinery, Inc
Y2 - 28 October 2024 through 1 November 2024
ER -