TY - GEN
T1 - ArnoldiGCL
T2 - 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2025
AU - Coşkun, Mustafa
AU - Baggag, Abdelkader
AU - Koyutürk, Mehmet
N1 - Publisher Copyright:
© 2025 Copyright held by the owner/author(s)
PY - 2025/8/3
Y1 - 2025/8/3
N2 - Graph Contrastive Learning (GCL) emerged as a powerful paradigm in self-supervised graph representation learning. While earlier applications of GCL rely on homophily assumptions, spectral graph neural networks (GNNs) enhance the effectiveness of GCL on heterophilic graphs by incorporating both low-pass and high-pass filters. However, due to numerical considerations, existing approaches oversimplify low-pass and high-pass filters by modeling them as basic linear operations, failing to capture complex topological relationships. Here, we propose ArnoldiGCL, a novel algorithm that enables the application of complex spectral filters for Graph Contrastive Learning (GCL). Using Arnoldi orthonormalization-based Chebyshev interpolation, ArnoldiGCL overcomes the difficulties posed by ill-conditioned Vandermonde systems that arise in the modeling of complex filters. By introducing learnable filters, our method generates diverse spectral views and effectively captures nuanced graph structures. Theoretical analysis demonstrates that ArnoldiGCL accurately interpolates complex filters, thus forming a solid foundation for contrastive learning on graphs with complex structures. Extensive experiments on real-world datasets confirm that ArnoldiGCL significantly outperforms state-of-the-art GCL algorithms on both homophilic and heterophilic graphs, showcasing its robustness and versatility.
AB - Graph Contrastive Learning (GCL) emerged as a powerful paradigm in self-supervised graph representation learning. While earlier applications of GCL rely on homophily assumptions, spectral graph neural networks (GNNs) enhance the effectiveness of GCL on heterophilic graphs by incorporating both low-pass and high-pass filters. However, due to numerical considerations, existing approaches oversimplify low-pass and high-pass filters by modeling them as basic linear operations, failing to capture complex topological relationships. Here, we propose ArnoldiGCL, a novel algorithm that enables the application of complex spectral filters for Graph Contrastive Learning (GCL). Using Arnoldi orthonormalization-based Chebyshev interpolation, ArnoldiGCL overcomes the difficulties posed by ill-conditioned Vandermonde systems that arise in the modeling of complex filters. By introducing learnable filters, our method generates diverse spectral views and effectively captures nuanced graph structures. Theoretical analysis demonstrates that ArnoldiGCL accurately interpolates complex filters, thus forming a solid foundation for contrastive learning on graphs with complex structures. Extensive experiments on real-world datasets confirm that ArnoldiGCL significantly outperforms state-of-the-art GCL algorithms on both homophilic and heterophilic graphs, showcasing its robustness and versatility.
KW - Graph Contrastive Learning
KW - Graph Neural Networks
KW - Guided Graph Filter
UR - https://www.scopus.com/pages/publications/105014313745
U2 - 10.1145/3711896.3736847
DO - 10.1145/3711896.3736847
M3 - Conference contribution
AN - SCOPUS:105014313745
T3 - Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
SP - 380
EP - 391
BT - KDD 2025 - Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining
PB - Association for Computing Machinery
Y2 - 3 August 2025 through 7 August 2025
ER -