TY - JOUR
T1 - Curriculum-Enhanced Adaptive Sampling for Physics-Informed Neural Networks
T2 - A Robust Framework for Stiff PDEs
AU - Cetinkaya, Hasan
AU - Ay, Fahrettin
AU - Tunçel, Mehmet
AU - Nounou, Hazem
AU - Nounou, Mohamed Numan
AU - Kurban, Hasan
AU - Serpedin, Erchin
N1 - Publisher Copyright:
© 2025 by the authors.
PY - 2025/12/15
Y1 - 2025/12/15
N2 - Physics-Informed Neural Networks (PINNs) often struggle with stiff partial differential equations (PDEs) exhibiting sharp gradients and extreme nonlinearities. We propose a Curriculum-Enhanced (CE) Adaptive Sampling framework that integrates curriculum learning with adaptive refinement to improve PINN training. Our framework introduces four methods: CE-RARG (greedy sampling), CE-RARD (probabilistic sampling), and their novel difficulty-aware dynamic counterparts, CED-RARG and CED-RARD, which adjust refinement effort based on task difficulty. We test these methods on five challenging stiff PDEs: the Allen–Cahn, Burgers’ (I and II), Korteweg–de Vries (KdV), and Reaction equations. Our methods consistently outperform both Vanilla PINNs and curriculum-only baselines. In the most difficult regimes, CED-RARD achieves errors up to 100 times lower for the Burgers’ and KdV equations. For the Allen–Cahn and Reaction equations, CED-RARG proves most effective, reducing errors by over 40% compared to its non-dynamic counterpart and by over two orders of magnitude relative to Vanilla PINN. Visualizations confirm that our methods effectively allocate collocation points to high-gradient regions. By demonstrating success across a wide range of stiffness parameters, we provide a robust and reproducible framework for solving stiff PDEs, with all code and datasets publicly available.
AB - Physics-Informed Neural Networks (PINNs) often struggle with stiff partial differential equations (PDEs) exhibiting sharp gradients and extreme nonlinearities. We propose a Curriculum-Enhanced (CE) Adaptive Sampling framework that integrates curriculum learning with adaptive refinement to improve PINN training. Our framework introduces four methods: CE-RARG (greedy sampling), CE-RARD (probabilistic sampling), and their novel difficulty-aware dynamic counterparts, CED-RARG and CED-RARD, which adjust refinement effort based on task difficulty. We test these methods on five challenging stiff PDEs: the Allen–Cahn, Burgers’ (I and II), Korteweg–de Vries (KdV), and Reaction equations. Our methods consistently outperform both Vanilla PINNs and curriculum-only baselines. In the most difficult regimes, CED-RARD achieves errors up to 100 times lower for the Burgers’ and KdV equations. For the Allen–Cahn and Reaction equations, CED-RARG proves most effective, reducing errors by over 40% compared to its non-dynamic counterpart and by over two orders of magnitude relative to Vanilla PINN. Visualizations confirm that our methods effectively allocate collocation points to high-gradient regions. By demonstrating success across a wide range of stiffness parameters, we provide a robust and reproducible framework for solving stiff PDEs, with all code and datasets publicly available.
KW - Adaptive sampling
KW - Curriculum learning
KW - Partial differential equations
KW - Physics-informed neural networks
KW - Scientific machine learning
UR - https://www.scopus.com/pages/publications/105025816915
U2 - 10.3390/math13243996
DO - 10.3390/math13243996
M3 - Article
AN - SCOPUS:105025816915
SN - 2227-7390
VL - 13
JO - Mathematics
JF - Mathematics
IS - 24
M1 - 3996
ER -