Abstract
Future wireless networks are anticipated to evolve by aerial communication platforms. Nonetheless, the operational lifespan and efficacy of transceivers such as unmanned aerial vehicle (UAVs) and Internet of Things (IoT) devices are strictly prohibited by their constrained onboard power sources. This paper focuses on an aerial network configuration where a UAV harvests solar power to serve energy-limited IoT devices through simultaneous wireless information and power transfer. In this setup, the UAV and the IoT devices, each are equipped with energy and data buffers. This system also benefits from rate splitting multiple access for efficient interference management. Upon optimizing the system efficacy, we formulate a long-term resource allocation problem to maximize the time-averaged energy efficiency. To address this stochastic and non-convex optimization problem, we propose a multi-stage solution strategy. Firstly, by leveraging Lyapunov optimization theory, we transform the long-term stochastic problem into an equivalent deterministic short-term form. Next, by recasting this equivalent problem into Markov decision process, we propose a resource allocation mechanism based on actor-critic hindsight experience replay (AC-HER), tailored to capture the problem dynamics and optimize its variables. Moreover, given the UAV high mobility and the system reconfigurations, we fortify the trained AC-HER model with meta-learning strategy, enhancing its adaptability to system variations. Simulations verified that the proposed resource allocation strategy considerably outperforms its counterparts.
| Original language | English |
|---|---|
| Pages (from-to) | 1942-1957 |
| Number of pages | 16 |
| Journal | IEEE Transactions on Networking |
| Volume | 34 |
| Early online date | Dec 2025 |
| DOIs | |
| Publication status | Published - 2026 |
Keywords
- Actor-critic hindsight experience replay
- meta learning
- rate splitting multiple access
- simultaneous wireless information and power transfer
- unmanned aerial vehicle (UAV)