Federated Deep Reinforcement Learning for Combating Cyber-Threats Specific to EV Charging in Next-Gen WPT Infrastructure

With the popularity of electric vehicles (EVs), wireless power transmission (WPT) technology has become a hot research topic for next-generation battery charging technology. However, the vulnerability of wireless networks to malicious interference attacks is inherited by WPT. To alleviate the privacy and security issues of WPT, we propose a novel FedDQ, a federated deep reinforcement learning with Q-ensemble, to cope with interference attacks in EV wireless charging network environments. Federated learning protects the security privacy of EVs by training a global model that exploits the property that data and models will not be transmitted. In order to trade-off the training cost and efficiency, we introduce offline-to-online training models by pre-training the offline Q-network with pre-collected data, and the trained model serves as an initialization of the online model. Then, the online Q-network is obtained by weakening or removing the original pessimistic constraints to enhance the training speed. Secondly, we introduce the intelligent reflective surface (IRS) to enhance the security performance of WPT by modifying the IRS phase shift and amplitude to cancel the malicious interference signal. Experimental results show that our proposed FedDQ algorithm has superior performance and outperforms existing baseline methods in terms of anti-jamming metrics.