基于混合惩罚函数增强型D3QN算法的微网低碳经济能量管理方法

In this paper, an enhanced dueling double deep Q network algorithm with mixed penalty function (EN-D3QN-MPF) for microgrid energy management control is developed. First, a novel microgrid model including PV, wind turbine generator, electric storage system, electric vehicle charging station, thermostatically controlled loads, and residential price-responsive loads are proposed. Then, by combining the mixed penalty function method with D3QN reinforcement learning together, a mixed penalty function method is implemented to balance the reward weightings. Accordingly, an EN-D3QN-MPF algorithm is presented to achieve low-carbon economic and EV users' charging satisfaction operation of the microgrid. The effectiveness of the proposed method is verified by the dataset collected from eastern China in 2019. Simulation results validate that our proposed method has superior energy management performance over the genetic algorithm (GA), Particle Swarm Optimization (PSO), dueling deep Q network (dueling DQN), double DQN (DDQN), and D3QN algorithms.