F-DQN: an optimized DQN for decision-making of generator start-up sequence after blackout

The decision-making of generator start-up sequence plays a pivotal role in the power system restoration process following the blackout. In this paper, an optimized deep Q-learning network (DQN) algorithm is proposed to address this challenge. The generator start-up process is modeled as a Markov Decision Process (MDP) based on its characteristics. The DQN is tasked with deciding both the generator start-up sequence and the corresponding restoration path. To address the limitations of DQN, such as low exploration efficiency and slow convergence, the study incorporates the Artificial Potential Field (APF) algorithm to refine the reward function of it. This integration results in the development of the F-DQN (APF-DQN) algorithm, which enhances training efficiency. The effectiveness of this proposed method is demonstrated through the IEEE 39-bus test system. The results reveal that the DQN algorithm is capable of efficiently solving the model of the generator start-up sequence after the blackout. Moreover, the F-DQN algorithm exhibits superior learning efficiency, faster convergence, and higher-quality optimal solutions compared to the DQN. This paper also discusses the applicability of this method under partial blackouts. When compared to other decision-making algorithms, the proposed method offers a restoration scheme that is both time-efficient and results in increased electricity generation.