Q-Learning Algorithm And CMAC Approximation Based Robust Optimal Control For Renewable Energy Management Systems

Abstract

This paper investigates a robust optimal control algorithm for a renewable energy management system. The algorithm is obtained by developing a novel method based on the zero-sum games (ZSG) theory for control and the well-known Q-learning algorithm. Firstly, the  performance index function is formed via real-time parameters including electricity price, load demand, solar energy, and battery lifetime. Secondly, a self-learning and control algorithm is established and the value function solution is approximated by the cerebellar model articulation controller (CMAC). Finally, the algorithm guarantees that the disturbance compensation policy, optimal value function and the optimal control strategy converge to the near-optimal values. Comparison with other methods in a numerical experiment using practically measured data is implemented to evaluate the effectiveness of the designed algorithm.