fig2

Figure 2. Overview of the methodology for the proposed CNN-TD3 optimization operational framework. CNN: Convolutional neural network; TD3: twin delayed deep deterministic policy gradient; RL: reinforcement learning; DRL: deep reinforcement learning; DES: direct event simulation; TESS: thermal energy storage system.