Figure 3. TD3 principal diagram. TD3: Twin delayed deep deterministic policy gradient; TD-error1: temporal difference error 1; TD-error2: temporal difference error 2; BESS: battery electricity energy storage; GE: gas engine; TESS: thermal energy storage system; PV: photovoltaic.