fig10

Figure 10. Typical day of cluster result in 3 for TD3 with load clustering (A) TD3 with prior knowledge and load clustering (B). TD3: Twin-delayed deep deterministic policy gradient; TD3c0:scenarios representing typical lower-level mixed cooling, heating, and electricity load loads; TD3c0-wpk: incorporates expert knowledge and CNN processors for nested agents based on scenarios representing typical lower-level mixed cooling, heating, and electricity load; PV: photovoltaic; BESS: battery energy storage system; GE: gas engine.