Matches in SemOpenAlex for { <https://semopenalex.org/work/W3156321937> ?p ?o ?g. }
- W3156321937 abstract "In Volt/Var control (VVC) of active distribution networks(ADNs), both slow timescale discrete devices (STDDs) and fast timescale continuous devices (FTCDs) are involved. The STDDs such as on-load tap changers (OLTC) and FTCDs such as distributed generators should be coordinated in time sequence. Such VCC is formulated as a two-timescale optimization problem to jointly optimize FTCDs and STDDs in ADNs. Traditional optimization methods are heavily based on accurate models of the system, but sometimes impractical because of their unaffordable effort on modelling. In this paper, a novel bi-level off-policy reinforcement learning (RL) algorithm is proposed to solve this problem in a model-free manner. A Bi-level Markov decision process (BMDP) is defined to describe the two-timescale VVC problem and separate agents are set up for the slow and fast timescale sub-problems. For the fast timescale sub-problem, we adopt an off-policy RL method soft actor-critic with high sample efficiency. For the slow one, we develop an off-policy multi-discrete soft actor-critic (MDSAC) algorithm to address the curse of dimensionality with various STDDs. To mitigate the non-stationary issue existing the two agents' learning processes, we propose a multi-timescale off-policy correction (MTOPC) method by adopting importance sampling technique. Comprehensive numerical studies not only demonstrate that the proposed method can achieve stable and satisfactory optimization of both STDDs and FTCDs without any model information, but also support that the proposed method outperforms existing two-timescale VVC methods." @default.
- W3156321937 created "2021-04-26" @default.
- W3156321937 creator A5009457440 @default.
- W3156321937 creator A5081837032 @default.
- W3156321937 date "2021-04-13" @default.
- W3156321937 modified "2023-09-24" @default.
- W3156321937 title "Bi-level Off-policy Reinforcement Learning for Volt/VAR Control Involving Continuous and Discrete Devices." @default.
- W3156321937 cites W1987463767 @default.
- W3156321937 cites W2101822270 @default.
- W3156321937 cites W2109910161 @default.
- W3156321937 cites W2145761514 @default.
- W3156321937 cites W2173564293 @default.
- W3156321937 cites W2344993821 @default.
- W3156321937 cites W2588825664 @default.
- W3156321937 cites W2616681435 @default.
- W3156321937 cites W2626637010 @default.
- W3156321937 cites W2736601468 @default.
- W3156321937 cites W2803281228 @default.
- W3156321937 cites W2842089854 @default.
- W3156321937 cites W2904246096 @default.
- W3156321937 cites W2908374053 @default.
- W3156321937 cites W2945010440 @default.
- W3156321937 cites W2950492145 @default.
- W3156321937 cites W2962414937 @default.
- W3156321937 cites W2962848173 @default.
- W3156321937 cites W2963407617 @default.
- W3156321937 cites W2985240388 @default.
- W3156321937 cites W2997572754 @default.
- W3156321937 cites W3000327236 @default.
- W3156321937 cites W3008338267 @default.
- W3156321937 cites W3017872050 @default.
- W3156321937 cites W3034586071 @default.
- W3156321937 cites W3035404531 @default.
- W3156321937 cites W3037661551 @default.
- W3156321937 cites W3102187216 @default.
- W3156321937 cites W3110616637 @default.
- W3156321937 cites W3110720423 @default.
- W3156321937 cites W3117423974 @default.
- W3156321937 cites W3126981000 @default.
- W3156321937 cites W3129322645 @default.
- W3156321937 cites W3131436982 @default.
- W3156321937 cites W3172472843 @default.
- W3156321937 hasPublicationYear "2021" @default.
- W3156321937 type Work @default.
- W3156321937 sameAs 3156321937 @default.
- W3156321937 citedByCount "2" @default.
- W3156321937 countsByYear W31563219372021 @default.
- W3156321937 crossrefType "posted-content" @default.
- W3156321937 hasAuthorship W3156321937A5009457440 @default.
- W3156321937 hasAuthorship W3156321937A5081837032 @default.
- W3156321937 hasConcept C105795698 @default.
- W3156321937 hasConcept C106131492 @default.
- W3156321937 hasConcept C106189395 @default.
- W3156321937 hasConcept C111030470 @default.
- W3156321937 hasConcept C111919701 @default.
- W3156321937 hasConcept C11413529 @default.
- W3156321937 hasConcept C126255220 @default.
- W3156321937 hasConcept C137836250 @default.
- W3156321937 hasConcept C140779682 @default.
- W3156321937 hasConcept C154945302 @default.
- W3156321937 hasConcept C159886148 @default.
- W3156321937 hasConcept C177264268 @default.
- W3156321937 hasConcept C185592680 @default.
- W3156321937 hasConcept C198531522 @default.
- W3156321937 hasConcept C199360897 @default.
- W3156321937 hasConcept C2775924081 @default.
- W3156321937 hasConcept C31972630 @default.
- W3156321937 hasConcept C33923547 @default.
- W3156321937 hasConcept C41008148 @default.
- W3156321937 hasConcept C43617362 @default.
- W3156321937 hasConcept C91575142 @default.
- W3156321937 hasConcept C97541855 @default.
- W3156321937 hasConcept C98045186 @default.
- W3156321937 hasConceptScore W3156321937C105795698 @default.
- W3156321937 hasConceptScore W3156321937C106131492 @default.
- W3156321937 hasConceptScore W3156321937C106189395 @default.
- W3156321937 hasConceptScore W3156321937C111030470 @default.
- W3156321937 hasConceptScore W3156321937C111919701 @default.
- W3156321937 hasConceptScore W3156321937C11413529 @default.
- W3156321937 hasConceptScore W3156321937C126255220 @default.
- W3156321937 hasConceptScore W3156321937C137836250 @default.
- W3156321937 hasConceptScore W3156321937C140779682 @default.
- W3156321937 hasConceptScore W3156321937C154945302 @default.
- W3156321937 hasConceptScore W3156321937C159886148 @default.
- W3156321937 hasConceptScore W3156321937C177264268 @default.
- W3156321937 hasConceptScore W3156321937C185592680 @default.
- W3156321937 hasConceptScore W3156321937C198531522 @default.
- W3156321937 hasConceptScore W3156321937C199360897 @default.
- W3156321937 hasConceptScore W3156321937C2775924081 @default.
- W3156321937 hasConceptScore W3156321937C31972630 @default.
- W3156321937 hasConceptScore W3156321937C33923547 @default.
- W3156321937 hasConceptScore W3156321937C41008148 @default.
- W3156321937 hasConceptScore W3156321937C43617362 @default.
- W3156321937 hasConceptScore W3156321937C91575142 @default.
- W3156321937 hasConceptScore W3156321937C97541855 @default.
- W3156321937 hasConceptScore W3156321937C98045186 @default.
- W3156321937 hasLocation W31563219371 @default.
- W3156321937 hasOpenAccess W3156321937 @default.
- W3156321937 hasPrimaryLocation W31563219371 @default.
- W3156321937 hasRelatedWork W11238731 @default.