Matches in SemOpenAlex for { <https://semopenalex.org/work/W4289749945> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4289749945 abstract "We investigate an energy-harvesting wireless sensor transmitting latency-sensitive data over a fading channel. The sensor injects captured data packets into its transmission queue and relies on ambient energy harvested from the environment to transmit them. We aim to find the optimal scheduling policy that decides whether or not to transmit the queue's head-of-line packet at each transmission opportunity such that the expected packet queuing delay is minimized given the available harvested energy. No prior knowledge of the stochastic processes that govern the channel, captured data, or harvested energy dynamics are assumed, thereby necessitating the use of online learning to optimize the scheduling policy. We formulate this scheduling problem as a Markov decision process (MDP) and analyze the structural properties of its optimal value function. In particular, we show that it is non-decreasing and has increasing differences in the queue backlog and that it is non-increasing and has increasing differences in the battery state. We exploit this structure to formulate a novel accelerated reinforcement learning (RL) algorithm to solve the scheduling problem online at a much faster learning rate, while limiting the induced computational complexity. Our experiments demonstrate that the proposed algorithm closely approximates the performance of an optimal offline solution that requires a priori knowledge of the channel, captured data, and harvested energy dynamics. Simultaneously, by leveraging the value function's structure, our approach achieves competitive performance relative to a state-of-the-art RL algorithm, at potentially orders of magnitude lower complexity. Finally, considerable performance gains are demonstrated over the well-known and widely used Q-learning algorithm." @default.
- W4289749945 created "2022-08-04" @default.
- W4289749945 creator A5020888445 @default.
- W4289749945 creator A5047238501 @default.
- W4289749945 creator A5084068339 @default.
- W4289749945 date "2018-07-22" @default.
- W4289749945 modified "2023-09-28" @default.
- W4289749945 title "Accelerated Structure-Aware Reinforcement Learning for Delay-Sensitive Energy Harvesting Wireless Sensors" @default.
- W4289749945 doi "https://doi.org/10.48550/arxiv.1807.08315" @default.
- W4289749945 hasPublicationYear "2018" @default.
- W4289749945 type Work @default.
- W4289749945 citedByCount "0" @default.
- W4289749945 crossrefType "posted-content" @default.
- W4289749945 hasAuthorship W4289749945A5020888445 @default.
- W4289749945 hasAuthorship W4289749945A5047238501 @default.
- W4289749945 hasAuthorship W4289749945A5084068339 @default.
- W4289749945 hasBestOaLocation W42897499451 @default.
- W4289749945 hasConcept C105795698 @default.
- W4289749945 hasConcept C106189395 @default.
- W4289749945 hasConcept C108921912 @default.
- W4289749945 hasConcept C111472728 @default.
- W4289749945 hasConcept C11413529 @default.
- W4289749945 hasConcept C126255220 @default.
- W4289749945 hasConcept C127162648 @default.
- W4289749945 hasConcept C138885662 @default.
- W4289749945 hasConcept C14646407 @default.
- W4289749945 hasConcept C154945302 @default.
- W4289749945 hasConcept C158379750 @default.
- W4289749945 hasConcept C159886148 @default.
- W4289749945 hasConcept C160403385 @default.
- W4289749945 hasConcept C188116033 @default.
- W4289749945 hasConcept C196921405 @default.
- W4289749945 hasConcept C206729178 @default.
- W4289749945 hasConcept C22684755 @default.
- W4289749945 hasConcept C31258907 @default.
- W4289749945 hasConcept C33923547 @default.
- W4289749945 hasConcept C41008148 @default.
- W4289749945 hasConcept C75553542 @default.
- W4289749945 hasConcept C79403827 @default.
- W4289749945 hasConcept C81978471 @default.
- W4289749945 hasConcept C97541855 @default.
- W4289749945 hasConceptScore W4289749945C105795698 @default.
- W4289749945 hasConceptScore W4289749945C106189395 @default.
- W4289749945 hasConceptScore W4289749945C108921912 @default.
- W4289749945 hasConceptScore W4289749945C111472728 @default.
- W4289749945 hasConceptScore W4289749945C11413529 @default.
- W4289749945 hasConceptScore W4289749945C126255220 @default.
- W4289749945 hasConceptScore W4289749945C127162648 @default.
- W4289749945 hasConceptScore W4289749945C138885662 @default.
- W4289749945 hasConceptScore W4289749945C14646407 @default.
- W4289749945 hasConceptScore W4289749945C154945302 @default.
- W4289749945 hasConceptScore W4289749945C158379750 @default.
- W4289749945 hasConceptScore W4289749945C159886148 @default.
- W4289749945 hasConceptScore W4289749945C160403385 @default.
- W4289749945 hasConceptScore W4289749945C188116033 @default.
- W4289749945 hasConceptScore W4289749945C196921405 @default.
- W4289749945 hasConceptScore W4289749945C206729178 @default.
- W4289749945 hasConceptScore W4289749945C22684755 @default.
- W4289749945 hasConceptScore W4289749945C31258907 @default.
- W4289749945 hasConceptScore W4289749945C33923547 @default.
- W4289749945 hasConceptScore W4289749945C41008148 @default.
- W4289749945 hasConceptScore W4289749945C75553542 @default.
- W4289749945 hasConceptScore W4289749945C79403827 @default.
- W4289749945 hasConceptScore W4289749945C81978471 @default.
- W4289749945 hasConceptScore W4289749945C97541855 @default.
- W4289749945 hasLocation W42897499451 @default.
- W4289749945 hasOpenAccess W4289749945 @default.
- W4289749945 hasPrimaryLocation W42897499451 @default.
- W4289749945 hasRelatedWork W1517315971 @default.
- W4289749945 hasRelatedWork W2122703518 @default.
- W4289749945 hasRelatedWork W2125243690 @default.
- W4289749945 hasRelatedWork W2162545413 @default.
- W4289749945 hasRelatedWork W2169957930 @default.
- W4289749945 hasRelatedWork W2883087722 @default.
- W4289749945 hasRelatedWork W2904382199 @default.
- W4289749945 hasRelatedWork W2970163766 @default.
- W4289749945 hasRelatedWork W2995677699 @default.
- W4289749945 hasRelatedWork W3136466665 @default.
- W4289749945 isParatext "false" @default.
- W4289749945 isRetracted "false" @default.
- W4289749945 workType "article" @default.