Matches in SemOpenAlex for { <https://semopenalex.org/work/W4297847879> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W4297847879 abstract "The term nexting has been used by psychologists to refer to the propensity of people and many other animals to continually predict what will happen next in an immediate, local, and personal sense. The ability to next constitutes a basic kind of awareness and knowledge of one's environment. In this paper we present results with a robot that learns to next in real time, predicting thousands of features of the world's state, including all sensory inputs, at timescales from 0.1 to 8 seconds. This was achieved by treating each state feature as a reward-like target and applying temporal-difference methods to learn a corresponding value function with a discount rate corresponding to the timescale. We show that two thousand predictions, each dependent on six thousand state features, can be learned and updated online at better than 10Hz on a laptop computer, using the standard TD(lambda) algorithm with linear function approximation. We show that this approach is efficient enough to be practical, with most of the learning complete within 30 minutes. We also show that a single tile-coded feature representation suffices to accurately predict many different signals at a significant range of timescales. Finally, we show that the accuracy of our learned predictions compares favorably with the optimal off-line solution." @default.
- W4297847879 created "2022-10-01" @default.
- W4297847879 creator A5004923102 @default.
- W4297847879 creator A5054065284 @default.
- W4297847879 creator A5056738150 @default.
- W4297847879 date "2011-12-05" @default.
- W4297847879 modified "2023-09-27" @default.
- W4297847879 title "Multi-timescale Nexting in a Reinforcement Learning Robot" @default.
- W4297847879 doi "https://doi.org/10.48550/arxiv.1112.1133" @default.
- W4297847879 hasPublicationYear "2011" @default.
- W4297847879 type Work @default.
- W4297847879 citedByCount "0" @default.
- W4297847879 crossrefType "posted-content" @default.
- W4297847879 hasAuthorship W4297847879A5004923102 @default.
- W4297847879 hasAuthorship W4297847879A5054065284 @default.
- W4297847879 hasAuthorship W4297847879A5056738150 @default.
- W4297847879 hasBestOaLocation W42978478791 @default.
- W4297847879 hasConcept C111919701 @default.
- W4297847879 hasConcept C11413529 @default.
- W4297847879 hasConcept C119857082 @default.
- W4297847879 hasConcept C126255220 @default.
- W4297847879 hasConcept C127413603 @default.
- W4297847879 hasConcept C138885662 @default.
- W4297847879 hasConcept C14036430 @default.
- W4297847879 hasConcept C14646407 @default.
- W4297847879 hasConcept C146978453 @default.
- W4297847879 hasConcept C154945302 @default.
- W4297847879 hasConcept C17744445 @default.
- W4297847879 hasConcept C196340769 @default.
- W4297847879 hasConcept C199539241 @default.
- W4297847879 hasConcept C202444582 @default.
- W4297847879 hasConcept C204323151 @default.
- W4297847879 hasConcept C2776359362 @default.
- W4297847879 hasConcept C2776401178 @default.
- W4297847879 hasConcept C2780008327 @default.
- W4297847879 hasConcept C33676613 @default.
- W4297847879 hasConcept C33923547 @default.
- W4297847879 hasConcept C41008148 @default.
- W4297847879 hasConcept C41895202 @default.
- W4297847879 hasConcept C48103436 @default.
- W4297847879 hasConcept C78458016 @default.
- W4297847879 hasConcept C86803240 @default.
- W4297847879 hasConcept C90509273 @default.
- W4297847879 hasConcept C94625758 @default.
- W4297847879 hasConcept C97541855 @default.
- W4297847879 hasConceptScore W4297847879C111919701 @default.
- W4297847879 hasConceptScore W4297847879C11413529 @default.
- W4297847879 hasConceptScore W4297847879C119857082 @default.
- W4297847879 hasConceptScore W4297847879C126255220 @default.
- W4297847879 hasConceptScore W4297847879C127413603 @default.
- W4297847879 hasConceptScore W4297847879C138885662 @default.
- W4297847879 hasConceptScore W4297847879C14036430 @default.
- W4297847879 hasConceptScore W4297847879C14646407 @default.
- W4297847879 hasConceptScore W4297847879C146978453 @default.
- W4297847879 hasConceptScore W4297847879C154945302 @default.
- W4297847879 hasConceptScore W4297847879C17744445 @default.
- W4297847879 hasConceptScore W4297847879C196340769 @default.
- W4297847879 hasConceptScore W4297847879C199539241 @default.
- W4297847879 hasConceptScore W4297847879C202444582 @default.
- W4297847879 hasConceptScore W4297847879C204323151 @default.
- W4297847879 hasConceptScore W4297847879C2776359362 @default.
- W4297847879 hasConceptScore W4297847879C2776401178 @default.
- W4297847879 hasConceptScore W4297847879C2780008327 @default.
- W4297847879 hasConceptScore W4297847879C33676613 @default.
- W4297847879 hasConceptScore W4297847879C33923547 @default.
- W4297847879 hasConceptScore W4297847879C41008148 @default.
- W4297847879 hasConceptScore W4297847879C41895202 @default.
- W4297847879 hasConceptScore W4297847879C48103436 @default.
- W4297847879 hasConceptScore W4297847879C78458016 @default.
- W4297847879 hasConceptScore W4297847879C86803240 @default.
- W4297847879 hasConceptScore W4297847879C90509273 @default.
- W4297847879 hasConceptScore W4297847879C94625758 @default.
- W4297847879 hasConceptScore W4297847879C97541855 @default.
- W4297847879 hasLocation W42978478791 @default.
- W4297847879 hasOpenAccess W4297847879 @default.
- W4297847879 hasPrimaryLocation W42978478791 @default.
- W4297847879 hasRelatedWork W2129532790 @default.
- W4297847879 hasRelatedWork W2149418961 @default.
- W4297847879 hasRelatedWork W2341346307 @default.
- W4297847879 hasRelatedWork W3022038857 @default.
- W4297847879 hasRelatedWork W3023701936 @default.
- W4297847879 hasRelatedWork W3025133396 @default.
- W4297847879 hasRelatedWork W4289355352 @default.
- W4297847879 hasRelatedWork W4308702637 @default.
- W4297847879 hasRelatedWork W4319083788 @default.
- W4297847879 hasRelatedWork W56580342 @default.
- W4297847879 isParatext "false" @default.
- W4297847879 isRetracted "false" @default.
- W4297847879 workType "article" @default.