Matches in SemOpenAlex for { <https://semopenalex.org/work/W4365395902> ?p ?o ?g. }
- W4365395902 endingPage "159" @default.
- W4365395902 startingPage "148" @default.
- W4365395902 abstract "We present a work-in-progress on implementing reinforcement learning by instrumental conditioning on SpiNNaker. Animals learn to behave by exploring the changing environment around them such that, over a period of time, their behaviour gives a good outcome (reward) i.e. a perception of ‘satisfaction’. While inspired by animal learning, reinforcement learning adopts a goal-directed strategy of maximising rewards in a dynamic environment. Instrumental conditioning is a strategy to strengthen the association between an action and the environmental state when the state-action pair is rewarded i.e. the reward is instrumental in forming the association. However, in the real world, the delivery of a reward is often delayed in time, known as the distal reward problem. Using the concept of eligibility traces and spike-time dependant plasticity (STDP), Izhikevich (2007) simulated both classical and instrumental conditioning in a spiking neural network with Dopamine (DA)-modulated STDP. The current implementation of DA-modulated plasticity on SpiNNaker using trace-based STDP is reported by Mikaitas et al. (2018), who demonstrated classical conditioning with a similar experimental set up as Izhikevich. Our results show that using delayed DA-modulation of STDP on SpiNNaker, we can condition a neural population to maximise its reward over a period of time by firing at a higher rate than another competing population. Ongoing work is looking into a dynamic conditioning scenario where different actions can be selected within the same run as is the case in real world scenarios." @default.
- W4365395902 created "2023-04-14" @default.
- W4365395902 creator A5006331026 @default.
- W4365395902 creator A5042101050 @default.
- W4365395902 creator A5056642972 @default.
- W4365395902 creator A5069244841 @default.
- W4365395902 creator A5072643963 @default.
- W4365395902 creator A5074640353 @default.
- W4365395902 creator A5083177159 @default.
- W4365395902 date "2023-01-01" @default.
- W4365395902 modified "2023-10-16" @default.
- W4365395902 title "Instrumental Conditioning with Neuromodulated Plasticity on SpiNNaker" @default.
- W4365395902 cites W1582051163 @default.
- W4365395902 cites W1896595291 @default.
- W4365395902 cites W2005967666 @default.
- W4365395902 cites W2038511109 @default.
- W4365395902 cites W2097852913 @default.
- W4365395902 cites W2102673654 @default.
- W4365395902 cites W2147101007 @default.
- W4365395902 cites W2150389614 @default.
- W4365395902 cites W2153113253 @default.
- W4365395902 cites W2159951683 @default.
- W4365395902 cites W2569736129 @default.
- W4365395902 cites W2790788952 @default.
- W4365395902 cites W2898350988 @default.
- W4365395902 cites W2969226897 @default.
- W4365395902 cites W3204790462 @default.
- W4365395902 cites W4242770316 @default.
- W4365395902 doi "https://doi.org/10.1007/978-3-031-30108-7_13" @default.
- W4365395902 hasPublicationYear "2023" @default.
- W4365395902 type Work @default.
- W4365395902 citedByCount "1" @default.
- W4365395902 countsByYear W43653959022023 @default.
- W4365395902 crossrefType "book-chapter" @default.
- W4365395902 hasAuthorship W4365395902A5006331026 @default.
- W4365395902 hasAuthorship W4365395902A5042101050 @default.
- W4365395902 hasAuthorship W4365395902A5056642972 @default.
- W4365395902 hasAuthorship W4365395902A5069244841 @default.
- W4365395902 hasAuthorship W4365395902A5072643963 @default.
- W4365395902 hasAuthorship W4365395902A5074640353 @default.
- W4365395902 hasAuthorship W4365395902A5083177159 @default.
- W4365395902 hasConcept C105795698 @default.
- W4365395902 hasConcept C138885662 @default.
- W4365395902 hasConcept C142853389 @default.
- W4365395902 hasConcept C144024400 @default.
- W4365395902 hasConcept C149923435 @default.
- W4365395902 hasConcept C154945302 @default.
- W4365395902 hasConcept C15744967 @default.
- W4365395902 hasConcept C163270606 @default.
- W4365395902 hasConcept C169760540 @default.
- W4365395902 hasConcept C177264268 @default.
- W4365395902 hasConcept C199360897 @default.
- W4365395902 hasConcept C26760741 @default.
- W4365395902 hasConcept C2908647359 @default.
- W4365395902 hasConcept C33923547 @default.
- W4365395902 hasConcept C39617858 @default.
- W4365395902 hasConcept C41008148 @default.
- W4365395902 hasConcept C41895202 @default.
- W4365395902 hasConcept C45262634 @default.
- W4365395902 hasConcept C542102704 @default.
- W4365395902 hasConcept C67203356 @default.
- W4365395902 hasConcept C75291252 @default.
- W4365395902 hasConcept C77805123 @default.
- W4365395902 hasConcept C97541855 @default.
- W4365395902 hasConceptScore W4365395902C105795698 @default.
- W4365395902 hasConceptScore W4365395902C138885662 @default.
- W4365395902 hasConceptScore W4365395902C142853389 @default.
- W4365395902 hasConceptScore W4365395902C144024400 @default.
- W4365395902 hasConceptScore W4365395902C149923435 @default.
- W4365395902 hasConceptScore W4365395902C154945302 @default.
- W4365395902 hasConceptScore W4365395902C15744967 @default.
- W4365395902 hasConceptScore W4365395902C163270606 @default.
- W4365395902 hasConceptScore W4365395902C169760540 @default.
- W4365395902 hasConceptScore W4365395902C177264268 @default.
- W4365395902 hasConceptScore W4365395902C199360897 @default.
- W4365395902 hasConceptScore W4365395902C26760741 @default.
- W4365395902 hasConceptScore W4365395902C2908647359 @default.
- W4365395902 hasConceptScore W4365395902C33923547 @default.
- W4365395902 hasConceptScore W4365395902C39617858 @default.
- W4365395902 hasConceptScore W4365395902C41008148 @default.
- W4365395902 hasConceptScore W4365395902C41895202 @default.
- W4365395902 hasConceptScore W4365395902C45262634 @default.
- W4365395902 hasConceptScore W4365395902C542102704 @default.
- W4365395902 hasConceptScore W4365395902C67203356 @default.
- W4365395902 hasConceptScore W4365395902C75291252 @default.
- W4365395902 hasConceptScore W4365395902C77805123 @default.
- W4365395902 hasConceptScore W4365395902C97541855 @default.
- W4365395902 hasLocation W43653959021 @default.
- W4365395902 hasOpenAccess W4365395902 @default.
- W4365395902 hasPrimaryLocation W43653959021 @default.
- W4365395902 hasRelatedWork W1538406843 @default.
- W4365395902 hasRelatedWork W1996251020 @default.
- W4365395902 hasRelatedWork W2022953025 @default.
- W4365395902 hasRelatedWork W2096048564 @default.
- W4365395902 hasRelatedWork W2936794250 @default.
- W4365395902 hasRelatedWork W3186721384 @default.
- W4365395902 hasRelatedWork W3196638943 @default.
- W4365395902 hasRelatedWork W4289450308 @default.