Matches in SemOpenAlex for { <https://semopenalex.org/work/W4281898441> ?p ?o ?g. }
- W4281898441 endingPage "e1009816" @default.
- W4281898441 startingPage "e1009816" @default.
- W4281898441 abstract "To accurately predict rewards associated with states or actions, the variability of observations has to be taken into account. In particular, when the observations are noisy, the individual rewards should have less influence on tracking of average reward, and the estimate of the mean reward should be updated to a smaller extent after each observation. However, it is not known how the magnitude of the observation noise might be tracked and used to control prediction updates in the brain reward system. Here, we introduce a new model that uses simple, tractable learning rules that track the mean and standard deviation of reward, and leverages prediction errors scaled by uncertainty as the central feedback signal. We show that the new model has an advantage over conventional reinforcement learning models in a value tracking task, and approaches a theoretic limit of performance provided by the Kalman filter. Further, we propose a possible biological implementation of the model in the basal ganglia circuit. In the proposed network, dopaminergic neurons encode reward prediction errors scaled by standard deviation of rewards. We show that such scaling may arise if the striatal neurons learn the standard deviation of rewards and modulate the activity of dopaminergic neurons. The model is consistent with experimental findings concerning dopamine prediction error scaling relative to reward magnitude, and with many features of striatal plasticity. Our results span across the levels of implementation, algorithm, and computation, and might have important implications for understanding the dopaminergic prediction error signal and its relation to adaptive and effective learning." @default.
- W4281898441 created "2022-06-13" @default.
- W4281898441 creator A5018999476 @default.
- W4281898441 creator A5048102371 @default.
- W4281898441 creator A5073339260 @default.
- W4281898441 date "2022-05-27" @default.
- W4281898441 modified "2023-10-03" @default.
- W4281898441 title "Uncertainty–guided learning with scaled prediction errors in the basal ganglia" @default.
- W4281898441 cites W1843669542 @default.
- W4281898441 cites W1969089145 @default.
- W4281898441 cites W1971999279 @default.
- W4281898441 cites W1980586072 @default.
- W4281898441 cites W1982670892 @default.
- W4281898441 cites W1983792941 @default.
- W4281898441 cites W1987052642 @default.
- W4281898441 cites W1991603311 @default.
- W4281898441 cites W2040891197 @default.
- W4281898441 cites W2047416352 @default.
- W4281898441 cites W2064424149 @default.
- W4281898441 cites W2077611535 @default.
- W4281898441 cites W2085376923 @default.
- W4281898441 cites W2090123298 @default.
- W4281898441 cites W2098534820 @default.
- W4281898441 cites W2105041994 @default.
- W4281898441 cites W2117726420 @default.
- W4281898441 cites W2118830830 @default.
- W4281898441 cites W2123093508 @default.
- W4281898441 cites W2127958135 @default.
- W4281898441 cites W2139635035 @default.
- W4281898441 cites W2163647009 @default.
- W4281898441 cites W2167021628 @default.
- W4281898441 cites W2171056452 @default.
- W4281898441 cites W2237059274 @default.
- W4281898441 cites W2309693715 @default.
- W4281898441 cites W2309716161 @default.
- W4281898441 cites W2375881150 @default.
- W4281898441 cites W2507447634 @default.
- W4281898441 cites W2518773215 @default.
- W4281898441 cites W2586293486 @default.
- W4281898441 cites W2617660370 @default.
- W4281898441 cites W2749662979 @default.
- W4281898441 cites W2778689844 @default.
- W4281898441 cites W2794413559 @default.
- W4281898441 cites W2808649721 @default.
- W4281898441 cites W2947738499 @default.
- W4281898441 cites W2951636479 @default.
- W4281898441 cites W2999778183 @default.
- W4281898441 cites W3007736386 @default.
- W4281898441 cites W3036131087 @default.
- W4281898441 cites W3038817743 @default.
- W4281898441 cites W3038915618 @default.
- W4281898441 cites W3134986698 @default.
- W4281898441 cites W3180834236 @default.
- W4281898441 cites W3213424833 @default.
- W4281898441 doi "https://doi.org/10.1371/journal.pcbi.1009816" @default.
- W4281898441 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/35622863" @default.
- W4281898441 hasPublicationYear "2022" @default.
- W4281898441 type Work @default.
- W4281898441 citedByCount "2" @default.
- W4281898441 countsByYear W42818984412023 @default.
- W4281898441 crossrefType "journal-article" @default.
- W4281898441 hasAuthorship W4281898441A5018999476 @default.
- W4281898441 hasAuthorship W4281898441A5048102371 @default.
- W4281898441 hasAuthorship W4281898441A5073339260 @default.
- W4281898441 hasBestOaLocation W42818984411 @default.
- W4281898441 hasConcept C105795698 @default.
- W4281898441 hasConcept C115961682 @default.
- W4281898441 hasConcept C119857082 @default.
- W4281898441 hasConcept C154945302 @default.
- W4281898441 hasConcept C22679943 @default.
- W4281898441 hasConcept C2779127903 @default.
- W4281898441 hasConcept C33923547 @default.
- W4281898441 hasConcept C41008148 @default.
- W4281898441 hasConcept C50644808 @default.
- W4281898441 hasConcept C97541855 @default.
- W4281898441 hasConcept C99498987 @default.
- W4281898441 hasConceptScore W4281898441C105795698 @default.
- W4281898441 hasConceptScore W4281898441C115961682 @default.
- W4281898441 hasConceptScore W4281898441C119857082 @default.
- W4281898441 hasConceptScore W4281898441C154945302 @default.
- W4281898441 hasConceptScore W4281898441C22679943 @default.
- W4281898441 hasConceptScore W4281898441C2779127903 @default.
- W4281898441 hasConceptScore W4281898441C33923547 @default.
- W4281898441 hasConceptScore W4281898441C41008148 @default.
- W4281898441 hasConceptScore W4281898441C50644808 @default.
- W4281898441 hasConceptScore W4281898441C97541855 @default.
- W4281898441 hasConceptScore W4281898441C99498987 @default.
- W4281898441 hasFunder F4320334626 @default.
- W4281898441 hasFunder F4320334629 @default.
- W4281898441 hasIssue "5" @default.
- W4281898441 hasLocation W42818984411 @default.
- W4281898441 hasLocation W42818984412 @default.
- W4281898441 hasLocation W42818984413 @default.
- W4281898441 hasLocation W42818984414 @default.
- W4281898441 hasOpenAccess W4281898441 @default.
- W4281898441 hasPrimaryLocation W42818984411 @default.
- W4281898441 hasRelatedWork W260766989 @default.
- W4281898441 hasRelatedWork W2959276766 @default.