Matches in SemOpenAlex for { <https://semopenalex.org/work/W2971304827> ?p ?o ?g. }
- W2971304827 endingPage "773" @default.
- W2971304827 startingPage "761" @default.
- W2971304827 abstract "Contingency is a critical concept for theories of associative learning and the assignment of credit problem in reinforcement learning. Measuring and manipulating it has, however, been problematic. The information-theoretic definition of contingency-normalized mutual information-makes it a readily computed property of the relation between reinforcing events, the stimuli that predict them and the responses that produce them. When necessary, the dynamic range of the required temporal representation divided by the Weber fraction gives a psychologically realistic plug-in estimates of the entropies. There is no measurable prospective contingency between a peck and reinforcement when pigeons peck on a variable interval schedule of reinforcement. There is, however, a perfect retrospective contingency between reinforcement and the immediately preceding peck. Degrading the retrospective contingency by gratis reinforcement reveals a critical value (.25), below which performance declines rapidly. Contingency is time scale invariant, whereas the perception of proximate causality depends-we assume-on there being a short, fixed psychologically negligible critical interval between cause and effect. Increasing the interval between a response and reinforcement that it triggers degrades the retrograde contingency, leading to a decline in performance that restores it to at or above its critical value. Thus, there is no critical interval in the retrospective effect of reinforcement. We conclude with a short review of the broad explanatory scope of information-theoretic contingencies when regarded as causal variables in conditioning. We suggest that the computation of contingencies may supplant the computation of the sum of all future rewards in models of reinforcement learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved)." @default.
- W2971304827 created "2019-09-05" @default.
- W2971304827 creator A5053596014 @default.
- W2971304827 creator A5062872403 @default.
- W2971304827 creator A5087434888 @default.
- W2971304827 date "2019-10-01" @default.
- W2971304827 modified "2023-09-30" @default.
- W2971304827 title "Contingency, contiguity, and causality in conditioning: Applying information theory and Weber’s Law to the assignment of credit problem." @default.
- W2971304827 cites W1463206090 @default.
- W2971304827 cites W1488862666 @default.
- W2971304827 cites W1524143658 @default.
- W2971304827 cites W160989634 @default.
- W2971304827 cites W1847236181 @default.
- W2971304827 cites W1922104716 @default.
- W2971304827 cites W1944839424 @default.
- W2971304827 cites W1973628485 @default.
- W2971304827 cites W1975401347 @default.
- W2971304827 cites W1977203725 @default.
- W2971304827 cites W1978449205 @default.
- W2971304827 cites W1985943047 @default.
- W2971304827 cites W1986264597 @default.
- W2971304827 cites W2003377658 @default.
- W2971304827 cites W2005013412 @default.
- W2971304827 cites W2005762437 @default.
- W2971304827 cites W2010669375 @default.
- W2971304827 cites W2013702324 @default.
- W2971304827 cites W2016085394 @default.
- W2971304827 cites W2023212430 @default.
- W2971304827 cites W2025016460 @default.
- W2971304827 cites W2025454278 @default.
- W2971304827 cites W2029654180 @default.
- W2971304827 cites W2031034121 @default.
- W2971304827 cites W2031485535 @default.
- W2971304827 cites W2040598998 @default.
- W2971304827 cites W2042220954 @default.
- W2971304827 cites W2046889372 @default.
- W2971304827 cites W2047730005 @default.
- W2971304827 cites W2048995537 @default.
- W2971304827 cites W2050741203 @default.
- W2971304827 cites W2051371887 @default.
- W2971304827 cites W2051935603 @default.
- W2971304827 cites W2053706998 @default.
- W2971304827 cites W2057720927 @default.
- W2971304827 cites W2060656101 @default.
- W2971304827 cites W2060694206 @default.
- W2971304827 cites W2069428670 @default.
- W2971304827 cites W2069680802 @default.
- W2971304827 cites W2074417701 @default.
- W2971304827 cites W2074558608 @default.
- W2971304827 cites W2078797464 @default.
- W2971304827 cites W2081143604 @default.
- W2971304827 cites W2087489810 @default.
- W2971304827 cites W2090144013 @default.
- W2971304827 cites W2093427091 @default.
- W2971304827 cites W2100677568 @default.
- W2971304827 cites W2104128511 @default.
- W2971304827 cites W2110004219 @default.
- W2971304827 cites W2117143825 @default.
- W2971304827 cites W2117726420 @default.
- W2971304827 cites W2120722526 @default.
- W2971304827 cites W2124218367 @default.
- W2971304827 cites W2124720308 @default.
- W2971304827 cites W2125790477 @default.
- W2971304827 cites W2126008037 @default.
- W2971304827 cites W2126805559 @default.
- W2971304827 cites W2128689969 @default.
- W2971304827 cites W2129046573 @default.
- W2971304827 cites W2131220353 @default.
- W2971304827 cites W2144806606 @default.
- W2971304827 cites W2149816092 @default.
- W2971304827 cites W2150128318 @default.
- W2971304827 cites W2153436688 @default.
- W2971304827 cites W2156952192 @default.
- W2971304827 cites W2159591784 @default.
- W2971304827 cites W2177068484 @default.
- W2971304827 cites W2178093636 @default.
- W2971304827 cites W2274685343 @default.
- W2971304827 cites W2283261589 @default.
- W2971304827 cites W2344235711 @default.
- W2971304827 cites W2587627859 @default.
- W2971304827 cites W2691559912 @default.
- W2971304827 cites W2746931880 @default.
- W2971304827 cites W2754187158 @default.
- W2971304827 cites W2781888692 @default.
- W2971304827 cites W2800480419 @default.
- W2971304827 cites W2894382374 @default.
- W2971304827 cites W2950380978 @default.
- W2971304827 cites W2953328634 @default.
- W2971304827 cites W2955393424 @default.
- W2971304827 cites W3214989072 @default.
- W2971304827 cites W763931832 @default.
- W2971304827 cites W878459836 @default.
- W2971304827 cites W2928398847 @default.
- W2971304827 doi "https://doi.org/10.1037/rev0000163" @default.
- W2971304827 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/31464474" @default.
- W2971304827 hasPublicationYear "2019" @default.
- W2971304827 type Work @default.
- W2971304827 sameAs 2971304827 @default.