Matches in SemOpenAlex for { <https://semopenalex.org/work/W2573662212> ?p ?o ?g. }
- W2573662212 abstract "In an influential paper (“Rule Learning by Seven-Month-Old Infants”), Marcus, Vijayan, Rao and Vishton claimed that connectionist models cannot account for human success at learning tasks that involved generalization of abstract knowledge such as grammatical rules. This claim triggered a heated debate, centered mostly around variants of the Simple Recurrent Network model. In our work, we revisit this unresolved debate and analyze the underlying issues from a different perspective. We argue that, in order to simulate human-like learning of grammatical rules, a neural network model should not be used as a tabula rasa, but rather, the initial wiring of the neural connections and the experience acquired prior to the actual task should be incorporated into the model. We present two methods that aim to provide such initial state: a manipulation of the initial connections of the network in a cognitively plausible manner (concretely, by implementing a “delay-line” memory), and a pre-training algorithm that incrementally challenges the network with novel stimuli. We implement such techniques in an Echo State Network (ESN), and we show that only when combining both techniques the ESN is able to learn truly general identity rules. Finally, we discuss the relation between these cognitively motivated techniques and recent advances in Deep Learning." @default.
- W2573662212 created "2017-01-26" @default.
- W2573662212 creator A5007928903 @default.
- W2573662212 creator A5055697003 @default.
- W2573662212 date "2016-01-01" @default.
- W2573662212 modified "2023-09-24" @default.
- W2573662212 title "Pre-Wiring and Pre-Training: What Does a Neural Network Need to Learn Truly General Identity Rules?" @default.
- W2573662212 cites W1553508775 @default.
- W2573662212 cites W1966678693 @default.
- W2573662212 cites W1975237594 @default.
- W2573662212 cites W1979539191 @default.
- W2573662212 cites W2006956639 @default.
- W2573662212 cites W2038158594 @default.
- W2573662212 cites W2062951866 @default.
- W2573662212 cites W2082568609 @default.
- W2573662212 cites W2089180859 @default.
- W2573662212 cites W2092130184 @default.
- W2573662212 cites W2103179919 @default.
- W2573662212 cites W2110485445 @default.
- W2573662212 cites W2129810345 @default.
- W2573662212 cites W2144862731 @default.
- W2573662212 cites W2157962689 @default.
- W2573662212 cites W2275929617 @default.
- W2573662212 cites W2416573875 @default.
- W2573662212 cites W172640552 @default.
- W2573662212 cites W2304487633 @default.
- W2573662212 hasPublicationYear "2016" @default.
- W2573662212 type Work @default.
- W2573662212 sameAs 2573662212 @default.
- W2573662212 citedByCount "2" @default.
- W2573662212 countsByYear W25736622122019 @default.
- W2573662212 crossrefType "proceedings-article" @default.
- W2573662212 hasAuthorship W2573662212A5007928903 @default.
- W2573662212 hasAuthorship W2573662212A5055697003 @default.
- W2573662212 hasConcept C119857082 @default.
- W2573662212 hasConcept C121332964 @default.
- W2573662212 hasConcept C12713177 @default.
- W2573662212 hasConcept C134306372 @default.
- W2573662212 hasConcept C147168706 @default.
- W2573662212 hasConcept C154945302 @default.
- W2573662212 hasConcept C15744967 @default.
- W2573662212 hasConcept C162324750 @default.
- W2573662212 hasConcept C177148314 @default.
- W2573662212 hasConcept C187736073 @default.
- W2573662212 hasConcept C188147891 @default.
- W2573662212 hasConcept C24890656 @default.
- W2573662212 hasConcept C25343380 @default.
- W2573662212 hasConcept C2778355321 @default.
- W2573662212 hasConcept C2780451532 @default.
- W2573662212 hasConcept C33923547 @default.
- W2573662212 hasConcept C41008148 @default.
- W2573662212 hasConcept C50644808 @default.
- W2573662212 hasConcept C77088390 @default.
- W2573662212 hasConcept C8521452 @default.
- W2573662212 hasConceptScore W2573662212C119857082 @default.
- W2573662212 hasConceptScore W2573662212C121332964 @default.
- W2573662212 hasConceptScore W2573662212C12713177 @default.
- W2573662212 hasConceptScore W2573662212C134306372 @default.
- W2573662212 hasConceptScore W2573662212C147168706 @default.
- W2573662212 hasConceptScore W2573662212C154945302 @default.
- W2573662212 hasConceptScore W2573662212C15744967 @default.
- W2573662212 hasConceptScore W2573662212C162324750 @default.
- W2573662212 hasConceptScore W2573662212C177148314 @default.
- W2573662212 hasConceptScore W2573662212C187736073 @default.
- W2573662212 hasConceptScore W2573662212C188147891 @default.
- W2573662212 hasConceptScore W2573662212C24890656 @default.
- W2573662212 hasConceptScore W2573662212C25343380 @default.
- W2573662212 hasConceptScore W2573662212C2778355321 @default.
- W2573662212 hasConceptScore W2573662212C2780451532 @default.
- W2573662212 hasConceptScore W2573662212C33923547 @default.
- W2573662212 hasConceptScore W2573662212C41008148 @default.
- W2573662212 hasConceptScore W2573662212C50644808 @default.
- W2573662212 hasConceptScore W2573662212C77088390 @default.
- W2573662212 hasConceptScore W2573662212C8521452 @default.
- W2573662212 hasLocation W25736622121 @default.
- W2573662212 hasOpenAccess W2573662212 @default.
- W2573662212 hasPrimaryLocation W25736622121 @default.
- W2573662212 hasRelatedWork W1482764590 @default.
- W2573662212 hasRelatedWork W1486204617 @default.
- W2573662212 hasRelatedWork W1500232188 @default.
- W2573662212 hasRelatedWork W1517008622 @default.
- W2573662212 hasRelatedWork W2157760789 @default.
- W2573662212 hasRelatedWork W2486401005 @default.
- W2573662212 hasRelatedWork W2604859491 @default.
- W2573662212 hasRelatedWork W2753182048 @default.
- W2573662212 hasRelatedWork W2802739856 @default.
- W2573662212 hasRelatedWork W2805478747 @default.
- W2573662212 hasRelatedWork W2947583014 @default.
- W2573662212 hasRelatedWork W2950658018 @default.
- W2573662212 hasRelatedWork W2972869776 @default.
- W2573662212 hasRelatedWork W3048613764 @default.
- W2573662212 hasRelatedWork W3089335014 @default.
- W2573662212 hasRelatedWork W3097894168 @default.
- W2573662212 hasRelatedWork W3169876613 @default.
- W2573662212 hasRelatedWork W3178680873 @default.
- W2573662212 hasRelatedWork W90836896 @default.
- W2573662212 hasRelatedWork W2304487633 @default.
- W2573662212 isParatext "false" @default.
- W2573662212 isRetracted "false" @default.
- W2573662212 magId "2573662212" @default.