Matches in SemOpenAlex for { <https://semopenalex.org/work/W2109802279> ?p ?o ?g. }
- W2109802279 abstract "We propose a theory that relates difficulty of learning in deep architectures to culture and language. It is articulated around the following hypotheses: (1) learning in an individual human brain is hampered by the presence of effective local minima; (2) this optimization difficulty is particularly important when it comes to learning higher-level abstractions, i.e., concepts that cover a vast and highly-nonlinear span of sensory configurations; (3) such high-level abstractions are best represented in brains by the composition of many levels of representation, i.e., by deep architectures; (4) a human brain can learn such high-level abstractions if guided by the signals produced by other humans, which act as hints or indirect supervision for these high-level abstractions; and (5), language and the recombination and optimization of mental concepts provide an efficient evolutionary recombination operator, and this gives rise to rapid search in the space of communicable ideas that help humans build up better high-level internal representations of their world. These hypotheses put together imply that human culture and the evolution of ideas have been crucial to counter an optimization difficulty: this optimization difficulty would otherwise make it very difficult for human brains to capture high-level knowledge of the world. The theory is grounded in experimental observations of the difficulties of training deep artificial neural networks. Plausible consequences of this theory for the efficiency of cultural evolutions are sketched." @default.
- W2109802279 created "2016-06-24" @default.
- W2109802279 creator A5086198262 @default.
- W2109802279 date "2012-03-14" @default.
- W2109802279 modified "2023-09-27" @default.
- W2109802279 title "Evolving Culture vs Local Minima" @default.
- W2109802279 cites W145476170 @default.
- W2109802279 cites W1497256448 @default.
- W2109802279 cites W1536929369 @default.
- W2109802279 cites W1605995731 @default.
- W2109802279 cites W177847060 @default.
- W2109802279 cites W181520010 @default.
- W2109802279 cites W189596042 @default.
- W2109802279 cites W196761320 @default.
- W2109802279 cites W1977263277 @default.
- W2109802279 cites W1980139700 @default.
- W2109802279 cites W2001141328 @default.
- W2109802279 cites W2007347635 @default.
- W2109802279 cites W2042492924 @default.
- W2109802279 cites W2045924252 @default.
- W2109802279 cites W2072128103 @default.
- W2109802279 cites W2087311458 @default.
- W2109802279 cites W2100495367 @default.
- W2109802279 cites W2106004777 @default.
- W2109802279 cites W2107008379 @default.
- W2109802279 cites W2107998050 @default.
- W2109802279 cites W2110361616 @default.
- W2109802279 cites W2110798204 @default.
- W2109802279 cites W2121863487 @default.
- W2109802279 cites W2122922389 @default.
- W2109802279 cites W2130325614 @default.
- W2109802279 cites W2136922672 @default.
- W2109802279 cites W2138857742 @default.
- W2109802279 cites W2140833774 @default.
- W2109802279 cites W2148603752 @default.
- W2109802279 cites W2151834591 @default.
- W2109802279 cites W2159291644 @default.
- W2109802279 cites W2165293955 @default.
- W2109802279 cites W2166493072 @default.
- W2109802279 cites W2172174689 @default.
- W2109802279 cites W2187089797 @default.
- W2109802279 cites W2296073425 @default.
- W2109802279 cites W2546302380 @default.
- W2109802279 cites W2584401907 @default.
- W2109802279 cites W2613634265 @default.
- W2109802279 cites W2624262714 @default.
- W2109802279 cites W2726772824 @default.
- W2109802279 cites W3022436500 @default.
- W2109802279 cites W3047029470 @default.
- W2109802279 cites W3207342693 @default.
- W2109802279 cites W66838807 @default.
- W2109802279 hasPublicationYear "2012" @default.
- W2109802279 type Work @default.
- W2109802279 sameAs 2109802279 @default.
- W2109802279 citedByCount "13" @default.
- W2109802279 countsByYear W21098022792013 @default.
- W2109802279 countsByYear W21098022792016 @default.
- W2109802279 countsByYear W21098022792017 @default.
- W2109802279 countsByYear W21098022792019 @default.
- W2109802279 countsByYear W21098022792020 @default.
- W2109802279 countsByYear W21098022792021 @default.
- W2109802279 crossrefType "posted-content" @default.
- W2109802279 hasAuthorship W2109802279A5086198262 @default.
- W2109802279 hasConcept C108583219 @default.
- W2109802279 hasConcept C111919701 @default.
- W2109802279 hasConcept C134306372 @default.
- W2109802279 hasConcept C154945302 @default.
- W2109802279 hasConcept C15744967 @default.
- W2109802279 hasConcept C17744445 @default.
- W2109802279 hasConcept C186633575 @default.
- W2109802279 hasConcept C188147891 @default.
- W2109802279 hasConcept C199539241 @default.
- W2109802279 hasConcept C2776359362 @default.
- W2109802279 hasConcept C2778572836 @default.
- W2109802279 hasConcept C33923547 @default.
- W2109802279 hasConcept C41008148 @default.
- W2109802279 hasConcept C50644808 @default.
- W2109802279 hasConcept C80444323 @default.
- W2109802279 hasConcept C94625758 @default.
- W2109802279 hasConceptScore W2109802279C108583219 @default.
- W2109802279 hasConceptScore W2109802279C111919701 @default.
- W2109802279 hasConceptScore W2109802279C134306372 @default.
- W2109802279 hasConceptScore W2109802279C154945302 @default.
- W2109802279 hasConceptScore W2109802279C15744967 @default.
- W2109802279 hasConceptScore W2109802279C17744445 @default.
- W2109802279 hasConceptScore W2109802279C186633575 @default.
- W2109802279 hasConceptScore W2109802279C188147891 @default.
- W2109802279 hasConceptScore W2109802279C199539241 @default.
- W2109802279 hasConceptScore W2109802279C2776359362 @default.
- W2109802279 hasConceptScore W2109802279C2778572836 @default.
- W2109802279 hasConceptScore W2109802279C33923547 @default.
- W2109802279 hasConceptScore W2109802279C41008148 @default.
- W2109802279 hasConceptScore W2109802279C50644808 @default.
- W2109802279 hasConceptScore W2109802279C80444323 @default.
- W2109802279 hasConceptScore W2109802279C94625758 @default.
- W2109802279 hasLocation W21098022791 @default.
- W2109802279 hasOpenAccess W2109802279 @default.
- W2109802279 hasPrimaryLocation W21098022791 @default.
- W2109802279 hasRelatedWork W1533861849 @default.
- W2109802279 hasRelatedWork W189596042 @default.