Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226184463> ?p ?o ?g. }
Showing items 1 to 48 of
48
with 100 items per page.
- W4226184463 abstract "The existence of a universal learning architecture in human cognition is a widely spread conjecture supported by experimental findings from neuroscience. While no low-level implementation can be specified yet, an abstract outline of human perception and learning is believed to entail three basic properties: (a) hierarchical attention and processing, (b) memory-based knowledge representation, and (c) progressive learning and knowledge compaction. We approach the design of such a learning architecture from a system-theoretic viewpoint, developing a closed-loop system with three main components: (i) a multi-resolution analysis pre-processor, (ii) a group-invariant feature extractor, and (iii) a progressive knowledge-based learning module. Multi-resolution feedback loops are used for learning, i.e., for adapting the system parameters to online observations. To design (i) and (ii), we build upon the established theory of wavelet-based multi-resolution analysis and the properties of group convolution operators. Regarding (iii), we introduce a novel learning algorithm that constructs progressively growing knowledge representations in multiple resolutions. The proposed algorithm is an extension of the Online Deterministic Annealing (ODA) algorithm based on annealing optimization, solved using gradient-free stochastic approximation. ODA has inherent robustness and regularization properties and provides a means to progressively increase the complexity of the learning model i.e. the number of the neurons, as needed, through an intuitive bifurcation phenomenon. The proposed multi-resolution approach is hierarchical, progressive, knowledge-based, and interpretable. We illustrate the properties of the proposed architecture in the context of the state-of-the-art learning algorithms and deep learning methods." @default.
- W4226184463 created "2022-05-05" @default.
- W4226184463 creator A5014738965 @default.
- W4226184463 creator A5044395526 @default.
- W4226184463 date "2021-12-04" @default.
- W4226184463 modified "2023-09-24" @default.
- W4226184463 title "Towards the One Learning Algorithm Hypothesis: A System-theoretic Approach" @default.
- W4226184463 hasPublicationYear "2021" @default.
- W4226184463 type Work @default.
- W4226184463 citedByCount "0" @default.
- W4226184463 crossrefType "posted-content" @default.
- W4226184463 hasAuthorship W4226184463A5014738965 @default.
- W4226184463 hasAuthorship W4226184463A5044395526 @default.
- W4226184463 hasBestOaLocation W42261844631 @default.
- W4226184463 hasConcept C11413529 @default.
- W4226184463 hasConcept C119857082 @default.
- W4226184463 hasConcept C154945302 @default.
- W4226184463 hasConcept C24138899 @default.
- W4226184463 hasConcept C41008148 @default.
- W4226184463 hasConcept C50292564 @default.
- W4226184463 hasConcept C58973888 @default.
- W4226184463 hasConcept C8038995 @default.
- W4226184463 hasConcept C80444323 @default.
- W4226184463 hasConceptScore W4226184463C11413529 @default.
- W4226184463 hasConceptScore W4226184463C119857082 @default.
- W4226184463 hasConceptScore W4226184463C154945302 @default.
- W4226184463 hasConceptScore W4226184463C24138899 @default.
- W4226184463 hasConceptScore W4226184463C41008148 @default.
- W4226184463 hasConceptScore W4226184463C50292564 @default.
- W4226184463 hasConceptScore W4226184463C58973888 @default.
- W4226184463 hasConceptScore W4226184463C8038995 @default.
- W4226184463 hasConceptScore W4226184463C80444323 @default.
- W4226184463 hasLocation W42261844631 @default.
- W4226184463 hasOpenAccess W4226184463 @default.
- W4226184463 hasPrimaryLocation W42261844631 @default.
- W4226184463 hasRelatedWork W1160799 @default.
- W4226184463 hasRelatedWork W12405408 @default.
- W4226184463 hasRelatedWork W14146387 @default.
- W4226184463 hasRelatedWork W14632104 @default.
- W4226184463 hasRelatedWork W1472067 @default.
- W4226184463 hasRelatedWork W15635813 @default.
- W4226184463 hasRelatedWork W302949 @default.
- W4226184463 hasRelatedWork W3555825 @default.
- W4226184463 hasRelatedWork W4828744 @default.
- W4226184463 hasRelatedWork W5331339 @default.
- W4226184463 isParatext "false" @default.
- W4226184463 isRetracted "false" @default.
- W4226184463 workType "article" @default.