FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3037367037> ?p ?o ?g. }

• W3037367037 abstract "We show that the mutual information between the representation of a learning machine and the hidden features that it extracts from data is bounded from below by the relevance, which is the entropy of the model's energy distribution. Models with maximal relevance -- that we call Optimal Learning Machines (OLM) -- are hence expected to extract maximally informative representations. We explore this principle in a range of models. For fully connected Ising models and we show that {em i)} OLM are characterised by inhomogeneous distributions of couplings, and that {em ii)} their learning performance is affected by sub-extensive features that are elusive to a thermodynamic treatment. On specific learning tasks, we find that likelihood maximisation is achieved by models with maximal relevance. Training of Restricted Boltzmann Machines on the MNIST benchmark shows that learning is associated with a broadening of the spectrum of energy levels and that the internal representation of the hidden layer approaches the maximal relevance that can be achieved in a finite dataset. Finally, we discuss a Gaussian learning machine that clarifies that learning hidden features is conceptually different from parameter estimation." @default.
• W3037367037 created "2020-07-02" @default.
• W3037367037 creator A5051471901 @default.
• W3037367037 creator A5056683833 @default.
• W3037367037 creator A5069239095 @default.
• W3037367037 date "2019-09-27" @default.
• W3037367037 modified "2023-09-27" @default.
• W3037367037 title "Maximal Relevance and Optimal Learning Machines" @default.
• W3037367037 cites W1965543169 @default.
• W3037367037 cites W2042492924 @default.
• W3037367037 cites W2066610273 @default.
• W3037367037 cites W2099111195 @default.
• W3037367037 cites W2112796928 @default.
• W3037367037 cites W2116825644 @default.
• W3037367037 cites W2123469175 @default.
• W3037367037 cites W2128084896 @default.
• W3037367037 cites W2128957129 @default.
• W3037367037 cites W2168175751 @default.
• W3037367037 cites W2169966170 @default.
• W3037367037 cites W2337702836 @default.
• W3037367037 cites W2490183153 @default.
• W3037367037 cites W2517648041 @default.
• W3037367037 cites W2556341799 @default.
• W3037367037 cites W2775241190 @default.
• W3037367037 cites W2789175323 @default.
• W3037367037 cites W2795932954 @default.
• W3037367037 cites W2963201159 @default.
• W3037367037 cites W2970115835 @default.
• W3037367037 cites W2970935073 @default.
• W3037367037 cites W2976768568 @default.
• W3037367037 cites W3029326706 @default.
• W3037367037 cites W3098232856 @default.
• W3037367037 cites W3105453593 @default.
• W3037367037 cites W3106017648 @default.
• W3037367037 cites W44815768 @default.
• W3037367037 doi "https://doi.org/10.48550/arxiv.1909.12792" @default.
• W3037367037 hasPublicationYear "2019" @default.
• W3037367037 type Work @default.
• W3037367037 sameAs 3037367037 @default.
• W3037367037 citedByCount "0" @default.
• W3037367037 crossrefType "posted-content" @default.
• W3037367037 hasAuthorship W3037367037A5051471901 @default.
• W3037367037 hasAuthorship W3037367037A5056683833 @default.
• W3037367037 hasAuthorship W3037367037A5069239095 @default.
• W3037367037 hasBestOaLocation W30373670371 @default.
• W3037367037 hasConcept C106301342 @default.
• W3037367037 hasConcept C108583219 @default.
• W3037367037 hasConcept C119857082 @default.
• W3037367037 hasConcept C121332964 @default.
• W3037367037 hasConcept C121864883 @default.
• W3037367037 hasConcept C13280743 @default.
• W3037367037 hasConcept C134306372 @default.
• W3037367037 hasConcept C152139883 @default.
• W3037367037 hasConcept C154945302 @default.
• W3037367037 hasConcept C158154518 @default.
• W3037367037 hasConcept C159985019 @default.
• W3037367037 hasConcept C163716315 @default.
• W3037367037 hasConcept C17744445 @default.
• W3037367037 hasConcept C185798385 @default.
• W3037367037 hasConcept C190502265 @default.
• W3037367037 hasConcept C192562407 @default.
• W3037367037 hasConcept C192576344 @default.
• W3037367037 hasConcept C199539241 @default.
• W3037367037 hasConcept C204323151 @default.
• W3037367037 hasConcept C205649164 @default.
• W3037367037 hasConcept C2776359362 @default.
• W3037367037 hasConcept C33923547 @default.
• W3037367037 hasConcept C34388435 @default.
• W3037367037 hasConcept C41008148 @default.
• W3037367037 hasConcept C51329190 @default.
• W3037367037 hasConcept C59404180 @default.
• W3037367037 hasConcept C62520636 @default.
• W3037367037 hasConcept C94625758 @default.
• W3037367037 hasConceptScore W3037367037C106301342 @default.
• W3037367037 hasConceptScore W3037367037C108583219 @default.
• W3037367037 hasConceptScore W3037367037C119857082 @default.
• W3037367037 hasConceptScore W3037367037C121332964 @default.
• W3037367037 hasConceptScore W3037367037C121864883 @default.
• W3037367037 hasConceptScore W3037367037C13280743 @default.
• W3037367037 hasConceptScore W3037367037C134306372 @default.
• W3037367037 hasConceptScore W3037367037C152139883 @default.
• W3037367037 hasConceptScore W3037367037C154945302 @default.
• W3037367037 hasConceptScore W3037367037C158154518 @default.
• W3037367037 hasConceptScore W3037367037C159985019 @default.
• W3037367037 hasConceptScore W3037367037C163716315 @default.
• W3037367037 hasConceptScore W3037367037C17744445 @default.
• W3037367037 hasConceptScore W3037367037C185798385 @default.
• W3037367037 hasConceptScore W3037367037C190502265 @default.
• W3037367037 hasConceptScore W3037367037C192562407 @default.
• W3037367037 hasConceptScore W3037367037C192576344 @default.
• W3037367037 hasConceptScore W3037367037C199539241 @default.
• W3037367037 hasConceptScore W3037367037C204323151 @default.
• W3037367037 hasConceptScore W3037367037C205649164 @default.
• W3037367037 hasConceptScore W3037367037C2776359362 @default.
• W3037367037 hasConceptScore W3037367037C33923547 @default.
• W3037367037 hasConceptScore W3037367037C34388435 @default.
• W3037367037 hasConceptScore W3037367037C41008148 @default.
• W3037367037 hasConceptScore W3037367037C51329190 @default.
• W3037367037 hasConceptScore W3037367037C59404180 @default.
• W3037367037 hasConceptScore W3037367037C62520636 @default.

• next