FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2070784404> ?p ?o ?g. }

• W2070784404 endingPage "4161" @default.
• W2070784404 startingPage "4146" @default.
• W2070784404 abstract "The statistical mechanics of two-layered perceptrons with N input units, K hidden units, and a single output unit that makes a decision based on a majority rule (Committee Machine) are studied. Two architectures are considered. In the nonoverlapping case the hidden units do not share common inputs. In the fully connected case each hidden unit is connected to the entire input layer. In both cases the network realizes a random dichotomy of P inputs. The statistical properties of the space of solutions as a function of P is studied, using the replica method, and by numerical simulations, in the regime where Nensuremath{gg}K. In the nonoverlapping architecture with continuously varying weights the capacity, defined as the maximal number of P per weight, (${mathrm{ensuremath{alpha}}}_{mathit{c}}$) is calculated under a replica-symmetric (RS) ansatz. At large K, ${mathrm{ensuremath{alpha}}}_{mathit{c}}$ diverges as ${mathit{K}}^{1/2}$ in contradiction with the rigorous upper bound, ${mathrm{ensuremath{alpha}}}_{mathit{c}}$C lnK, where C is a proportionality constant, derived by Mitchison and Durbin [Biol. Cybern. 60, 345 (1989)]. This suggests a strong replica-symmetry-breaking effect.The instability of the RS solution is shown to occur at a value of ensuremath{alpha} which remains finite in the large-K limit. A one-step replica-symmetry-breaking (RSB) ansatz is studied for K=3 and in the limit K goes to infinity. The results indicate that ${mathrm{ensuremath{alpha}}}_{mathit{c}}$(K) diverges with K, probably logarithmically. The occurrence of RSB far below the capacity limit is confirmed by comparison of the theoretical results with numerical simulations for K=3. This symmetry breaking implies that unlike the single-layer perceptron case, the space of solutions of the two-layer perceptron breaks, beyond a critical value of ensuremath{alpha}, into many disjoint subregions. The entropies of the connected subregions are almost degenerate, their relative difference being of order 1/N. In the case of a nonoverlapping Committee Machine with binary, i.e., ifmmodepmelsetextpmfi{}1 weights, ${mathrm{ensuremath{alpha}}}_{mathit{c}}$ensuremath{le}1 is an upper bound for all K. The RS theory predicts ${mathrm{ensuremath{alpha}}}_{mathit{c}}$=0.92 for K=3 and ${mathrm{ensuremath{alpha}}}_{mathit{c}}$=0.95 for the large-K limit.The theoretical prediction (for K=3) is in excellent agreement with the numerical estimate based on an exhaustive search in the space of solutions for small N. These results indicate that in the binary case there is no RSB in the space of solutions below the maximal capacity. In the fully connected architecture, the solution's phase space has a global permutation symmetry (PS) reflecting the invariance under permuting the hidden units. The order parameters that signal the spontaneous breaking of this symmetry are defined. The RS theory shows that for small ensuremath{alpha} the PS is maintained. For larger values of ensuremath{alpha}${mathrm{ensuremath{alpha}}}_{mathit{c}}$ the symmetry is broken, inplying the breaking of the solution space into disjoint regions. These regions are related by permutation symmetry, hence they are fully degenerate with respect to their entropies and statistical properties. This prediction has been tested by simulations of the K=3 case, calculating the order parameters by random walks in the space of solutions. They yield good evidence for existence of a phase with broken permutation symmetry at values of ensuremath{alpha}ensuremath{ge}2. Finally, both theory and simulations show that for a typical fully connected network the connections joining the same input to a pair of hidden units are negatively correlated." @default.
• W2070784404 created "2016-06-24" @default.
• W2070784404 creator A5004055821 @default.
• W2070784404 creator A5073266403 @default.
• W2070784404 creator A5075146702 @default.
• W2070784404 date "1992-03-01" @default.
• W2070784404 modified "2023-10-06" @default.
• W2070784404 title "Broken symmetries in multilayered perceptrons" @default.
• W2070784404 cites W2001570872 @default.
• W2070784404 cites W2002193713 @default.
• W2070784404 cites W2012903341 @default.
• W2070784404 cites W2013128153 @default.
• W2070784404 cites W2030450972 @default.
• W2070784404 cites W2031578644 @default.
• W2070784404 cites W2033606703 @default.
• W2070784404 cites W2044767119 @default.
• W2070784404 cites W2080531309 @default.
• W2070784404 cites W2083715726 @default.
• W2070784404 cites W2088522405 @default.
• W2070784404 cites W2161278885 @default.
• W2070784404 doi "https://doi.org/10.1103/physreva.45.4146" @default.
• W2070784404 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/9907466" @default.
• W2070784404 hasPublicationYear "1992" @default.
• W2070784404 type Work @default.
• W2070784404 sameAs 2070784404 @default.
• W2070784404 citedByCount "79" @default.
• W2070784404 countsByYear W20707844042013 @default.
• W2070784404 countsByYear W20707844042014 @default.
• W2070784404 countsByYear W20707844042019 @default.
• W2070784404 countsByYear W20707844042021 @default.
• W2070784404 countsByYear W20707844042022 @default.
• W2070784404 countsByYear W20707844042023 @default.
• W2070784404 crossrefType "journal-article" @default.
• W2070784404 hasAuthorship W2070784404A5004055821 @default.
• W2070784404 hasAuthorship W2070784404A5073266403 @default.
• W2070784404 hasAuthorship W2070784404A5075146702 @default.
• W2070784404 hasConcept C114614502 @default.
• W2070784404 hasConcept C119857082 @default.
• W2070784404 hasConcept C121332964 @default.
• W2070784404 hasConcept C122637931 @default.
• W2070784404 hasConcept C130979935 @default.
• W2070784404 hasConcept C145420912 @default.
• W2070784404 hasConcept C204795200 @default.
• W2070784404 hasConcept C2524010 @default.
• W2070784404 hasConcept C33923547 @default.
• W2070784404 hasConcept C37914503 @default.
• W2070784404 hasConcept C41008148 @default.
• W2070784404 hasConcept C50644808 @default.
• W2070784404 hasConcept C60908668 @default.
• W2070784404 hasConcept C62520636 @default.
• W2070784404 hasConcept C96469262 @default.
• W2070784404 hasConceptScore W2070784404C114614502 @default.
• W2070784404 hasConceptScore W2070784404C119857082 @default.
• W2070784404 hasConceptScore W2070784404C121332964 @default.
• W2070784404 hasConceptScore W2070784404C122637931 @default.
• W2070784404 hasConceptScore W2070784404C130979935 @default.
• W2070784404 hasConceptScore W2070784404C145420912 @default.
• W2070784404 hasConceptScore W2070784404C204795200 @default.
• W2070784404 hasConceptScore W2070784404C2524010 @default.
• W2070784404 hasConceptScore W2070784404C33923547 @default.
• W2070784404 hasConceptScore W2070784404C37914503 @default.
• W2070784404 hasConceptScore W2070784404C41008148 @default.
• W2070784404 hasConceptScore W2070784404C50644808 @default.
• W2070784404 hasConceptScore W2070784404C60908668 @default.
• W2070784404 hasConceptScore W2070784404C62520636 @default.
• W2070784404 hasConceptScore W2070784404C96469262 @default.
• W2070784404 hasIssue "6" @default.
• W2070784404 hasLocation W20707844041 @default.
• W2070784404 hasLocation W20707844042 @default.
• W2070784404 hasOpenAccess W2070784404 @default.
• W2070784404 hasPrimaryLocation W20707844041 @default.
• W2070784404 hasRelatedWork W1557098208 @default.
• W2070784404 hasRelatedWork W1976506325 @default.
• W2070784404 hasRelatedWork W2006096104 @default.
• W2070784404 hasRelatedWork W2012389174 @default.
• W2070784404 hasRelatedWork W2047557392 @default.
• W2070784404 hasRelatedWork W2081394998 @default.
• W2070784404 hasRelatedWork W2088214966 @default.
• W2070784404 hasRelatedWork W2119068144 @default.
• W2070784404 hasRelatedWork W2767645432 @default.
• W2070784404 hasRelatedWork W3102835096 @default.
• W2070784404 hasVolume "45" @default.
• W2070784404 isParatext "false" @default.
• W2070784404 isRetracted "false" @default.
• W2070784404 magId "2070784404" @default.
• W2070784404 workType "article" @default.