FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3081635055> ?p ?o ?g. }

• W3081635055 abstract "Efforts to improve the learning abilities of neural networks have focused mostly on the role of optimization methods rather than on weight initializations. Recent findings, however, suggest that neural networks rely on lucky random initial weights of subnetworks called tickets that converge quickly to a solution. To investigate how weight initializations affect performance, we examine small convolutional networks that are trained to predict n steps of the two-dimensional cellular automaton Conway's Game of Life, the update rules of which can be implemented efficiently in a 2n+1 layer convolutional network. We find that networks of this architecture trained on this task rarely converge. Rather, networks require substantially more parameters to consistently converge. In addition, near-minimal architectures are sensitive to tiny changes in parameters: changing the sign of a single weight can cause the network to fail to learn. Finally, we observe a critical value d_0 such that training minimal networks with examples in which cells are alive with probability d_0 dramatically increases the chance of convergence to a solution. We conclude that training convolutional neural networks to learn the input/output function represented by n steps of Game of Life exhibits many characteristics predicted by the lottery ticket hypothesis, namely, that the size of the networks required to learn this function are often significantly larger than the minimal network required to implement the function." @default.
• W3081635055 created "2020-09-08" @default.
• W3081635055 creator A5035773495 @default.
• W3081635055 creator A5086534835 @default.
• W3081635055 date "2020-09-03" @default.
• W3081635055 modified "2023-09-27" @default.
• W3081635055 title "It's Hard for Neural Networks To Learn the Game of Life" @default.
• W3081635055 cites W1522301498 @default.
• W3081635055 cites W1533861849 @default.
• W3081635055 cites W1732222442 @default.
• W3081635055 cites W1821462560 @default.
• W3081635055 cites W1899249567 @default.
• W3081635055 cites W1964298122 @default.
• W3081635055 cites W2057440314 @default.
• W3081635055 cites W2125318369 @default.
• W3081635055 cites W2125389748 @default.
• W3081635055 cites W2173051530 @default.
• W3081635055 cites W2178237821 @default.
• W3081635055 cites W2515385951 @default.
• W3081635055 cites W2788800397 @default.
• W3081635055 cites W2799217725 @default.
• W3081635055 cites W2805003733 @default.
• W3081635055 cites W2807299122 @default.
• W3081635055 cites W2887020936 @default.
• W3081635055 cites W2908206262 @default.
• W3081635055 cites W2943283198 @default.
• W3081635055 cites W2950527759 @default.
• W3081635055 cites W2954097612 @default.
• W3081635055 cites W2962698540 @default.
• W3081635055 cites W2963427613 @default.
• W3081635055 cites W2963446085 @default.
• W3081635055 cites W2963477238 @default.
• W3081635055 cites W2963674932 @default.
• W3081635055 cites W2963833878 @default.
• W3081635055 cites W2970674435 @default.
• W3081635055 cites W3021189130 @default.
• W3081635055 cites W3195905567 @default.
• W3081635055 hasPublicationYear "2020" @default.
• W3081635055 type Work @default.
• W3081635055 sameAs 3081635055 @default.
• W3081635055 citedByCount "2" @default.
• W3081635055 countsByYear W30816350552021 @default.
• W3081635055 crossrefType "posted-content" @default.
• W3081635055 hasAuthorship W3081635055A5035773495 @default.
• W3081635055 hasAuthorship W3081635055A5086534835 @default.
• W3081635055 hasConcept C105795698 @default.
• W3081635055 hasConcept C112505250 @default.
• W3081635055 hasConcept C119857082 @default.
• W3081635055 hasConcept C134306372 @default.
• W3081635055 hasConcept C139676723 @default.
• W3081635055 hasConcept C14036430 @default.
• W3081635055 hasConcept C154945302 @default.
• W3081635055 hasConcept C162324750 @default.
• W3081635055 hasConcept C2776291640 @default.
• W3081635055 hasConcept C2776807809 @default.
• W3081635055 hasConcept C2777303404 @default.
• W3081635055 hasConcept C2777340749 @default.
• W3081635055 hasConcept C33923547 @default.
• W3081635055 hasConcept C35527583 @default.
• W3081635055 hasConcept C38365724 @default.
• W3081635055 hasConcept C41008148 @default.
• W3081635055 hasConcept C50522688 @default.
• W3081635055 hasConcept C50644808 @default.
• W3081635055 hasConcept C78458016 @default.
• W3081635055 hasConcept C81363708 @default.
• W3081635055 hasConcept C86803240 @default.
• W3081635055 hasConceptScore W3081635055C105795698 @default.
• W3081635055 hasConceptScore W3081635055C112505250 @default.
• W3081635055 hasConceptScore W3081635055C119857082 @default.
• W3081635055 hasConceptScore W3081635055C134306372 @default.
• W3081635055 hasConceptScore W3081635055C139676723 @default.
• W3081635055 hasConceptScore W3081635055C14036430 @default.
• W3081635055 hasConceptScore W3081635055C154945302 @default.
• W3081635055 hasConceptScore W3081635055C162324750 @default.
• W3081635055 hasConceptScore W3081635055C2776291640 @default.
• W3081635055 hasConceptScore W3081635055C2776807809 @default.
• W3081635055 hasConceptScore W3081635055C2777303404 @default.
• W3081635055 hasConceptScore W3081635055C2777340749 @default.
• W3081635055 hasConceptScore W3081635055C33923547 @default.
• W3081635055 hasConceptScore W3081635055C35527583 @default.
• W3081635055 hasConceptScore W3081635055C38365724 @default.
• W3081635055 hasConceptScore W3081635055C41008148 @default.
• W3081635055 hasConceptScore W3081635055C50522688 @default.
• W3081635055 hasConceptScore W3081635055C50644808 @default.
• W3081635055 hasConceptScore W3081635055C78458016 @default.
• W3081635055 hasConceptScore W3081635055C81363708 @default.
• W3081635055 hasConceptScore W3081635055C86803240 @default.
• W3081635055 hasLocation W30816350551 @default.
• W3081635055 hasOpenAccess W3081635055 @default.
• W3081635055 hasPrimaryLocation W30816350551 @default.
• W3081635055 hasRelatedWork W1883940464 @default.
• W3081635055 hasRelatedWork W2117933835 @default.
• W3081635055 hasRelatedWork W2134264591 @default.
• W3081635055 hasRelatedWork W2147368400 @default.
• W3081635055 hasRelatedWork W2156938623 @default.
• W3081635055 hasRelatedWork W2182969463 @default.
• W3081635055 hasRelatedWork W2778480222 @default.
• W3081635055 hasRelatedWork W2786262858 @default.
• W3081635055 hasRelatedWork W2786465559 @default.
• W3081635055 hasRelatedWork W2792760996 @default.

• next