FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3176543443> ?p ?o ?g. }

• W3176543443 abstract "Studying neural network loss landscapes provides insights into the nature of the underlying optimization problems. Unfortunately, loss landscapes are notoriously difficult to visualize in a human-comprehensible fashion. One common way to address this problem is to plot linear slices of the landscape, for example from the initial state of the network to the final state after optimization. On the basis of this analysis, prior work has drawn broader conclusions about the difficulty of the optimization problem. In this paper, we put inferences of this kind to the test, systematically evaluating how linear interpolation and final performance vary when altering the data, choice of initialization, and other optimizer and architecture design choices. Further, we use linear interpolation to study the role played by individual layers and substructures of the network. We find that certain layers are more sensitive to the choice of initialization and optimizer hyperparameter settings, and we exploit these observations to design custom optimization schemes. However, our results cast doubt on the broader intuition that the presence or absence of barriers when interpolating necessarily relates to the success of optimization." @default.
• W3176543443 created "2021-07-05" @default.
• W3176543443 creator A5068323517 @default.
• W3176543443 creator A5078716102 @default.
• W3176543443 date "2021-06-30" @default.
• W3176543443 modified "2023-09-27" @default.
• W3176543443 title "What can linear interpolation of neural network loss landscapes tell us" @default.
• W3176543443 cites W2194775991 @default.
• W3176543443 cites W2294059674 @default.
• W3176543443 cites W2401231614 @default.
• W3176543443 cites W2757910899 @default.
• W3176543443 cites W2768267830 @default.
• W3176543443 cites W2793333878 @default.
• W3176543443 cites W2899771611 @default.
• W3176543443 cites W2903697572 @default.
• W3176543443 cites W2913190747 @default.
• W3176543443 cites W2950179405 @default.
• W3176543443 cites W2951696358 @default.
• W3176543443 cites W2963341956 @default.
• W3176543443 cites W2963384892 @default.
• W3176543443 cites W2963477238 @default.
• W3176543443 cites W2963959597 @default.
• W3176543443 cites W2964160102 @default.
• W3176543443 cites W2965373594 @default.
• W3176543443 cites W2970249264 @default.
• W3176543443 cites W2971033911 @default.
• W3176543443 cites W2992525328 @default.
• W3176543443 cites W2995343314 @default.
• W3176543443 cites W2995435108 @default.
• W3176543443 cites W2996056314 @default.
• W3176543443 cites W2996642285 @default.
• W3176543443 cites W3103375947 @default.
• W3176543443 cites W3111396641 @default.
• W3176543443 cites W3118608800 @default.
• W3176543443 cites W3172058676 @default.
• W3176543443 hasPublicationYear "2021" @default.
• W3176543443 type Work @default.
• W3176543443 sameAs 3176543443 @default.
• W3176543443 citedByCount "0" @default.
• W3176543443 crossrefType "posted-content" @default.
• W3176543443 hasAuthorship W3176543443A5068323517 @default.
• W3176543443 hasAuthorship W3176543443A5078716102 @default.
• W3176543443 hasConcept C104114177 @default.
• W3176543443 hasConcept C111472728 @default.
• W3176543443 hasConcept C114466953 @default.
• W3176543443 hasConcept C119857082 @default.
• W3176543443 hasConcept C126255220 @default.
• W3176543443 hasConcept C132010649 @default.
• W3176543443 hasConcept C137800194 @default.
• W3176543443 hasConcept C138885662 @default.
• W3176543443 hasConcept C153180895 @default.
• W3176543443 hasConcept C154945302 @default.
• W3176543443 hasConcept C165696696 @default.
• W3176543443 hasConcept C171836373 @default.
• W3176543443 hasConcept C199360897 @default.
• W3176543443 hasConcept C33923547 @default.
• W3176543443 hasConcept C38652104 @default.
• W3176543443 hasConcept C41008148 @default.
• W3176543443 hasConcept C8642999 @default.
• W3176543443 hasConceptScore W3176543443C104114177 @default.
• W3176543443 hasConceptScore W3176543443C111472728 @default.
• W3176543443 hasConceptScore W3176543443C114466953 @default.
• W3176543443 hasConceptScore W3176543443C119857082 @default.
• W3176543443 hasConceptScore W3176543443C126255220 @default.
• W3176543443 hasConceptScore W3176543443C132010649 @default.
• W3176543443 hasConceptScore W3176543443C137800194 @default.
• W3176543443 hasConceptScore W3176543443C138885662 @default.
• W3176543443 hasConceptScore W3176543443C153180895 @default.
• W3176543443 hasConceptScore W3176543443C154945302 @default.
• W3176543443 hasConceptScore W3176543443C165696696 @default.
• W3176543443 hasConceptScore W3176543443C171836373 @default.
• W3176543443 hasConceptScore W3176543443C199360897 @default.
• W3176543443 hasConceptScore W3176543443C33923547 @default.
• W3176543443 hasConceptScore W3176543443C38652104 @default.
• W3176543443 hasConceptScore W3176543443C41008148 @default.
• W3176543443 hasConceptScore W3176543443C8642999 @default.
• W3176543443 hasLocation W31765434431 @default.
• W3176543443 hasOpenAccess W3176543443 @default.
• W3176543443 hasPrimaryLocation W31765434431 @default.
• W3176543443 hasRelatedWork W100376849 @default.
• W3176543443 hasRelatedWork W1533869576 @default.
• W3176543443 hasRelatedWork W156098718 @default.
• W3176543443 hasRelatedWork W1606273899 @default.
• W3176543443 hasRelatedWork W1803592988 @default.
• W3176543443 hasRelatedWork W203646419 @default.
• W3176543443 hasRelatedWork W2061385089 @default.
• W3176543443 hasRelatedWork W2550223322 @default.
• W3176543443 hasRelatedWork W2557117065 @default.
• W3176543443 hasRelatedWork W2608642409 @default.
• W3176543443 hasRelatedWork W2794111629 @default.
• W3176543443 hasRelatedWork W2939745571 @default.
• W3176543443 hasRelatedWork W3100115376 @default.
• W3176543443 hasRelatedWork W3106325613 @default.
• W3176543443 hasRelatedWork W3112261185 @default.
• W3176543443 hasRelatedWork W3124251198 @default.
• W3176543443 hasRelatedWork W3204581629 @default.
• W3176543443 hasRelatedWork W3212538018 @default.
• W3176543443 hasRelatedWork W637379431 @default.
• W3176543443 hasRelatedWork W99756603 @default.
• W3176543443 isParatext "false" @default.

• next