Matches in SemOpenAlex for { <https://semopenalex.org/work/W2541674938> ?p ?o ?g. }
Showing items 1 to 82 of
82
with 100 items per page.
- W2541674938 abstract "In this work we propose a novel interpretation of residual networks showing that they can be seen as a collection of many paths of differing length. Moreover, residual networks seem to enable very deep networks by leveraging only the short paths during training. To support this observation, we rewrite residual networks as an explicit collection of paths. Unlike traditional models, paths through residual networks vary in length. Further, a lesion study reveals that these paths show ensemble-like behavior in the sense that they do not strongly depend on each other. Finally, and most surprising, most paths are shorter than one might expect, and only the short paths are needed during training, as longer paths do not contribute any gradient. For example, most of the gradient in a residual network with 110 layers comes from paths that are only 10-34 layers deep. Our results reveal one of the key characteristics that seem to enable the training of very deep networks: Residual networks avoid the vanishing gradient problem by introducing short paths which can carry gradient throughout the extent of very deep networks." @default.
- W2541674938 created "2016-11-04" @default.
- W2541674938 creator A5018609918 @default.
- W2541674938 creator A5026971189 @default.
- W2541674938 creator A5081627147 @default.
- W2541674938 date "2016-05-20" @default.
- W2541674938 modified "2023-09-27" @default.
- W2541674938 title "Residual Networks Behave Like Ensembles of Relatively Shallow Networks" @default.
- W2541674938 cites W1686810756 @default.
- W2541674938 cites W1849277567 @default.
- W2541674938 cites W1904365287 @default.
- W2541674938 cites W2093717447 @default.
- W2541674938 cites W2101926813 @default.
- W2541674938 cites W2108598243 @default.
- W2541674938 cites W2112796928 @default.
- W2541674938 cites W2115738369 @default.
- W2541674938 cites W2116360511 @default.
- W2541674938 cites W2132172482 @default.
- W2541674938 cites W2194775991 @default.
- W2541674938 cites W2949117887 @default.
- W2541674938 cites W2949427019 @default.
- W2541674938 cites W2949892913 @default.
- W2541674938 cites W2964153729 @default.
- W2541674938 cites W3118608800 @default.
- W2541674938 cites W194249466 @default.
- W2541674938 hasPublicationYear "2016" @default.
- W2541674938 type Work @default.
- W2541674938 sameAs 2541674938 @default.
- W2541674938 citedByCount "87" @default.
- W2541674938 countsByYear W25416749382016 @default.
- W2541674938 countsByYear W25416749382017 @default.
- W2541674938 countsByYear W25416749382018 @default.
- W2541674938 countsByYear W25416749382019 @default.
- W2541674938 countsByYear W25416749382020 @default.
- W2541674938 countsByYear W25416749382021 @default.
- W2541674938 crossrefType "posted-content" @default.
- W2541674938 hasAuthorship W2541674938A5018609918 @default.
- W2541674938 hasAuthorship W2541674938A5026971189 @default.
- W2541674938 hasAuthorship W2541674938A5081627147 @default.
- W2541674938 hasConcept C11413529 @default.
- W2541674938 hasConcept C154945302 @default.
- W2541674938 hasConcept C155512373 @default.
- W2541674938 hasConcept C199360897 @default.
- W2541674938 hasConcept C26517878 @default.
- W2541674938 hasConcept C38652104 @default.
- W2541674938 hasConcept C41008148 @default.
- W2541674938 hasConcept C527412718 @default.
- W2541674938 hasConceptScore W2541674938C11413529 @default.
- W2541674938 hasConceptScore W2541674938C154945302 @default.
- W2541674938 hasConceptScore W2541674938C155512373 @default.
- W2541674938 hasConceptScore W2541674938C199360897 @default.
- W2541674938 hasConceptScore W2541674938C26517878 @default.
- W2541674938 hasConceptScore W2541674938C38652104 @default.
- W2541674938 hasConceptScore W2541674938C41008148 @default.
- W2541674938 hasConceptScore W2541674938C527412718 @default.
- W2541674938 hasLocation W25416749381 @default.
- W2541674938 hasOpenAccess W2541674938 @default.
- W2541674938 hasPrimaryLocation W25416749381 @default.
- W2541674938 hasRelatedWork W1522301498 @default.
- W2541674938 hasRelatedWork W1677182931 @default.
- W2541674938 hasRelatedWork W1686810756 @default.
- W2541674938 hasRelatedWork W1901129140 @default.
- W2541674938 hasRelatedWork W1903029394 @default.
- W2541674938 hasRelatedWork W2095705004 @default.
- W2541674938 hasRelatedWork W2097117768 @default.
- W2541674938 hasRelatedWork W2108598243 @default.
- W2541674938 hasRelatedWork W2117539524 @default.
- W2541674938 hasRelatedWork W2163605009 @default.
- W2541674938 hasRelatedWork W2194775991 @default.
- W2541674938 hasRelatedWork W2274287116 @default.
- W2541674938 hasRelatedWork W2302255633 @default.
- W2541674938 hasRelatedWork W2401231614 @default.
- W2541674938 hasRelatedWork W2919115771 @default.
- W2541674938 hasRelatedWork W2949117887 @default.
- W2541674938 hasRelatedWork W2949892913 @default.
- W2541674938 hasRelatedWork W2963410064 @default.
- W2541674938 hasRelatedWork W2963446712 @default.
- W2541674938 hasRelatedWork W3118608800 @default.
- W2541674938 isParatext "false" @default.
- W2541674938 isRetracted "false" @default.
- W2541674938 magId "2541674938" @default.
- W2541674938 workType "article" @default.