Matches in SemOpenAlex for { <https://semopenalex.org/work/W2897025488> ?p ?o ?g. }
- W2897025488 abstract "The bias-variance tradeoff tells us that as model complexity increases, bias falls and variances increases, leading to a U-shaped test error curve. However, recent empirical results with over-parameterized neural networks are marked by a striking absence of the classic U-shaped test error curve: test error keeps decreasing in wider networks. This suggests that there might not be a bias-variance tradeoff in neural networks with respect to network width, unlike was originally claimed by, e.g., Geman et al. (1992). Motivated by the shaky evidence used to support this claim in neural networks, we measure bias and variance in the modern setting. We find that both bias and variance can decrease as the number of parameters grows. To better understand this, we introduce a new decomposition of the variance to disentangle the effects of optimization and data sampling. We also provide theoretical analysis in a simplified setting that is consistent with our empirical findings." @default.
- W2897025488 created "2018-10-26" @default.
- W2897025488 creator A5017575759 @default.
- W2897025488 creator A5017587027 @default.
- W2897025488 creator A5020059055 @default.
- W2897025488 creator A5051076050 @default.
- W2897025488 creator A5064841098 @default.
- W2897025488 creator A5074049737 @default.
- W2897025488 creator A5088076429 @default.
- W2897025488 date "2018-10-19" @default.
- W2897025488 modified "2023-09-27" @default.
- W2897025488 title "A Modern Take on the Bias-Variance Tradeoff in Neural Networks" @default.
- W2897025488 cites W1480376833 @default.
- W2897025488 cites W1492815834 @default.
- W2897025488 cites W1506806321 @default.
- W2897025488 cites W1516193414 @default.
- W2897025488 cites W1521062204 @default.
- W2897025488 cites W1537662695 @default.
- W2897025488 cites W1554944419 @default.
- W2897025488 cites W1573820523 @default.
- W2897025488 cites W1608401492 @default.
- W2897025488 cites W1992774725 @default.
- W2897025488 cites W2032210760 @default.
- W2897025488 cites W2076118331 @default.
- W2897025488 cites W2088883866 @default.
- W2897025488 cites W2093717447 @default.
- W2897025488 cites W2107878631 @default.
- W2897025488 cites W2117897510 @default.
- W2897025488 cites W2125930537 @default.
- W2897025488 cites W2139338362 @default.
- W2897025488 cites W2149298154 @default.
- W2897025488 cites W2166163519 @default.
- W2897025488 cites W2194775991 @default.
- W2897025488 cites W2281477230 @default.
- W2897025488 cites W2419597278 @default.
- W2897025488 cites W2604451472 @default.
- W2897025488 cites W2626325961 @default.
- W2897025488 cites W2739160792 @default.
- W2897025488 cites W2752860283 @default.
- W2897025488 cites W2753358588 @default.
- W2897025488 cites W2763894180 @default.
- W2897025488 cites W2768267830 @default.
- W2897025488 cites W2777662428 @default.
- W2897025488 cites W2783557135 @default.
- W2897025488 cites W2788800397 @default.
- W2897025488 cites W2894604724 @default.
- W2897025488 cites W2904243021 @default.
- W2897025488 cites W2907047316 @default.
- W2897025488 cites W2912260645 @default.
- W2897025488 cites W2923764619 @default.
- W2897025488 cites W2949117887 @default.
- W2897025488 cites W2962804662 @default.
- W2897025488 cites W2962930448 @default.
- W2897025488 cites W2963096987 @default.
- W2897025488 cites W2963100491 @default.
- W2897025488 cites W2963477238 @default.
- W2897025488 cites W2963518130 @default.
- W2897025488 cites W2963695615 @default.
- W2897025488 cites W2963702144 @default.
- W2897025488 cites W2963959597 @default.
- W2897025488 cites W2964052793 @default.
- W2897025488 cites W2964084001 @default.
- W2897025488 cites W2964137095 @default.
- W2897025488 cites W2964313743 @default.
- W2897025488 cites W3137695714 @default.
- W2897025488 cites W194249466 @default.
- W2897025488 hasPublicationYear "2018" @default.
- W2897025488 type Work @default.
- W2897025488 sameAs 2897025488 @default.
- W2897025488 citedByCount "42" @default.
- W2897025488 countsByYear W28970254882018 @default.
- W2897025488 countsByYear W28970254882019 @default.
- W2897025488 countsByYear W28970254882020 @default.
- W2897025488 countsByYear W28970254882021 @default.
- W2897025488 crossrefType "posted-content" @default.
- W2897025488 hasAuthorship W2897025488A5017575759 @default.
- W2897025488 hasAuthorship W2897025488A5017587027 @default.
- W2897025488 hasAuthorship W2897025488A5020059055 @default.
- W2897025488 hasAuthorship W2897025488A5051076050 @default.
- W2897025488 hasAuthorship W2897025488A5064841098 @default.
- W2897025488 hasAuthorship W2897025488A5074049737 @default.
- W2897025488 hasAuthorship W2897025488A5088076429 @default.
- W2897025488 hasConcept C105795698 @default.
- W2897025488 hasConcept C11413529 @default.
- W2897025488 hasConcept C121955636 @default.
- W2897025488 hasConcept C124101348 @default.
- W2897025488 hasConcept C149782125 @default.
- W2897025488 hasConcept C154945302 @default.
- W2897025488 hasConcept C162324750 @default.
- W2897025488 hasConcept C165464430 @default.
- W2897025488 hasConcept C196083921 @default.
- W2897025488 hasConcept C2780009758 @default.
- W2897025488 hasConcept C2984842247 @default.
- W2897025488 hasConcept C33923547 @default.
- W2897025488 hasConcept C41008148 @default.
- W2897025488 hasConcept C50644808 @default.
- W2897025488 hasConcept C89715816 @default.
- W2897025488 hasConceptScore W2897025488C105795698 @default.
- W2897025488 hasConceptScore W2897025488C11413529 @default.
- W2897025488 hasConceptScore W2897025488C121955636 @default.