Matches in SemOpenAlex for { <https://semopenalex.org/work/W3094219710> ?p ?o ?g. }
- W3094219710 abstract "Hard parameter sharing for multi-task learning is widely used in empirical research despite the fact that its generalization properties have not been well established in many cases. This paper studies its generalization properties in a fundamental setting: How does hard parameter sharing work given multiple linear regression tasks? We develop new techniques and establish a number of new results in the high-dimensional setting, where the sample size and feature dimension increase at a fixed ratio. First, we show a sharp bias-variance decomposition of hard parameter sharing, given multiple tasks with the same features. Second, we characterize the asymptotic bias-variance limit for two tasks, even when they have arbitrarily different sample size ratios and covariate shifts. We also demonstrate that these limiting estimates for the empirical loss are incredibly accurate in moderate dimensions. Finally, we explain an intriguing phenomenon where increasing one task's sample size helps another task initially by reducing variance but hurts eventually due to increasing bias. This suggests progressively adding data for optimizing hard parameter sharing, and we validate its efficiency in text classification tasks." @default.
- W3094219710 created "2020-10-29" @default.
- W3094219710 creator A5033975637 @default.
- W3094219710 creator A5039677253 @default.
- W3094219710 creator A5070267604 @default.
- W3094219710 creator A5080010066 @default.
- W3094219710 creator A5080575294 @default.
- W3094219710 date "2020-10-22" @default.
- W3094219710 modified "2023-09-27" @default.
- W3094219710 title "Sharp Bias-variance Tradeoffs of Hard Parameter Sharing in High-dimensional Linear Regression." @default.
- W3094219710 cites W1973628105 @default.
- W3094219710 cites W2156267734 @default.
- W3094219710 cites W2156557681 @default.
- W3094219710 cites W2907380995 @default.
- W3094219710 hasPublicationYear "2020" @default.
- W3094219710 type Work @default.
- W3094219710 sameAs 3094219710 @default.
- W3094219710 citedByCount "2" @default.
- W3094219710 countsByYear W30942197102021 @default.
- W3094219710 crossrefType "posted-content" @default.
- W3094219710 hasAuthorship W3094219710A5033975637 @default.
- W3094219710 hasAuthorship W3094219710A5039677253 @default.
- W3094219710 hasAuthorship W3094219710A5070267604 @default.
- W3094219710 hasAuthorship W3094219710A5080010066 @default.
- W3094219710 hasAuthorship W3094219710A5080575294 @default.
- W3094219710 hasConcept C105795698 @default.
- W3094219710 hasConcept C119043178 @default.
- W3094219710 hasConcept C121955636 @default.
- W3094219710 hasConcept C129848803 @default.
- W3094219710 hasConcept C134306372 @default.
- W3094219710 hasConcept C144133560 @default.
- W3094219710 hasConcept C149782125 @default.
- W3094219710 hasConcept C151201525 @default.
- W3094219710 hasConcept C154945302 @default.
- W3094219710 hasConcept C162324750 @default.
- W3094219710 hasConcept C177148314 @default.
- W3094219710 hasConcept C185592680 @default.
- W3094219710 hasConcept C187736073 @default.
- W3094219710 hasConcept C196083921 @default.
- W3094219710 hasConcept C198531522 @default.
- W3094219710 hasConcept C202444582 @default.
- W3094219710 hasConcept C2776502983 @default.
- W3094219710 hasConcept C2780451532 @default.
- W3094219710 hasConcept C2993021520 @default.
- W3094219710 hasConcept C33676613 @default.
- W3094219710 hasConcept C33923547 @default.
- W3094219710 hasConcept C41008148 @default.
- W3094219710 hasConcept C43617362 @default.
- W3094219710 hasConcept C48921125 @default.
- W3094219710 hasConcept C83546350 @default.
- W3094219710 hasConceptScore W3094219710C105795698 @default.
- W3094219710 hasConceptScore W3094219710C119043178 @default.
- W3094219710 hasConceptScore W3094219710C121955636 @default.
- W3094219710 hasConceptScore W3094219710C129848803 @default.
- W3094219710 hasConceptScore W3094219710C134306372 @default.
- W3094219710 hasConceptScore W3094219710C144133560 @default.
- W3094219710 hasConceptScore W3094219710C149782125 @default.
- W3094219710 hasConceptScore W3094219710C151201525 @default.
- W3094219710 hasConceptScore W3094219710C154945302 @default.
- W3094219710 hasConceptScore W3094219710C162324750 @default.
- W3094219710 hasConceptScore W3094219710C177148314 @default.
- W3094219710 hasConceptScore W3094219710C185592680 @default.
- W3094219710 hasConceptScore W3094219710C187736073 @default.
- W3094219710 hasConceptScore W3094219710C196083921 @default.
- W3094219710 hasConceptScore W3094219710C198531522 @default.
- W3094219710 hasConceptScore W3094219710C202444582 @default.
- W3094219710 hasConceptScore W3094219710C2776502983 @default.
- W3094219710 hasConceptScore W3094219710C2780451532 @default.
- W3094219710 hasConceptScore W3094219710C2993021520 @default.
- W3094219710 hasConceptScore W3094219710C33676613 @default.
- W3094219710 hasConceptScore W3094219710C33923547 @default.
- W3094219710 hasConceptScore W3094219710C41008148 @default.
- W3094219710 hasConceptScore W3094219710C43617362 @default.
- W3094219710 hasConceptScore W3094219710C48921125 @default.
- W3094219710 hasConceptScore W3094219710C83546350 @default.
- W3094219710 hasLocation W30942197101 @default.
- W3094219710 hasOpenAccess W3094219710 @default.
- W3094219710 hasPrimaryLocation W30942197101 @default.
- W3094219710 hasRelatedWork W12226763 @default.
- W3094219710 hasRelatedWork W1578890739 @default.
- W3094219710 hasRelatedWork W2142920735 @default.
- W3094219710 hasRelatedWork W2475468636 @default.
- W3094219710 hasRelatedWork W2750294530 @default.
- W3094219710 hasRelatedWork W2805331836 @default.
- W3094219710 hasRelatedWork W2929342234 @default.
- W3094219710 hasRelatedWork W2951376723 @default.
- W3094219710 hasRelatedWork W2955972601 @default.
- W3094219710 hasRelatedWork W2980313216 @default.
- W3094219710 hasRelatedWork W3090173138 @default.
- W3094219710 hasRelatedWork W3092956825 @default.
- W3094219710 hasRelatedWork W3096304594 @default.
- W3094219710 hasRelatedWork W3109533473 @default.
- W3094219710 hasRelatedWork W3134880929 @default.
- W3094219710 hasRelatedWork W3165255832 @default.
- W3094219710 hasRelatedWork W3192639962 @default.
- W3094219710 hasRelatedWork W3195203488 @default.
- W3094219710 hasRelatedWork W3195607544 @default.
- W3094219710 hasRelatedWork W3210452206 @default.
- W3094219710 isParatext "false" @default.
- W3094219710 isRetracted "false" @default.