Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100676560> ?p ?o ?g. }
- W3100676560 endingPage "7862" @default.
- W3100676560 startingPage "7852" @default.
- W3100676560 abstract "We provide new statistical guarantees for transfer learning via representation learning--when transfer is achieved by learning a feature representation shared across different tasks. This enables learning on new tasks using far less data than is required to learn them in isolation. Formally, we consider $t+1$ tasks parameterized by functions of the form $f_j circ h$ in a general function class $mathcal{F} circ mathcal{H}$, where each $f_j$ is a task-specific function in $mathcal{F}$ and $h$ is the shared representation in $mathcal{H}$. Letting $C(cdot)$ denote the complexity measure of the function class, we show that for diverse training tasks (1) the sample complexity needed to learn the shared representation across the first $t$ training tasks scales as $C(mathcal{H}) + t C(mathcal{F})$, despite no explicit access to a signal from the feature representation and (2) with an accurate estimate of the representation, the sample complexity needed to learn a new task scales only with $C(mathcal{F})$. Our results depend upon a new general notion of task diversity--applicable to models with general tasks, features, and losses--as well as a novel chain rule for Gaussian complexities. Finally, we exhibit the utility of our general framework in several models of importance in the literature." @default.
- W3100676560 created "2020-11-23" @default.
- W3100676560 creator A5026221871 @default.
- W3100676560 creator A5049812527 @default.
- W3100676560 creator A5082311500 @default.
- W3100676560 date "2020-01-01" @default.
- W3100676560 modified "2023-10-18" @default.
- W3100676560 title "On the Theory of Transfer Learning: The Importance of Task Diversity" @default.
- W3100676560 hasPublicationYear "2020" @default.
- W3100676560 type Work @default.
- W3100676560 sameAs 3100676560 @default.
- W3100676560 citedByCount "10" @default.
- W3100676560 countsByYear W31006765602021 @default.
- W3100676560 crossrefType "proceedings-article" @default.
- W3100676560 hasAuthorship W3100676560A5026221871 @default.
- W3100676560 hasAuthorship W3100676560A5049812527 @default.
- W3100676560 hasAuthorship W3100676560A5082311500 @default.
- W3100676560 hasConcept C11413529 @default.
- W3100676560 hasConcept C118615104 @default.
- W3100676560 hasConcept C121332964 @default.
- W3100676560 hasConcept C138885662 @default.
- W3100676560 hasConcept C14036430 @default.
- W3100676560 hasConcept C150899416 @default.
- W3100676560 hasConcept C154945302 @default.
- W3100676560 hasConcept C162324750 @default.
- W3100676560 hasConcept C163716315 @default.
- W3100676560 hasConcept C165464430 @default.
- W3100676560 hasConcept C17744445 @default.
- W3100676560 hasConcept C187736073 @default.
- W3100676560 hasConcept C199539241 @default.
- W3100676560 hasConcept C2776359362 @default.
- W3100676560 hasConcept C2776401178 @default.
- W3100676560 hasConcept C2777212361 @default.
- W3100676560 hasConcept C2780451532 @default.
- W3100676560 hasConcept C28006648 @default.
- W3100676560 hasConcept C33923547 @default.
- W3100676560 hasConcept C41008148 @default.
- W3100676560 hasConcept C41895202 @default.
- W3100676560 hasConcept C59404180 @default.
- W3100676560 hasConcept C62520636 @default.
- W3100676560 hasConcept C78458016 @default.
- W3100676560 hasConcept C80444323 @default.
- W3100676560 hasConcept C86803240 @default.
- W3100676560 hasConcept C94625758 @default.
- W3100676560 hasConceptScore W3100676560C11413529 @default.
- W3100676560 hasConceptScore W3100676560C118615104 @default.
- W3100676560 hasConceptScore W3100676560C121332964 @default.
- W3100676560 hasConceptScore W3100676560C138885662 @default.
- W3100676560 hasConceptScore W3100676560C14036430 @default.
- W3100676560 hasConceptScore W3100676560C150899416 @default.
- W3100676560 hasConceptScore W3100676560C154945302 @default.
- W3100676560 hasConceptScore W3100676560C162324750 @default.
- W3100676560 hasConceptScore W3100676560C163716315 @default.
- W3100676560 hasConceptScore W3100676560C165464430 @default.
- W3100676560 hasConceptScore W3100676560C17744445 @default.
- W3100676560 hasConceptScore W3100676560C187736073 @default.
- W3100676560 hasConceptScore W3100676560C199539241 @default.
- W3100676560 hasConceptScore W3100676560C2776359362 @default.
- W3100676560 hasConceptScore W3100676560C2776401178 @default.
- W3100676560 hasConceptScore W3100676560C2777212361 @default.
- W3100676560 hasConceptScore W3100676560C2780451532 @default.
- W3100676560 hasConceptScore W3100676560C28006648 @default.
- W3100676560 hasConceptScore W3100676560C33923547 @default.
- W3100676560 hasConceptScore W3100676560C41008148 @default.
- W3100676560 hasConceptScore W3100676560C41895202 @default.
- W3100676560 hasConceptScore W3100676560C59404180 @default.
- W3100676560 hasConceptScore W3100676560C62520636 @default.
- W3100676560 hasConceptScore W3100676560C78458016 @default.
- W3100676560 hasConceptScore W3100676560C80444323 @default.
- W3100676560 hasConceptScore W3100676560C86803240 @default.
- W3100676560 hasConceptScore W3100676560C94625758 @default.
- W3100676560 hasLocation W31006765601 @default.
- W3100676560 hasOpenAccess W3100676560 @default.
- W3100676560 hasPrimaryLocation W31006765601 @default.
- W3100676560 hasRelatedWork W1635792279 @default.
- W3100676560 hasRelatedWork W2040852548 @default.
- W3100676560 hasRelatedWork W2147198965 @default.
- W3100676560 hasRelatedWork W2150287743 @default.
- W3100676560 hasRelatedWork W2181750757 @default.
- W3100676560 hasRelatedWork W2186494677 @default.
- W3100676560 hasRelatedWork W2237537322 @default.
- W3100676560 hasRelatedWork W2340940935 @default.
- W3100676560 hasRelatedWork W2397132841 @default.
- W3100676560 hasRelatedWork W2604763608 @default.
- W3100676560 hasRelatedWork W2767316680 @default.
- W3100676560 hasRelatedWork W2899291363 @default.
- W3100676560 hasRelatedWork W2947334431 @default.
- W3100676560 hasRelatedWork W2950909529 @default.
- W3100676560 hasRelatedWork W2989834192 @default.
- W3100676560 hasRelatedWork W3034268901 @default.
- W3100676560 hasRelatedWork W3035990676 @default.
- W3100676560 hasRelatedWork W3104240813 @default.
- W3100676560 hasRelatedWork W3168281993 @default.
- W3100676560 hasRelatedWork W86588979 @default.
- W3100676560 hasVolume "33" @default.
- W3100676560 isParatext "false" @default.
- W3100676560 isRetracted "false" @default.
- W3100676560 magId "3100676560" @default.