Matches in SemOpenAlex for { <https://semopenalex.org/work/W3093669898> ?p ?o ?g. }
- W3093669898 abstract "After developer adjustments to a machine learning (ML) algorithm, how can the results of an old hyperparameter optimization (HPO) automatically be used to speedup a new HPO? This question poses a challenging problem, as developer adjustments can change which hyperparameter settings perform well, or even the hyperparameter search space itself. While many approaches exist that leverage knowledge obtained on previous tasks, so far, knowledge from previous development steps remains entirely untapped. In this work, we remedy this situation and propose a new research framework: hyperparameter transfer across adjustments (HT-AA). To lay a solid foundation for this research framework, we provide four simple HT-AA baseline algorithms and eight benchmarks changing various aspects of ML algorithms, their hyperparameter search spaces, and the neural architectures used. The best baseline, on average and depending on the budgets for the old and new HPO, reaches a given performance 1.2-3.6x faster than a prominent HPO algorithm without transfer. As HPO is a crucial step in ML development but requires extensive computational resources, this speedup would lead to faster development cycles, lower costs, and reduced environmental impacts. To make these benefits available to ML developers off-the-shelf and to facilitate future research on HT-AA, we provide python packages for our baselines and benchmarks." @default.
- W3093669898 created "2020-10-29" @default.
- W3093669898 creator A5031002895 @default.
- W3093669898 creator A5039793317 @default.
- W3093669898 creator A5048243124 @default.
- W3093669898 creator A5053058754 @default.
- W3093669898 creator A5067949550 @default.
- W3093669898 date "2021-05-04" @default.
- W3093669898 modified "2023-09-27" @default.
- W3093669898 title "Hyperparameter Transfer Across Developer Adjustments" @default.
- W3093669898 cites W114730584 @default.
- W3093669898 cites W115795130 @default.
- W3093669898 cites W1683511521 @default.
- W3093669898 cites W1991564165 @default.
- W3093669898 cites W2047003964 @default.
- W3093669898 cites W2106411961 @default.
- W3093669898 cites W2113145584 @default.
- W3093669898 cites W2113207845 @default.
- W3093669898 cites W2149764047 @default.
- W3093669898 cites W2178031510 @default.
- W3093669898 cites W2403271036 @default.
- W3093669898 cites W2758375579 @default.
- W3093669898 cites W2780562800 @default.
- W3093669898 cites W2785444061 @default.
- W3093669898 cites W2795783309 @default.
- W3093669898 cites W2891146651 @default.
- W3093669898 cites W2895531857 @default.
- W3093669898 cites W2903717821 @default.
- W3093669898 cites W2944786596 @default.
- W3093669898 cites W2948223045 @default.
- W3093669898 cites W2950182411 @default.
- W3093669898 cites W2963273374 @default.
- W3093669898 cites W2963423218 @default.
- W3093669898 cites W2963446712 @default.
- W3093669898 cites W2969870446 @default.
- W3093669898 cites W2987705220 @default.
- W3093669898 cites W2996037775 @default.
- W3093669898 cites W2999270366 @default.
- W3093669898 cites W3007385124 @default.
- W3093669898 cites W3011927872 @default.
- W3093669898 hasPublicationYear "2021" @default.
- W3093669898 type Work @default.
- W3093669898 sameAs 3093669898 @default.
- W3093669898 citedByCount "1" @default.
- W3093669898 countsByYear W30936698982021 @default.
- W3093669898 crossrefType "journal-article" @default.
- W3093669898 hasAuthorship W3093669898A5031002895 @default.
- W3093669898 hasAuthorship W3093669898A5039793317 @default.
- W3093669898 hasAuthorship W3093669898A5048243124 @default.
- W3093669898 hasAuthorship W3093669898A5053058754 @default.
- W3093669898 hasAuthorship W3093669898A5067949550 @default.
- W3093669898 hasConcept C10485038 @default.
- W3093669898 hasConcept C111368507 @default.
- W3093669898 hasConcept C119857082 @default.
- W3093669898 hasConcept C12267149 @default.
- W3093669898 hasConcept C12725497 @default.
- W3093669898 hasConcept C127313418 @default.
- W3093669898 hasConcept C150899416 @default.
- W3093669898 hasConcept C153083717 @default.
- W3093669898 hasConcept C154945302 @default.
- W3093669898 hasConcept C173608175 @default.
- W3093669898 hasConcept C199360897 @default.
- W3093669898 hasConcept C41008148 @default.
- W3093669898 hasConcept C519991488 @default.
- W3093669898 hasConcept C68339613 @default.
- W3093669898 hasConcept C8642999 @default.
- W3093669898 hasConceptScore W3093669898C10485038 @default.
- W3093669898 hasConceptScore W3093669898C111368507 @default.
- W3093669898 hasConceptScore W3093669898C119857082 @default.
- W3093669898 hasConceptScore W3093669898C12267149 @default.
- W3093669898 hasConceptScore W3093669898C12725497 @default.
- W3093669898 hasConceptScore W3093669898C127313418 @default.
- W3093669898 hasConceptScore W3093669898C150899416 @default.
- W3093669898 hasConceptScore W3093669898C153083717 @default.
- W3093669898 hasConceptScore W3093669898C154945302 @default.
- W3093669898 hasConceptScore W3093669898C173608175 @default.
- W3093669898 hasConceptScore W3093669898C199360897 @default.
- W3093669898 hasConceptScore W3093669898C41008148 @default.
- W3093669898 hasConceptScore W3093669898C519991488 @default.
- W3093669898 hasConceptScore W3093669898C68339613 @default.
- W3093669898 hasConceptScore W3093669898C8642999 @default.
- W3093669898 hasOpenAccess W3093669898 @default.
- W3093669898 hasRelatedWork W1258972194 @default.
- W3093669898 hasRelatedWork W2731604420 @default.
- W3093669898 hasRelatedWork W2948464353 @default.
- W3093669898 hasRelatedWork W2951671802 @default.
- W3093669898 hasRelatedWork W2963138154 @default.
- W3093669898 hasRelatedWork W2963642335 @default.
- W3093669898 hasRelatedWork W2966368669 @default.
- W3093669898 hasRelatedWork W2970562710 @default.
- W3093669898 hasRelatedWork W2971799085 @default.
- W3093669898 hasRelatedWork W3041354530 @default.
- W3093669898 hasRelatedWork W3043510298 @default.
- W3093669898 hasRelatedWork W3044836307 @default.
- W3093669898 hasRelatedWork W3093107604 @default.
- W3093669898 hasRelatedWork W3099126479 @default.
- W3093669898 hasRelatedWork W3106885804 @default.
- W3093669898 hasRelatedWork W3130468151 @default.
- W3093669898 hasRelatedWork W3157036251 @default.
- W3093669898 hasRelatedWork W3192751261 @default.