Matches in SemOpenAlex for { <https://semopenalex.org/work/W3136489196> ?p ?o ?g. }
- W3136489196 abstract "Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the set). This is done by solving a min-max game: the model is trained to minimize its maximum expected loss among all distributions in the uncertainty set. While careful design of the uncertainty set is critical to the success of the DRO procedure, previous work has been limited to relatively simple alternatives that keep the min-max optimization problem exactly tractable, such as $f$-divergence balls. In this paper, we argue instead for the use of neural generative models to characterize the worst-case distribution, allowing for more flexible and problem-specific selection of the uncertainty set. However, while simple conceptually, this approach poses a number of implementation and optimization challenges. To circumvent these issues, we propose a relaxation of the KL-constrained inner maximization objective that makes the DRO problem more amenable to gradient-based optimization of large scale generative models, and develop model selection heuristics to guide hyper-parameter search. On both toy settings and realistic NLP tasks, we find that the proposed approach yields models that are more robust than comparable baselines." @default.
- W3136489196 created "2021-03-29" @default.
- W3136489196 creator A5001170954 @default.
- W3136489196 creator A5015518638 @default.
- W3136489196 creator A5068811427 @default.
- W3136489196 date "2021-03-18" @default.
- W3136489196 modified "2023-09-27" @default.
- W3136489196 title "Modeling the Second Player in Distributionally Robust Optimization" @default.
- W3136489196 cites W1484551447 @default.
- W3136489196 cites W1607392272 @default.
- W3136489196 cites W1965555277 @default.
- W3136489196 cites W1968355947 @default.
- W3136489196 cites W2033178790 @default.
- W3136489196 cites W2064675550 @default.
- W3136489196 cites W2099471712 @default.
- W3136489196 cites W2108682071 @default.
- W3136489196 cites W2109100253 @default.
- W3136489196 cites W2123921160 @default.
- W3136489196 cites W2193413348 @default.
- W3136489196 cites W2250559305 @default.
- W3136489196 cites W2251939518 @default.
- W3136489196 cites W2402268235 @default.
- W3136489196 cites W2531499355 @default.
- W3136489196 cites W2562747313 @default.
- W3136489196 cites W2595653137 @default.
- W3136489196 cites W2740168486 @default.
- W3136489196 cites W2769449989 @default.
- W3136489196 cites W2788557041 @default.
- W3136489196 cites W2791170418 @default.
- W3136489196 cites W2887782043 @default.
- W3136489196 cites W2896534181 @default.
- W3136489196 cites W2949678053 @default.
- W3136489196 cites W2962979365 @default.
- W3136489196 cites W2963341956 @default.
- W3136489196 cites W2963494889 @default.
- W3136489196 cites W2963539647 @default.
- W3136489196 cites W2963549959 @default.
- W3136489196 cites W2963962369 @default.
- W3136489196 cites W2964121744 @default.
- W3136489196 cites W2964235839 @default.
- W3136489196 cites W2968009374 @default.
- W3136489196 cites W2970789589 @default.
- W3136489196 cites W2991497298 @default.
- W3136489196 cites W2997352934 @default.
- W3136489196 cites W3034238904 @default.
- W3136489196 cites W3035482741 @default.
- W3136489196 cites W3045555759 @default.
- W3136489196 cites W3100895823 @default.
- W3136489196 cites W3105741936 @default.
- W3136489196 cites W3127284993 @default.
- W3136489196 hasPublicationYear "2021" @default.
- W3136489196 type Work @default.
- W3136489196 sameAs 3136489196 @default.
- W3136489196 citedByCount "0" @default.
- W3136489196 crossrefType "posted-content" @default.
- W3136489196 hasAuthorship W3136489196A5001170954 @default.
- W3136489196 hasAuthorship W3136489196A5015518638 @default.
- W3136489196 hasAuthorship W3136489196A5068811427 @default.
- W3136489196 hasConcept C111472728 @default.
- W3136489196 hasConcept C119857082 @default.
- W3136489196 hasConcept C126255220 @default.
- W3136489196 hasConcept C127705205 @default.
- W3136489196 hasConcept C137836250 @default.
- W3136489196 hasConcept C138885662 @default.
- W3136489196 hasConcept C154945302 @default.
- W3136489196 hasConcept C15744967 @default.
- W3136489196 hasConcept C167966045 @default.
- W3136489196 hasConcept C177264268 @default.
- W3136489196 hasConcept C193254401 @default.
- W3136489196 hasConcept C199360897 @default.
- W3136489196 hasConcept C2776029896 @default.
- W3136489196 hasConcept C2776330181 @default.
- W3136489196 hasConcept C2780586882 @default.
- W3136489196 hasConcept C33923547 @default.
- W3136489196 hasConcept C39890363 @default.
- W3136489196 hasConcept C41008148 @default.
- W3136489196 hasConcept C77805123 @default.
- W3136489196 hasConcept C81917197 @default.
- W3136489196 hasConceptScore W3136489196C111472728 @default.
- W3136489196 hasConceptScore W3136489196C119857082 @default.
- W3136489196 hasConceptScore W3136489196C126255220 @default.
- W3136489196 hasConceptScore W3136489196C127705205 @default.
- W3136489196 hasConceptScore W3136489196C137836250 @default.
- W3136489196 hasConceptScore W3136489196C138885662 @default.
- W3136489196 hasConceptScore W3136489196C154945302 @default.
- W3136489196 hasConceptScore W3136489196C15744967 @default.
- W3136489196 hasConceptScore W3136489196C167966045 @default.
- W3136489196 hasConceptScore W3136489196C177264268 @default.
- W3136489196 hasConceptScore W3136489196C193254401 @default.
- W3136489196 hasConceptScore W3136489196C199360897 @default.
- W3136489196 hasConceptScore W3136489196C2776029896 @default.
- W3136489196 hasConceptScore W3136489196C2776330181 @default.
- W3136489196 hasConceptScore W3136489196C2780586882 @default.
- W3136489196 hasConceptScore W3136489196C33923547 @default.
- W3136489196 hasConceptScore W3136489196C39890363 @default.
- W3136489196 hasConceptScore W3136489196C41008148 @default.
- W3136489196 hasConceptScore W3136489196C77805123 @default.
- W3136489196 hasConceptScore W3136489196C81917197 @default.
- W3136489196 hasLocation W31364891961 @default.
- W3136489196 hasOpenAccess W3136489196 @default.