Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100511085> ?p ?o ?g. }
- W3100511085 abstract "ML models often exhibit unexpectedly poor behavior when they are deployed in real-world domains. We identify underspecification as a key reason for these failures. An ML pipeline is underspecified when it can return many predictors with equivalently strong held-out performance in the training domain. Underspecification is common in modern ML pipelines, such as those based on deep learning. Predictors returned by underspecified pipelines are often treated as equivalent based on their training domain performance, but we show here that such predictors can behave very differently in deployment domains. This ambiguity can lead to instability and poor model behavior in practice, and is a distinct failure mode from previously identified issues arising from structural mismatch between training and deployment domains. We show that this problem appears in a wide variety of practical ML pipelines, using examples from computer vision, medical imaging, natural language processing, clinical risk prediction based on electronic health records, and medical genomics. Our results show the need to explicitly account for underspecification in modeling pipelines that are intended for real-world deployment in any domain." @default.
- W3100511085 created "2020-11-23" @default.
- W3100511085 creator A5003509342 @default.
- W3100511085 creator A5005452839 @default.
- W3100511085 creator A5007707507 @default.
- W3100511085 creator A5007880675 @default.
- W3100511085 creator A5011999109 @default.
- W3100511085 creator A5014018142 @default.
- W3100511085 creator A5016230870 @default.
- W3100511085 creator A5016611202 @default.
- W3100511085 creator A5021644000 @default.
- W3100511085 creator A5024842018 @default.
- W3100511085 creator A5025760626 @default.
- W3100511085 creator A5027480948 @default.
- W3100511085 creator A5032405131 @default.
- W3100511085 creator A5034102933 @default.
- W3100511085 creator A5038101632 @default.
- W3100511085 creator A5041806431 @default.
- W3100511085 creator A5043094101 @default.
- W3100511085 creator A5044677020 @default.
- W3100511085 creator A5047699861 @default.
- W3100511085 creator A5048167471 @default.
- W3100511085 creator A5048204767 @default.
- W3100511085 creator A5055928795 @default.
- W3100511085 creator A5058399428 @default.
- W3100511085 creator A5058677067 @default.
- W3100511085 creator A5059293780 @default.
- W3100511085 creator A5059964324 @default.
- W3100511085 creator A5060172197 @default.
- W3100511085 creator A5060694111 @default.
- W3100511085 creator A5067411442 @default.
- W3100511085 creator A5067481441 @default.
- W3100511085 creator A5068878643 @default.
- W3100511085 creator A5069219684 @default.
- W3100511085 creator A5071668416 @default.
- W3100511085 creator A5077406767 @default.
- W3100511085 creator A5078690248 @default.
- W3100511085 creator A5080988309 @default.
- W3100511085 creator A5084052779 @default.
- W3100511085 creator A5086270414 @default.
- W3100511085 creator A5088842522 @default.
- W3100511085 creator A5091102480 @default.
- W3100511085 date "2020-11-06" @default.
- W3100511085 modified "2023-09-27" @default.
- W3100511085 title "Underspecification Presents Challenges for Credibility in Modern Machine Learning" @default.
- W3100511085 cites W127769986 @default.
- W3100511085 cites W1840435438 @default.
- W3100511085 cites W2006940889 @default.
- W3100511085 cites W2010380543 @default.
- W3100511085 cites W2026274122 @default.
- W3100511085 cites W2048011602 @default.
- W3100511085 cites W2064675550 @default.
- W3100511085 cites W2082704080 @default.
- W3100511085 cites W2088911157 @default.
- W3100511085 cites W2091239497 @default.
- W3100511085 cites W2097159647 @default.
- W3100511085 cites W2097572487 @default.
- W3100511085 cites W2098597355 @default.
- W3100511085 cites W2108598243 @default.
- W3100511085 cites W2120930809 @default.
- W3100511085 cites W2144902422 @default.
- W3100511085 cites W2157752701 @default.
- W3100511085 cites W2161633633 @default.
- W3100511085 cites W2194775991 @default.
- W3100511085 cites W2203167467 @default.
- W3100511085 cites W2483215953 @default.
- W3100511085 cites W2552194003 @default.
- W3100511085 cites W2557074642 @default.
- W3100511085 cites W2557270725 @default.
- W3100511085 cites W2557738935 @default.
- W3100511085 cites W2598022332 @default.
- W3100511085 cites W2610886376 @default.
- W3100511085 cites W2753845591 @default.
- W3100511085 cites W2759710969 @default.
- W3100511085 cites W2762741128 @default.
- W3100511085 cites W2788481061 @default.
- W3100511085 cites W2790376986 @default.
- W3100511085 cites W2886283492 @default.
- W3100511085 cites W2886752110 @default.
- W3100511085 cites W2891620446 @default.
- W3100511085 cites W2902617128 @default.
- W3100511085 cites W2903277834 @default.
- W3100511085 cites W2907127169 @default.
- W3100511085 cites W2916722198 @default.
- W3100511085 cites W2919271091 @default.
- W3100511085 cites W2946609015 @default.
- W3100511085 cites W2950577311 @default.
- W3100511085 cites W2951286828 @default.
- W3100511085 cites W2952204734 @default.
- W3100511085 cites W2953494151 @default.
- W3100511085 cites W2961301154 @default.
- W3100511085 cites W2962833164 @default.
- W3100511085 cites W2963026768 @default.
- W3100511085 cites W2963060032 @default.
- W3100511085 cites W2963159690 @default.
- W3100511085 cites W2963160524 @default.
- W3100511085 cites W2963173418 @default.
- W3100511085 cites W2963174729 @default.
- W3100511085 cites W2963238274 @default.
- W3100511085 cites W2963341956 @default.