Matches in SemOpenAlex for { <https://semopenalex.org/work/W2947777775> ?p ?o ?g. }
- W2947777775 abstract "Simplifying machine learning (ML) application development, including distributed computation, programming interface, resource management, model selection, etc, has attracted intensive interests recently. These research efforts have significantly improved the efficiency and the degree of automation of developing ML models. In this paper, we take a first step in an orthogonal direction towards automated quality management for human-in-the-loop ML application development. We build ease. ml/meter, a system that can automatically detect and measure the degree of overfitting during the whole lifecycle of ML application development. ease. ml/meter returns overfitting signals with strong probabilistic guarantees, based on which developers can take appropriate actions. In particular, ease. ml/meter provides principled guidelines to simple yet nontrivial questions regarding desired validation and test data sizes, which are among commonest questions raised by developers. The fact that ML application development is typically a continuous procedure further worsens the situation: The validation and test data sets can lose their statistical power quickly due to multiple accesses, especially in the presence of adaptive analysis. ease. ml/meter addresses these challenges by leveraging a collection of novel techniques and optimizations, resulting in practically tractable data sizes without compromising the probabilistic guarantees. We present the design and implementation details of ease. ml/meter, as well as detailed theoretical analysis and empirical evaluation of its effectiveness." @default.
- W2947777775 created "2019-06-07" @default.
- W2947777775 creator A5041232755 @default.
- W2947777775 creator A5041515151 @default.
- W2947777775 creator A5081651393 @default.
- W2947777775 date "2019-06-01" @default.
- W2947777775 modified "2023-09-23" @default.
- W2947777775 title "Quantitative Overfitting Management for Human-in-the-loop ML Application Development with ease.ml/meter" @default.
- W2947777775 cites W1562629803 @default.
- W2947777775 cites W1585854823 @default.
- W2947777775 cites W1798749056 @default.
- W2947777775 cites W1982723861 @default.
- W2947777775 cites W2074702228 @default.
- W2947777775 cites W2077641783 @default.
- W2947777775 cites W2083842231 @default.
- W2947777775 cites W2107598941 @default.
- W2947777775 cites W2250539671 @default.
- W2947777775 cites W2404161646 @default.
- W2947777775 cites W2572438701 @default.
- W2947777775 cites W2598809989 @default.
- W2947777775 cites W2612387549 @default.
- W2947777775 cites W2789663542 @default.
- W2947777775 cites W2804191040 @default.
- W2947777775 cites W2888870906 @default.
- W2947777775 cites W2889073286 @default.
- W2947777775 cites W2920073645 @default.
- W2947777775 cites W2962739339 @default.
- W2947777775 cites W2962891276 @default.
- W2947777775 cites W2963288913 @default.
- W2947777775 cites W2964125981 @default.
- W2947777775 cites W3105655676 @default.
- W2947777775 cites W3139670689 @default.
- W2947777775 cites W607505555 @default.
- W2947777775 cites W2964204577 @default.
- W2947777775 hasPublicationYear "2019" @default.
- W2947777775 type Work @default.
- W2947777775 sameAs 2947777775 @default.
- W2947777775 citedByCount "3" @default.
- W2947777775 countsByYear W29477777752020 @default.
- W2947777775 crossrefType "posted-content" @default.
- W2947777775 hasAuthorship W2947777775A5041232755 @default.
- W2947777775 hasAuthorship W2947777775A5041515151 @default.
- W2947777775 hasAuthorship W2947777775A5081651393 @default.
- W2947777775 hasConcept C10558101 @default.
- W2947777775 hasConcept C107457646 @default.
- W2947777775 hasConcept C115901376 @default.
- W2947777775 hasConcept C119857082 @default.
- W2947777775 hasConcept C124101348 @default.
- W2947777775 hasConcept C127413603 @default.
- W2947777775 hasConcept C154945302 @default.
- W2947777775 hasConcept C170130773 @default.
- W2947777775 hasConcept C18903297 @default.
- W2947777775 hasConcept C22019652 @default.
- W2947777775 hasConcept C2779510800 @default.
- W2947777775 hasConcept C2780009758 @default.
- W2947777775 hasConcept C41008148 @default.
- W2947777775 hasConcept C49937458 @default.
- W2947777775 hasConcept C50644808 @default.
- W2947777775 hasConcept C78519656 @default.
- W2947777775 hasConcept C86803240 @default.
- W2947777775 hasConceptScore W2947777775C10558101 @default.
- W2947777775 hasConceptScore W2947777775C107457646 @default.
- W2947777775 hasConceptScore W2947777775C115901376 @default.
- W2947777775 hasConceptScore W2947777775C119857082 @default.
- W2947777775 hasConceptScore W2947777775C124101348 @default.
- W2947777775 hasConceptScore W2947777775C127413603 @default.
- W2947777775 hasConceptScore W2947777775C154945302 @default.
- W2947777775 hasConceptScore W2947777775C170130773 @default.
- W2947777775 hasConceptScore W2947777775C18903297 @default.
- W2947777775 hasConceptScore W2947777775C22019652 @default.
- W2947777775 hasConceptScore W2947777775C2779510800 @default.
- W2947777775 hasConceptScore W2947777775C2780009758 @default.
- W2947777775 hasConceptScore W2947777775C41008148 @default.
- W2947777775 hasConceptScore W2947777775C49937458 @default.
- W2947777775 hasConceptScore W2947777775C50644808 @default.
- W2947777775 hasConceptScore W2947777775C78519656 @default.
- W2947777775 hasConceptScore W2947777775C86803240 @default.
- W2947777775 hasLocation W29477777751 @default.
- W2947777775 hasOpenAccess W2947777775 @default.
- W2947777775 hasPrimaryLocation W29477777751 @default.
- W2947777775 hasRelatedWork W10708573 @default.
- W2947777775 hasRelatedWork W1470307449 @default.
- W2947777775 hasRelatedWork W2022611728 @default.
- W2947777775 hasRelatedWork W2412975189 @default.
- W2947777775 hasRelatedWork W2517285761 @default.
- W2947777775 hasRelatedWork W2533383645 @default.
- W2947777775 hasRelatedWork W2560536472 @default.
- W2947777775 hasRelatedWork W2726148074 @default.
- W2947777775 hasRelatedWork W2749599497 @default.
- W2947777775 hasRelatedWork W2749927092 @default.
- W2947777775 hasRelatedWork W2885222086 @default.
- W2947777775 hasRelatedWork W2901421555 @default.
- W2947777775 hasRelatedWork W2964858848 @default.
- W2947777775 hasRelatedWork W2967458934 @default.
- W2947777775 hasRelatedWork W2967860686 @default.
- W2947777775 hasRelatedWork W2967987351 @default.
- W2947777775 hasRelatedWork W2981674198 @default.
- W2947777775 hasRelatedWork W3008544856 @default.
- W2947777775 hasRelatedWork W3158630730 @default.
- W2947777775 hasRelatedWork W3183276810 @default.