Matches in SemOpenAlex for { <https://semopenalex.org/work/W2954602266> ?p ?o ?g. }
- W2954602266 abstract "Online Controlled Experiments (OCEs) are transforming the decision-making process of data-driven companies into an experimental laboratory. Despite their great power in identifying what customers actually value, experimentation is very sensitive to data loss, skipped checks, wrong designs, and many other 'hiccups' in the analysis process. For this purpose, experiment analysis has traditionally been done by experienced data analysts and scientists that closely monitored experiments throughout their lifecycle. Depending solely on scarce experts, however, is neither scalable nor bulletproof. To democratize experimentation, analysis should be streamlined and meticulously performed by engineers, managers, or others responsible for the development of a product. In this paper, based on synthesized experience of companies that run thousands of OCEs per year, we examined how experts inspect online experiments. We reveal that most of the experiment analysis happens before OCEs are even started, and we summarize the key analysis steps in three checklists. The value of the checklists is threefold. First, they can increase the accuracy of experiment set-up and decision-making process. Second, checklists can enable novice data scientists and software engineers to become more autonomous in setting-up and analyzing experiments. Finally, they can serve as a base to develop trustworthy platforms and tools for OCE set-up and analysis." @default.
- W2954602266 created "2019-07-12" @default.
- W2954602266 creator A5010170972 @default.
- W2954602266 creator A5010245209 @default.
- W2954602266 creator A5020697231 @default.
- W2954602266 creator A5028609132 @default.
- W2954602266 creator A5031956439 @default.
- W2954602266 creator A5049811300 @default.
- W2954602266 date "2019-05-01" @default.
- W2954602266 modified "2023-09-27" @default.
- W2954602266 title "Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale" @default.
- W2954602266 cites W1584570151 @default.
- W2954602266 cites W161897729 @default.
- W2954602266 cites W1972091638 @default.
- W2954602266 cites W1975566260 @default.
- W2954602266 cites W2031385454 @default.
- W2954602266 cites W2052080537 @default.
- W2954602266 cites W2069523442 @default.
- W2954602266 cites W2070815407 @default.
- W2954602266 cites W2080770071 @default.
- W2954602266 cites W2104942079 @default.
- W2954602266 cites W2110228583 @default.
- W2954602266 cites W2114968482 @default.
- W2954602266 cites W2162739315 @default.
- W2954602266 cites W2169113736 @default.
- W2954602266 cites W2182687482 @default.
- W2954602266 cites W2532610538 @default.
- W2954602266 cites W2584822570 @default.
- W2954602266 cites W2620002388 @default.
- W2954602266 cites W2726916727 @default.
- W2954602266 cites W2743849295 @default.
- W2954602266 cites W2760448772 @default.
- W2954602266 cites W2783317701 @default.
- W2954602266 cites W2804539745 @default.
- W2954602266 cites W2884019407 @default.
- W2954602266 cites W2895842676 @default.
- W2954602266 cites W2896728844 @default.
- W2954602266 cites W2897260156 @default.
- W2954602266 cites W2897427400 @default.
- W2954602266 cites W2963366444 @default.
- W2954602266 cites W3104418946 @default.
- W2954602266 cites W3147048975 @default.
- W2954602266 cites W4205092223 @default.
- W2954602266 cites W4232778106 @default.
- W2954602266 doi "https://doi.org/10.1109/icse-seip.2019.00009" @default.
- W2954602266 hasPublicationYear "2019" @default.
- W2954602266 type Work @default.
- W2954602266 sameAs 2954602266 @default.
- W2954602266 citedByCount "11" @default.
- W2954602266 countsByYear W29546022662019 @default.
- W2954602266 countsByYear W29546022662020 @default.
- W2954602266 countsByYear W29546022662021 @default.
- W2954602266 countsByYear W29546022662022 @default.
- W2954602266 countsByYear W29546022662023 @default.
- W2954602266 crossrefType "proceedings-article" @default.
- W2954602266 hasAuthorship W2954602266A5010170972 @default.
- W2954602266 hasAuthorship W2954602266A5010245209 @default.
- W2954602266 hasAuthorship W2954602266A5020697231 @default.
- W2954602266 hasAuthorship W2954602266A5028609132 @default.
- W2954602266 hasAuthorship W2954602266A5031956439 @default.
- W2954602266 hasAuthorship W2954602266A5049811300 @default.
- W2954602266 hasConcept C111919701 @default.
- W2954602266 hasConcept C115903868 @default.
- W2954602266 hasConcept C119857082 @default.
- W2954602266 hasConcept C121332964 @default.
- W2954602266 hasConcept C153701036 @default.
- W2954602266 hasConcept C177264268 @default.
- W2954602266 hasConcept C199360897 @default.
- W2954602266 hasConcept C2522767166 @default.
- W2954602266 hasConcept C2524010 @default.
- W2954602266 hasConcept C26517878 @default.
- W2954602266 hasConcept C2776291640 @default.
- W2954602266 hasConcept C2778755073 @default.
- W2954602266 hasConcept C33923547 @default.
- W2954602266 hasConcept C38652104 @default.
- W2954602266 hasConcept C41008148 @default.
- W2954602266 hasConcept C48044578 @default.
- W2954602266 hasConcept C62520636 @default.
- W2954602266 hasConcept C77088390 @default.
- W2954602266 hasConcept C90673727 @default.
- W2954602266 hasConcept C98045186 @default.
- W2954602266 hasConceptScore W2954602266C111919701 @default.
- W2954602266 hasConceptScore W2954602266C115903868 @default.
- W2954602266 hasConceptScore W2954602266C119857082 @default.
- W2954602266 hasConceptScore W2954602266C121332964 @default.
- W2954602266 hasConceptScore W2954602266C153701036 @default.
- W2954602266 hasConceptScore W2954602266C177264268 @default.
- W2954602266 hasConceptScore W2954602266C199360897 @default.
- W2954602266 hasConceptScore W2954602266C2522767166 @default.
- W2954602266 hasConceptScore W2954602266C2524010 @default.
- W2954602266 hasConceptScore W2954602266C26517878 @default.
- W2954602266 hasConceptScore W2954602266C2776291640 @default.
- W2954602266 hasConceptScore W2954602266C2778755073 @default.
- W2954602266 hasConceptScore W2954602266C33923547 @default.
- W2954602266 hasConceptScore W2954602266C38652104 @default.
- W2954602266 hasConceptScore W2954602266C41008148 @default.
- W2954602266 hasConceptScore W2954602266C48044578 @default.
- W2954602266 hasConceptScore W2954602266C62520636 @default.
- W2954602266 hasConceptScore W2954602266C77088390 @default.
- W2954602266 hasConceptScore W2954602266C90673727 @default.