FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2952127798> ?p ?o ?g. }

• W2952127798 abstract "Accurately learning what delivers value to customers is difficult. Online Controlled Experiments (OCEs), aka A/B tests, are becoming a standard operating procedure in software companies to address this challenge as they can detect small causal changes in user behavior due to product modifications (e.g. new features). However, like any data analysis method, OCEs are sensitive to trustworthiness and data quality issues which, if go unaddressed or unnoticed, may result in making wrong decisions. One of the most useful indicators of a variety of data quality issues is a Sample Ratio Mismatch (SRM) ? the situation when the observed sample ratio in the experiment is different from the expected. Just like fever is a symptom for multiple types of illness, an SRM is a symptom for a variety of data quality issues. While a simple statistical check is used to detect an SRM, correctly identifying the root cause and preventing it from happening in the future is often extremely challenging and time consuming. Ignoring the SRM without knowing the root cause may result in a bad product modification appearing to be good and getting shipped to users, or vice versa. The goal of this paper is to make diagnosing, fixing, and preventing SRMs easier. Based on our experience of running OCEs in four different software companies in over 25 different products used by hundreds of millions of users worldwide, we have derived a taxonomy for different types of SRMs. We share examples, detection guidelines, and best practices for preventing SRMs of each type. We hope that the lessons and practical tips we describe in this paper will speed up SRM investigations and prevent some of them. Ultimately, this should lead to improved decision making based on trustworthy experiment analysis." @default.
• W2952127798 created "2019-06-27" @default.
• W2952127798 creator A5010195521 @default.
• W2952127798 creator A5010245209 @default.
• W2952127798 creator A5020286799 @default.
• W2952127798 creator A5020697231 @default.
• W2952127798 creator A5031956439 @default.
• W2952127798 creator A5033271026 @default.
• W2952127798 creator A5039548707 @default.
• W2952127798 date "2019-07-25" @default.
• W2952127798 modified "2023-09-28" @default.
• W2952127798 title "Diagnosing Sample Ratio Mismatch in Online Controlled Experiments" @default.
• W2952127798 cites W1975566260 @default.
• W2952127798 cites W2031648200 @default.
• W2952127798 cites W2070815407 @default.
• W2952127798 cites W2080770071 @default.
• W2952127798 cites W2095056536 @default.
• W2952127798 cites W2110228583 @default.
• W2952127798 cites W2112508839 @default.
• W2952127798 cites W2162739315 @default.
• W2952127798 cites W2327481811 @default.
• W2952127798 cites W2584778415 @default.
• W2952127798 cites W2584822570 @default.
• W2952127798 cites W2726916727 @default.
• W2952127798 cites W2743849295 @default.
• W2952127798 cites W2760448772 @default.
• W2952127798 cites W2884019407 @default.
• W2952127798 cites W2895842676 @default.
• W2952127798 cites W2896728844 @default.
• W2952127798 cites W2897260156 @default.
• W2952127798 cites W2900414111 @default.
• W2952127798 cites W3104418946 @default.
• W2952127798 cites W4210922477 @default.
• W2952127798 cites W4300879629 @default.
• W2952127798 doi "https://doi.org/10.1145/3292500.3330722" @default.
• W2952127798 hasPublicationYear "2019" @default.
• W2952127798 type Work @default.
• W2952127798 sameAs 2952127798 @default.
• W2952127798 citedByCount "18" @default.
• W2952127798 countsByYear W29521277982019 @default.
• W2952127798 countsByYear W29521277982020 @default.
• W2952127798 countsByYear W29521277982021 @default.
• W2952127798 countsByYear W29521277982022 @default.
• W2952127798 countsByYear W29521277982023 @default.
• W2952127798 crossrefType "proceedings-article" @default.
• W2952127798 hasAuthorship W2952127798A5010195521 @default.
• W2952127798 hasAuthorship W2952127798A5010245209 @default.
• W2952127798 hasAuthorship W2952127798A5020286799 @default.
• W2952127798 hasAuthorship W2952127798A5020697231 @default.
• W2952127798 hasAuthorship W2952127798A5031956439 @default.
• W2952127798 hasAuthorship W2952127798A5033271026 @default.
• W2952127798 hasAuthorship W2952127798A5039548707 @default.
• W2952127798 hasConcept C105795698 @default.
• W2952127798 hasConcept C111472728 @default.
• W2952127798 hasConcept C119857082 @default.
• W2952127798 hasConcept C121158502 @default.
• W2952127798 hasConcept C124101348 @default.
• W2952127798 hasConcept C129848803 @default.
• W2952127798 hasConcept C136197465 @default.
• W2952127798 hasConcept C138885662 @default.
• W2952127798 hasConcept C154945302 @default.
• W2952127798 hasConcept C161191863 @default.
• W2952127798 hasConcept C185592680 @default.
• W2952127798 hasConcept C198531522 @default.
• W2952127798 hasConcept C199360897 @default.
• W2952127798 hasConcept C2522767166 @default.
• W2952127798 hasConcept C2524010 @default.
• W2952127798 hasConcept C2777904410 @default.
• W2952127798 hasConcept C2779530757 @default.
• W2952127798 hasConcept C33923547 @default.
• W2952127798 hasConcept C41008148 @default.
• W2952127798 hasConcept C43617362 @default.
• W2952127798 hasConcept C90673727 @default.
• W2952127798 hasConceptScore W2952127798C105795698 @default.
• W2952127798 hasConceptScore W2952127798C111472728 @default.
• W2952127798 hasConceptScore W2952127798C119857082 @default.
• W2952127798 hasConceptScore W2952127798C121158502 @default.
• W2952127798 hasConceptScore W2952127798C124101348 @default.
• W2952127798 hasConceptScore W2952127798C129848803 @default.
• W2952127798 hasConceptScore W2952127798C136197465 @default.
• W2952127798 hasConceptScore W2952127798C138885662 @default.
• W2952127798 hasConceptScore W2952127798C154945302 @default.
• W2952127798 hasConceptScore W2952127798C161191863 @default.
• W2952127798 hasConceptScore W2952127798C185592680 @default.
• W2952127798 hasConceptScore W2952127798C198531522 @default.
• W2952127798 hasConceptScore W2952127798C199360897 @default.
• W2952127798 hasConceptScore W2952127798C2522767166 @default.
• W2952127798 hasConceptScore W2952127798C2524010 @default.
• W2952127798 hasConceptScore W2952127798C2777904410 @default.
• W2952127798 hasConceptScore W2952127798C2779530757 @default.
• W2952127798 hasConceptScore W2952127798C33923547 @default.
• W2952127798 hasConceptScore W2952127798C41008148 @default.
• W2952127798 hasConceptScore W2952127798C43617362 @default.
• W2952127798 hasConceptScore W2952127798C90673727 @default.
• W2952127798 hasLocation W29521277981 @default.
• W2952127798 hasOpenAccess W2952127798 @default.
• W2952127798 hasPrimaryLocation W29521277981 @default.
• W2952127798 hasRelatedWork W2107854016 @default.
• W2952127798 hasRelatedWork W2961085424 @default.
• W2952127798 hasRelatedWork W3046775127 @default.

• next