Matches in SemOpenAlex for { <https://semopenalex.org/work/W4308505488> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4308505488 abstract "There is a well-known problem in Null Hypothesis Significance Testing: many statistically significant results fail to replicate in subsequent experiments. We show that this problem arises because standard `point-form null' significance tests consider only within-experiment but ignore between-experiment variation, and so systematically underestimate the degree of random variation in results. We give an extension to standard significance testing that addresses this problem by analysing both within- and between-experiment variation. This `distributional null' approach does not underestimate experimental variability and so is not overconfident in identifying significance; because this approach addresses between-experiment variation, it gives mathematically coherent estimates for the probability of replication of significant results. Using a large-scale replication dataset (the first `Many Labs' project), we show that many experimental results that appear statistically significant in standard tests are in fact consistent with random variation when both within- and between-experiment variation are taken into account in this approach. Further, grouping experiments in this dataset into `predictor-target' pairs we show that the predicted replication probabilities for target experiments produced in this approach (given predictor experiment results and the sample sizes of the two experiments) are strongly correlated with observed replication rates. Distributional null hypothesis testing thus gives researchers a statistical tool for identifying statistically significant and reliably replicable results." @default.
- W4308505488 created "2022-11-12" @default.
- W4308505488 creator A5003777200 @default.
- W4308505488 creator A5044724458 @default.
- W4308505488 date "2022-11-04" @default.
- W4308505488 modified "2023-09-23" @default.
- W4308505488 title "How to Tell When a Result Will Replicate: Significance and Replication in Distributional Null Hypothesis Tests" @default.
- W4308505488 doi "https://doi.org/10.48550/arxiv.2211.02609" @default.
- W4308505488 hasPublicationYear "2022" @default.
- W4308505488 type Work @default.
- W4308505488 citedByCount "0" @default.
- W4308505488 crossrefType "posted-content" @default.
- W4308505488 hasAuthorship W4308505488A5003777200 @default.
- W4308505488 hasAuthorship W4308505488A5044724458 @default.
- W4308505488 hasBestOaLocation W43085054881 @default.
- W4308505488 hasConcept C105795698 @default.
- W4308505488 hasConcept C114614502 @default.
- W4308505488 hasConcept C120577422 @default.
- W4308505488 hasConcept C121332964 @default.
- W4308505488 hasConcept C124101348 @default.
- W4308505488 hasConcept C12590798 @default.
- W4308505488 hasConcept C129848803 @default.
- W4308505488 hasConcept C149782125 @default.
- W4308505488 hasConcept C191988596 @default.
- W4308505488 hasConcept C203763787 @default.
- W4308505488 hasConcept C2778334786 @default.
- W4308505488 hasConcept C2781162219 @default.
- W4308505488 hasConcept C33923547 @default.
- W4308505488 hasConcept C36382193 @default.
- W4308505488 hasConcept C41008148 @default.
- W4308505488 hasConcept C44870925 @default.
- W4308505488 hasConcept C65409693 @default.
- W4308505488 hasConcept C87007009 @default.
- W4308505488 hasConcept C96608239 @default.
- W4308505488 hasConceptScore W4308505488C105795698 @default.
- W4308505488 hasConceptScore W4308505488C114614502 @default.
- W4308505488 hasConceptScore W4308505488C120577422 @default.
- W4308505488 hasConceptScore W4308505488C121332964 @default.
- W4308505488 hasConceptScore W4308505488C124101348 @default.
- W4308505488 hasConceptScore W4308505488C12590798 @default.
- W4308505488 hasConceptScore W4308505488C129848803 @default.
- W4308505488 hasConceptScore W4308505488C149782125 @default.
- W4308505488 hasConceptScore W4308505488C191988596 @default.
- W4308505488 hasConceptScore W4308505488C203763787 @default.
- W4308505488 hasConceptScore W4308505488C2778334786 @default.
- W4308505488 hasConceptScore W4308505488C2781162219 @default.
- W4308505488 hasConceptScore W4308505488C33923547 @default.
- W4308505488 hasConceptScore W4308505488C36382193 @default.
- W4308505488 hasConceptScore W4308505488C41008148 @default.
- W4308505488 hasConceptScore W4308505488C44870925 @default.
- W4308505488 hasConceptScore W4308505488C65409693 @default.
- W4308505488 hasConceptScore W4308505488C87007009 @default.
- W4308505488 hasConceptScore W4308505488C96608239 @default.
- W4308505488 hasLocation W43085054881 @default.
- W4308505488 hasLocation W43085054882 @default.
- W4308505488 hasOpenAccess W4308505488 @default.
- W4308505488 hasPrimaryLocation W43085054881 @default.
- W4308505488 hasRelatedWork W1963493069 @default.
- W4308505488 hasRelatedWork W2031117957 @default.
- W4308505488 hasRelatedWork W2031884339 @default.
- W4308505488 hasRelatedWork W2070378522 @default.
- W4308505488 hasRelatedWork W2979681497 @default.
- W4308505488 hasRelatedWork W3003558595 @default.
- W4308505488 hasRelatedWork W4245099416 @default.
- W4308505488 hasRelatedWork W4252747994 @default.
- W4308505488 hasRelatedWork W4295905522 @default.
- W4308505488 hasRelatedWork W4308505488 @default.
- W4308505488 isParatext "false" @default.
- W4308505488 isRetracted "false" @default.
- W4308505488 workType "article" @default.