Matches in SemOpenAlex for { <https://semopenalex.org/work/W231448966> ?p ?o ?g. }
- W231448966 startingPage "28" @default.
- W231448966 abstract "Despite its widespread use in evaluation data analysis, Null Hypothesis Testing (NHST) has come under persistent criticism resulting in calls for its rethinking, and even possible elimination (Carver, 1978, 1993; Hunter, 1997; Rozeboom, 1960; Schmidt, 1996; Schmidt & Hunter, 1997). As a result, a consensus is beginning emerge that testing, with its strange backward logic and slippery terminology, is generally not well understood by practitioners (Zuckerman, Hodgins, Zuckerman, & Rosenthal, 1993). Critics also claim that tests are overused in a mindless and mechanistic way and interpreted in ways which cannot be supported (Rozeboom, 1997). Others (Cortina & Dunlap, 1997; Frick, 1996; Macdonald, 2002) maintain it is important have a grasp of tests because they are so commonly reported in evaluation and research reports. They conclude that tests have some value and should be rethought rather than eliminated. A real-life example may help illustrate the tension in the testing debate.Amanda teaches two basic writing classes, and this semester she tried an innovation in one class but not the other. Both of the classes are fairly similar, and Amanda used the same end-of-semester test in both classes. She thought the class in which she used the innovation would score higher on the test. After the final compositions were scored, Amanda found that her innovation class did, in fact, score higher than the other class. A friend told her do a statistical test on the scores between the two classes. A manda wasn't sure what it would show, but she conducted a Mest. Her results were t = 4.349, df= 9, p To understand what Amanda wants know, one must first become acquainted with tests, which are a family of statistical procedures for determining the probability or likelihood of achieving certain results. Because these statistical procedures involve a comparison between the actual scores and a hypothesized relationship, they are often referred as Null Hypothesis Testing; (Huberty & Pike, 1999). A null hypothesis states that there is no relationship between the results. NHST is commonly used in studies which report score data (cf., Boylan, Bliss, & Bonham, 1997).Saxon and Boylan issue a call to strengthen developmental education research and make it more accessible (2003, p. 2). Among the types of research they consider appropriate is that which uses control group methodology. This paper responds their suggestion and tries make NHST, an important tool in control group methodology, more accessible. The purpose of this paper is explain NHST, state what tests can and cannot tell us, and make practical recommendations for their use. This paper is not a step-by-step procedure for conducting a test. For that, see general statistical textbooks such as Sirkin (1999, p. 217). Nor does this paper promote quantitative data at the expense of qualitative data. The following questions will be discussed:1. What does the term significance mean?2. What is a test?3. What does a test tell us?4. What does a test not tell us?5. What recommendations can we make for using and interpreting NHST?What Does the Term Significance Mean?In ordinary language, indicates meaning or importance. In evaluation and assessment, however, because of the ambiguity of language, we have be more specific when we talk about evaluation results. Substantive or practical can be used describe any research finding that is useful or that can have an effect on our practice. This is ajudgment call, and thus there is no cut and dried test for substantive (Vogt, 1999, p. …" @default.
- W231448966 created "2016-06-24" @default.
- W231448966 creator A5080470999 @default.
- W231448966 date "2004-04-01" @default.
- W231448966 modified "2023-09-27" @default.
- W231448966 title "Research in Practice: Understanding Significance Testing Program Evaluation" @default.
- W231448966 cites W1913875882 @default.
- W231448966 cites W1969580991 @default.
- W231448966 cites W1976163365 @default.
- W231448966 cites W1980957386 @default.
- W231448966 cites W1982364381 @default.
- W231448966 cites W2015968801 @default.
- W231448966 cites W2019357286 @default.
- W231448966 cites W2023971322 @default.
- W231448966 cites W2024086275 @default.
- W231448966 cites W2076930812 @default.
- W231448966 cites W2078741755 @default.
- W231448966 cites W2079297380 @default.
- W231448966 cites W2088228990 @default.
- W231448966 cites W2090822039 @default.
- W231448966 cites W2094675405 @default.
- W231448966 cites W2094987047 @default.
- W231448966 cites W2101132953 @default.
- W231448966 cites W2102634733 @default.
- W231448966 cites W2108753729 @default.
- W231448966 cites W2111096139 @default.
- W231448966 cites W2127537241 @default.
- W231448966 cites W2131251797 @default.
- W231448966 cites W2131688422 @default.
- W231448966 cites W2734264286 @default.
- W231448966 cites W1965436337 @default.
- W231448966 hasPublicationYear "2004" @default.
- W231448966 type Work @default.
- W231448966 sameAs 231448966 @default.
- W231448966 citedByCount "2" @default.
- W231448966 countsByYear W2314489662015 @default.
- W231448966 crossrefType "journal-article" @default.
- W231448966 hasAuthorship W231448966A5080470999 @default.
- W231448966 hasConcept C105795698 @default.
- W231448966 hasConcept C111472728 @default.
- W231448966 hasConcept C124952713 @default.
- W231448966 hasConcept C138885662 @default.
- W231448966 hasConcept C142362112 @default.
- W231448966 hasConcept C145420912 @default.
- W231448966 hasConcept C151730666 @default.
- W231448966 hasConcept C15744967 @default.
- W231448966 hasConcept C191988596 @default.
- W231448966 hasConcept C2777212361 @default.
- W231448966 hasConcept C2777267654 @default.
- W231448966 hasConcept C33923547 @default.
- W231448966 hasConcept C41895202 @default.
- W231448966 hasConcept C547195049 @default.
- W231448966 hasConcept C7991579 @default.
- W231448966 hasConcept C86803240 @default.
- W231448966 hasConcept C87007009 @default.
- W231448966 hasConceptScore W231448966C105795698 @default.
- W231448966 hasConceptScore W231448966C111472728 @default.
- W231448966 hasConceptScore W231448966C124952713 @default.
- W231448966 hasConceptScore W231448966C138885662 @default.
- W231448966 hasConceptScore W231448966C142362112 @default.
- W231448966 hasConceptScore W231448966C145420912 @default.
- W231448966 hasConceptScore W231448966C151730666 @default.
- W231448966 hasConceptScore W231448966C15744967 @default.
- W231448966 hasConceptScore W231448966C191988596 @default.
- W231448966 hasConceptScore W231448966C2777212361 @default.
- W231448966 hasConceptScore W231448966C2777267654 @default.
- W231448966 hasConceptScore W231448966C33923547 @default.
- W231448966 hasConceptScore W231448966C41895202 @default.
- W231448966 hasConceptScore W231448966C547195049 @default.
- W231448966 hasConceptScore W231448966C7991579 @default.
- W231448966 hasConceptScore W231448966C86803240 @default.
- W231448966 hasConceptScore W231448966C87007009 @default.
- W231448966 hasIssue "3" @default.
- W231448966 hasLocation W2314489661 @default.
- W231448966 hasOpenAccess W231448966 @default.
- W231448966 hasPrimaryLocation W2314489661 @default.
- W231448966 hasRelatedWork W1518705534 @default.
- W231448966 hasRelatedWork W1682149967 @default.
- W231448966 hasRelatedWork W1975361274 @default.
- W231448966 hasRelatedWork W2004097205 @default.
- W231448966 hasRelatedWork W2033886292 @default.
- W231448966 hasRelatedWork W2061672714 @default.
- W231448966 hasRelatedWork W2095492232 @default.
- W231448966 hasRelatedWork W2124331289 @default.
- W231448966 hasRelatedWork W2126944142 @default.
- W231448966 hasRelatedWork W2170756766 @default.
- W231448966 hasRelatedWork W2185103196 @default.
- W231448966 hasRelatedWork W2256903694 @default.
- W231448966 hasRelatedWork W2521110250 @default.
- W231448966 hasRelatedWork W2605943730 @default.
- W231448966 hasRelatedWork W2924557387 @default.
- W231448966 hasRelatedWork W295165651 @default.
- W231448966 hasRelatedWork W3124463323 @default.
- W231448966 hasRelatedWork W3147492965 @default.
- W231448966 hasRelatedWork W34302804 @default.
- W231448966 hasRelatedWork W818180698 @default.
- W231448966 hasVolume "27" @default.
- W231448966 isParatext "false" @default.
- W231448966 isRetracted "false" @default.