Matches in SemOpenAlex for { <https://semopenalex.org/work/W2922473706> ?p ?o ?g. }
- W2922473706 abstract "Stakeholders’ interpretations of the findings of large-scale educational assessments can influence important decisions. In the context of educational assessment, standard-setting remains an especially critical element, because it is complex and largely unstandardized. Instruments established by means of standard-setting procedures such as proficiency levels (PL) therefore appear to be arbitrary to some degree. Owing to the significance such results take on, when they are communicated to stakeholders or the public, a thorough validation of this process seems crucial. In our study, ministry stakeholders intended to use PL established in an assessment of science abilities to obtain information about students’ strengths and weaknesses regarding science abilities in general and specifically about the extent to which they were prepared for future science studies. The aim of our study was to investigate the validity arguments regarding these two intended interpretations. Based on a university science test administered to 3641 upper secondary students (Grade 13), a panel of nine experts set four cut scores using two variations of the Angoff method, the Yes/No Angoff method (multiple choice items) and the extended Angoff method (complex multiple choice items). We carried out t-tests, repeated measures ANOVA, G-studies and regression analyses to support the procedural, internal, external, and consequential validity elements regarding the aforementioned interpretations of the cut scores. Our t-tests and G-studies showed that the intended use of the cut scores was valid regarding procedural and internal aspects of validity. These findings were called into question by the experts’ lack of confidence in the established cut scores. Regression analyses including number of lessons taught and intended and pursued science-related studies showed good external and poor consequential validity. The cut scores can be used as an indicator of 13th graders’ strengths and weaknesses in science. They should not be used as an indicator for preparedness for science university studies. Since assessment formats are continually evolving and consequently leading to more complex designs, further research needs to be conducted on the application of new standard-setting methods to meet the challenges arising from this development." @default.
- W2922473706 created "2019-03-22" @default.
- W2922473706 creator A5009378142 @default.
- W2922473706 creator A5036302984 @default.
- W2922473706 creator A5065278851 @default.
- W2922473706 date "2019-02-18" @default.
- W2922473706 modified "2023-10-14" @default.
- W2922473706 title "The standard setting process: validating interpretations of stakeholders" @default.
- W2922473706 cites W1704942559 @default.
- W2922473706 cites W1964218847 @default.
- W2922473706 cites W1976172684 @default.
- W2922473706 cites W1982051553 @default.
- W2922473706 cites W1992518871 @default.
- W2922473706 cites W1993634387 @default.
- W2922473706 cites W2016718436 @default.
- W2922473706 cites W2028829385 @default.
- W2922473706 cites W2034583395 @default.
- W2922473706 cites W2035515578 @default.
- W2922473706 cites W2047242223 @default.
- W2922473706 cites W2058007749 @default.
- W2922473706 cites W2059433494 @default.
- W2922473706 cites W2069479750 @default.
- W2922473706 cites W2086336991 @default.
- W2922473706 cites W2107229891 @default.
- W2922473706 cites W2154666357 @default.
- W2922473706 cites W2155636727 @default.
- W2922473706 cites W2156832302 @default.
- W2922473706 cites W2164777277 @default.
- W2922473706 cites W2170481154 @default.
- W2922473706 cites W2208643995 @default.
- W2922473706 cites W2319531873 @default.
- W2922473706 cites W2325958708 @default.
- W2922473706 cites W2561012062 @default.
- W2922473706 cites W2573498121 @default.
- W2922473706 cites W26616773 @default.
- W2922473706 cites W4238804190 @default.
- W2922473706 doi "https://doi.org/10.1186/s40536-019-0071-8" @default.
- W2922473706 hasPublicationYear "2019" @default.
- W2922473706 type Work @default.
- W2922473706 sameAs 2922473706 @default.
- W2922473706 citedByCount "2" @default.
- W2922473706 countsByYear W29224737062020 @default.
- W2922473706 countsByYear W29224737062021 @default.
- W2922473706 crossrefType "journal-article" @default.
- W2922473706 hasAuthorship W2922473706A5009378142 @default.
- W2922473706 hasAuthorship W2922473706A5036302984 @default.
- W2922473706 hasAuthorship W2922473706A5065278851 @default.
- W2922473706 hasBestOaLocation W29224737061 @default.
- W2922473706 hasConcept C111919701 @default.
- W2922473706 hasConcept C121332964 @default.
- W2922473706 hasConcept C145420912 @default.
- W2922473706 hasConcept C151730666 @default.
- W2922473706 hasConcept C15744967 @default.
- W2922473706 hasConcept C177264268 @default.
- W2922473706 hasConcept C17744445 @default.
- W2922473706 hasConcept C199360897 @default.
- W2922473706 hasConcept C199539241 @default.
- W2922473706 hasConcept C2777267654 @default.
- W2922473706 hasConcept C2778755073 @default.
- W2922473706 hasConcept C2779343474 @default.
- W2922473706 hasConcept C41008148 @default.
- W2922473706 hasConcept C509550671 @default.
- W2922473706 hasConcept C521751864 @default.
- W2922473706 hasConcept C62520636 @default.
- W2922473706 hasConcept C63882131 @default.
- W2922473706 hasConcept C71924100 @default.
- W2922473706 hasConcept C75630572 @default.
- W2922473706 hasConcept C77805123 @default.
- W2922473706 hasConcept C86803240 @default.
- W2922473706 hasConcept C98045186 @default.
- W2922473706 hasConceptScore W2922473706C111919701 @default.
- W2922473706 hasConceptScore W2922473706C121332964 @default.
- W2922473706 hasConceptScore W2922473706C145420912 @default.
- W2922473706 hasConceptScore W2922473706C151730666 @default.
- W2922473706 hasConceptScore W2922473706C15744967 @default.
- W2922473706 hasConceptScore W2922473706C177264268 @default.
- W2922473706 hasConceptScore W2922473706C17744445 @default.
- W2922473706 hasConceptScore W2922473706C199360897 @default.
- W2922473706 hasConceptScore W2922473706C199539241 @default.
- W2922473706 hasConceptScore W2922473706C2777267654 @default.
- W2922473706 hasConceptScore W2922473706C2778755073 @default.
- W2922473706 hasConceptScore W2922473706C2779343474 @default.
- W2922473706 hasConceptScore W2922473706C41008148 @default.
- W2922473706 hasConceptScore W2922473706C509550671 @default.
- W2922473706 hasConceptScore W2922473706C521751864 @default.
- W2922473706 hasConceptScore W2922473706C62520636 @default.
- W2922473706 hasConceptScore W2922473706C63882131 @default.
- W2922473706 hasConceptScore W2922473706C71924100 @default.
- W2922473706 hasConceptScore W2922473706C75630572 @default.
- W2922473706 hasConceptScore W2922473706C77805123 @default.
- W2922473706 hasConceptScore W2922473706C86803240 @default.
- W2922473706 hasConceptScore W2922473706C98045186 @default.
- W2922473706 hasLocation W29224737061 @default.
- W2922473706 hasOpenAccess W2922473706 @default.
- W2922473706 hasPrimaryLocation W29224737061 @default.
- W2922473706 hasRelatedWork W12409867 @default.
- W2922473706 hasRelatedWork W16486869 @default.
- W2922473706 hasRelatedWork W17833990 @default.
- W2922473706 hasRelatedWork W17851021 @default.
- W2922473706 hasRelatedWork W2382990 @default.