Matches in SemOpenAlex for { <https://semopenalex.org/work/W4308692963> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4308692963 abstract "Large-scale assessments in education often involve the measurement of latent competence, with the aim to perform comparisons between groups in subsequent analyses. The assessment of latent competence is thereby often performed within the institutionalized context of schools, or with the help of interviewers visiting respondents’ homes. In addition, sample selection for educational assessments might focus on groups as sampling units. For example, German secondary school types are used as primary sampling units in a multi-stage sampling procedure in educational studies. Subsequently, several schools per school type are selected for student competence assessment and in consequence, students are nested within clusters of schools. Hence, hierarchical data structures in large-scale educational assessments are caused by contexts of assessments, the sampling design or the combination of both. Regarding the resulting measures of latent competence, construct-irrelevant variance could be introduced by the context of educational assessments in the form of variance between clusters. This can potentially reduce the quality of measurement and impair a fair and valid interpretation of test scores. Further uncertainty in latent competence assessment arises by using as set of item indicators to measure the latent trait of interest. Besides the overall latent trait, also single items can vary by assessment contexts, indicated by random item effects that denote item variation across clusters. In addition, item differences can occur between groups (i.e., fixed item effects) and, if severe, indicate measurement non-invariance in the form of differential item functioning between groups. Item bias is indicated when item differences between groups favor a particular group. If item bias is found between groups that were used as sampling units (e.g., school type), item bias is associated with the context of competence assessment. Hence, group differences of items are then found on the cluster-level of the hierarchical data structure. For the detection of such sources of construct-irrelevant variance stemming from the assessment context, as well as item bias and item variances associated with the assessment context, multilevel latent variable models are presented and applied to competence and cognitive ability assessments. Competence measurements in the domains mathematic and reading are examined, as well as a measure of the cognitive ability perceptual speed, all assessed within the National Educational Panel Study. In the first study, interviewer and area clusters were investigated in an adult mathematic competence assessment, as hierarchical structures that might introduce construct-irrelevant variance. The examination of cross-classified multilevel item response theory models showed substantial interviewer variance in mathematic competence, while area effects were small. Subsequent analyses revealed some interviewers with undue influence, that were in addition associated with the respondents’ number of missing values in the assessed test and participation rates at the subsequent competence assessment. The second study investigated consequences of item bias, in the form of cluster-level group differences in items by school type, for students reading competence development from fifth to ninth grade of German secondary school. Measurement non-invariance occurred especially between the highest and lowest school type of German secondary schools at all measurement occasions. Nevertheless, the school type comparisons of reading competence development were not sensitive to found measurement non-invariance between school types and a parallel development of reading competence between German secondary school types was presented. In the third study, in addition to cluster-level group differences in item estimates by school type (i.e., fixed item effects), also random item effects across school clusters per school type were investigated for three items measuring perceptual speed for German secondary school students at ninth grade. Fixed- and random-group differential item functioning was investigated in comparison of students from several types of regular schools and students with special educational needs. Random-group differential item functioning was found for two out of the three items, indicating that estimated item difficulties differed across school clusters. Such differences across assessment contexts (i.e., school clusters) might stem from problems of standardized test assessment. Finally, the results of the three studies are discussed with regard to test standards for educational and psychological testing. The results are furthermore compared to empirical evaluations of context effects in other educational large-scale assessments." @default.
- W4308692963 created "2022-11-14" @default.
- W4308692963 creator A5000087792 @default.
- W4308692963 date "2022-11-10" @default.
- W4308692963 modified "2023-10-14" @default.
- W4308692963 title "Analyzing the context of large-scale educational assessments using multilevel latent variable modeling" @default.
- W4308692963 doi "https://doi.org/10.20378/irb-55904" @default.
- W4308692963 hasPublicationYear "2022" @default.
- W4308692963 type Work @default.
- W4308692963 citedByCount "0" @default.
- W4308692963 crossrefType "dissertation" @default.
- W4308692963 hasAuthorship W4308692963A5000087792 @default.
- W4308692963 hasBestOaLocation W43086929631 @default.
- W4308692963 hasConcept C100521375 @default.
- W4308692963 hasConcept C105795698 @default.
- W4308692963 hasConcept C106934330 @default.
- W4308692963 hasConcept C138496976 @default.
- W4308692963 hasConcept C15744967 @default.
- W4308692963 hasConcept C1589151 @default.
- W4308692963 hasConcept C171606756 @default.
- W4308692963 hasConcept C181447626 @default.
- W4308692963 hasConcept C19875794 @default.
- W4308692963 hasConcept C199360897 @default.
- W4308692963 hasConcept C207968926 @default.
- W4308692963 hasConcept C33923547 @default.
- W4308692963 hasConcept C40722632 @default.
- W4308692963 hasConcept C41008148 @default.
- W4308692963 hasConcept C51167844 @default.
- W4308692963 hasConcept C53059260 @default.
- W4308692963 hasConcept C70727504 @default.
- W4308692963 hasConcept C71104824 @default.
- W4308692963 hasConcept C77805123 @default.
- W4308692963 hasConceptScore W4308692963C100521375 @default.
- W4308692963 hasConceptScore W4308692963C105795698 @default.
- W4308692963 hasConceptScore W4308692963C106934330 @default.
- W4308692963 hasConceptScore W4308692963C138496976 @default.
- W4308692963 hasConceptScore W4308692963C15744967 @default.
- W4308692963 hasConceptScore W4308692963C1589151 @default.
- W4308692963 hasConceptScore W4308692963C171606756 @default.
- W4308692963 hasConceptScore W4308692963C181447626 @default.
- W4308692963 hasConceptScore W4308692963C19875794 @default.
- W4308692963 hasConceptScore W4308692963C199360897 @default.
- W4308692963 hasConceptScore W4308692963C207968926 @default.
- W4308692963 hasConceptScore W4308692963C33923547 @default.
- W4308692963 hasConceptScore W4308692963C40722632 @default.
- W4308692963 hasConceptScore W4308692963C41008148 @default.
- W4308692963 hasConceptScore W4308692963C51167844 @default.
- W4308692963 hasConceptScore W4308692963C53059260 @default.
- W4308692963 hasConceptScore W4308692963C70727504 @default.
- W4308692963 hasConceptScore W4308692963C71104824 @default.
- W4308692963 hasConceptScore W4308692963C77805123 @default.
- W4308692963 hasLocation W43086929631 @default.
- W4308692963 hasOpenAccess W4308692963 @default.
- W4308692963 hasPrimaryLocation W43086929631 @default.
- W4308692963 hasRelatedWork W1230967497 @default.
- W4308692963 hasRelatedWork W1973905307 @default.
- W4308692963 hasRelatedWork W1976766035 @default.
- W4308692963 hasRelatedWork W2056587526 @default.
- W4308692963 hasRelatedWork W2570722182 @default.
- W4308692963 hasRelatedWork W2914729284 @default.
- W4308692963 hasRelatedWork W3014938911 @default.
- W4308692963 hasRelatedWork W3088594873 @default.
- W4308692963 hasRelatedWork W4308692963 @default.
- W4308692963 hasRelatedWork W4318617505 @default.
- W4308692963 isParatext "false" @default.
- W4308692963 isRetracted "false" @default.
- W4308692963 workType "dissertation" @default.