Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385152092> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W4385152092 endingPage "2898" @default.
- W4385152092 startingPage "2886" @default.
- W4385152092 abstract "In a subjective task, such as Spoken Language Assessment (SLA), the reference scores provided by different human raters may vary. A collection of annotated scores from multiple raters can be interpreted as an expression of data uncertainty. Previous studies often treat SLA as classification or regression tasks, and train and evaluate models against scalar reference scores that were computed from the multiple rater scores, for example by majority voting. However, a scalar representation may not adequately capture information about uncertainty that is expressed by the multiple rater scores. This paper proposes to reformulate this subjective task as a distribution fitting problem, where the model should aim to emulate the uncertainty expressed by the multiple raters. Toward this aim, the model is trained and evaluated by computing a distance between the model's output posterior and the distribution of reference scores from the multiple raters. Different methods to infer a scalar score from the model's output posterior are also considered. This paper also proposes to improve the match between the model and the SLA task, by interpreting the model's outputs as parameters of a beta density function, to capture both uncertainty and score monotonicity. Finally, ensemble combination is investigated and a novel combination method is proposed, to marginalise out model uncertainty from the combined output distribution. These approaches are evaluated on the speechocean762 dataset and an in-house Tamil dataset." @default.
- W4385152092 created "2023-07-23" @default.
- W4385152092 creator A5014190404 @default.
- W4385152092 creator A5023952623 @default.
- W4385152092 creator A5048201022 @default.
- W4385152092 date "2023-01-01" @default.
- W4385152092 modified "2023-09-26" @default.
- W4385152092 title "Modelling Inter-Rater Uncertainty in Spoken Language Assessment" @default.
- W4385152092 cites W12857174 @default.
- W4385152092 cites W1494198834 @default.
- W4385152092 cites W1528470941 @default.
- W4385152092 cites W1531333757 @default.
- W4385152092 cites W1904457459 @default.
- W4385152092 cites W1976526581 @default.
- W4385152092 cites W1988790447 @default.
- W4385152092 cites W1991133427 @default.
- W4385152092 cites W2030026461 @default.
- W4385152092 cites W2034537249 @default.
- W4385152092 cites W2064675550 @default.
- W4385152092 cites W2085628288 @default.
- W4385152092 cites W2088538739 @default.
- W4385152092 cites W2091856355 @default.
- W4385152092 cites W2097137621 @default.
- W4385152092 cites W2105906164 @default.
- W4385152092 cites W2115055261 @default.
- W4385152092 cites W2117671523 @default.
- W4385152092 cites W2139008940 @default.
- W4385152092 cites W2144920829 @default.
- W4385152092 cites W2146334809 @default.
- W4385152092 cites W2161278885 @default.
- W4385152092 cites W2164810574 @default.
- W4385152092 cites W2395106899 @default.
- W4385152092 cites W2398423749 @default.
- W4385152092 cites W2402040300 @default.
- W4385152092 cites W2514741789 @default.
- W4385152092 cites W2729190387 @default.
- W4385152092 cites W2739575494 @default.
- W4385152092 cites W2749848124 @default.
- W4385152092 cites W2911546748 @default.
- W4385152092 cites W2914769449 @default.
- W4385152092 cites W2950170869 @default.
- W4385152092 cites W2963505832 @default.
- W4385152092 cites W3015870704 @default.
- W4385152092 cites W3037150633 @default.
- W4385152092 cites W3096195729 @default.
- W4385152092 cites W3096582851 @default.
- W4385152092 cites W3196891430 @default.
- W4385152092 cites W3197474936 @default.
- W4385152092 cites W3197742413 @default.
- W4385152092 cites W34303869 @default.
- W4385152092 cites W4240665608 @default.
- W4385152092 cites W4241644338 @default.
- W4385152092 cites W811578723 @default.
- W4385152092 doi "https://doi.org/10.1109/taslp.2023.3297958" @default.
- W4385152092 hasPublicationYear "2023" @default.
- W4385152092 type Work @default.
- W4385152092 citedByCount "0" @default.
- W4385152092 crossrefType "journal-article" @default.
- W4385152092 hasAuthorship W4385152092A5014190404 @default.
- W4385152092 hasAuthorship W4385152092A5023952623 @default.
- W4385152092 hasAuthorship W4385152092A5048201022 @default.
- W4385152092 hasConcept C119857082 @default.
- W4385152092 hasConcept C154945302 @default.
- W4385152092 hasConcept C162324750 @default.
- W4385152092 hasConcept C187736073 @default.
- W4385152092 hasConcept C204321447 @default.
- W4385152092 hasConcept C2524010 @default.
- W4385152092 hasConcept C2780451532 @default.
- W4385152092 hasConcept C33923547 @default.
- W4385152092 hasConcept C41008148 @default.
- W4385152092 hasConcept C57691317 @default.
- W4385152092 hasConceptScore W4385152092C119857082 @default.
- W4385152092 hasConceptScore W4385152092C154945302 @default.
- W4385152092 hasConceptScore W4385152092C162324750 @default.
- W4385152092 hasConceptScore W4385152092C187736073 @default.
- W4385152092 hasConceptScore W4385152092C204321447 @default.
- W4385152092 hasConceptScore W4385152092C2524010 @default.
- W4385152092 hasConceptScore W4385152092C2780451532 @default.
- W4385152092 hasConceptScore W4385152092C33923547 @default.
- W4385152092 hasConceptScore W4385152092C41008148 @default.
- W4385152092 hasConceptScore W4385152092C57691317 @default.
- W4385152092 hasLocation W43851520921 @default.
- W4385152092 hasOpenAccess W4385152092 @default.
- W4385152092 hasPrimaryLocation W43851520921 @default.
- W4385152092 hasRelatedWork W2081647779 @default.
- W4385152092 hasRelatedWork W2961085424 @default.
- W4385152092 hasRelatedWork W3046775127 @default.
- W4385152092 hasRelatedWork W3170094116 @default.
- W4385152092 hasRelatedWork W4205958290 @default.
- W4385152092 hasRelatedWork W4285260836 @default.
- W4385152092 hasRelatedWork W4286629047 @default.
- W4385152092 hasRelatedWork W4306321456 @default.
- W4385152092 hasRelatedWork W4306674287 @default.
- W4385152092 hasRelatedWork W4224009465 @default.
- W4385152092 hasVolume "31" @default.
- W4385152092 isParatext "false" @default.
- W4385152092 isRetracted "false" @default.
- W4385152092 workType "article" @default.