Matches in SemOpenAlex for { <https://semopenalex.org/work/W3155737070> ?p ?o ?g. }
- W3155737070 endingPage "2516" @default.
- W3155737070 startingPage "2502" @default.
- W3155737070 abstract "In artistic gymnastics, difficulty score or D-score is used for judging performance. Starting from zero, an athlete earns points from different aspects such as composition requirement, difficulty, and connection between moves. The final score is a composition of the quality of various performance indicators. Similarly, when evaluating dialogue responses, human judges generally follow a number of criteria, among which language fluency, context coherence, logical consistency, and semantic appropriateness are on top of the agenda. In this paper, we propose an automatic dialogue evaluation framework called D-score that resembles the way gymnastics is evaluated. Following the four human judging criteria above, we devise a range of evaluation tasks and model them under a multi-task learning framework. The proposed framework, without relying on any human-written reference, learns to appreciate the overall quality of human-human conversations through a representation that is shared by all tasks without over-fitting to individual task domain. We evaluate D-score by performing comprehensive correlation analyses with human judgement on three dialogue evaluation datasets, among which two are from past DSTC series, and benchmark against state-of-the-art baselines. D-score not only outperforms the best baseline by a large margin in terms of system-level Spearman correlation but also represents an important step towards explainable dialogue scoring." @default.
- W3155737070 created "2021-04-26" @default.
- W3155737070 creator A5002040636 @default.
- W3155737070 creator A5024161267 @default.
- W3155737070 creator A5032690182 @default.
- W3155737070 creator A5056020864 @default.
- W3155737070 date "2021-01-01" @default.
- W3155737070 modified "2023-10-02" @default.
- W3155737070 title "D-Score: Holistic Dialogue Evaluation Without Reference" @default.
- W3155737070 cites W2089150068 @default.
- W3155737070 cites W2093790824 @default.
- W3155737070 cites W2117130368 @default.
- W3155737070 cites W2133459682 @default.
- W3155737070 cites W2143104527 @default.
- W3155737070 cites W2250539671 @default.
- W3155737070 cites W2250767751 @default.
- W3155737070 cites W2295072214 @default.
- W3155737070 cites W2493916176 @default.
- W3155737070 cites W2608787653 @default.
- W3155737070 cites W2891717274 @default.
- W3155737070 cites W2904468521 @default.
- W3155737070 cites W2913340405 @default.
- W3155737070 cites W2916772188 @default.
- W3155737070 cites W2949423690 @default.
- W3155737070 cites W2951508633 @default.
- W3155737070 cites W2962717182 @default.
- W3155737070 cites W2962739339 @default.
- W3155737070 cites W2962784628 @default.
- W3155737070 cites W2962786758 @default.
- W3155737070 cites W2962974452 @default.
- W3155737070 cites W2962989446 @default.
- W3155737070 cites W2963466651 @default.
- W3155737070 cites W2963527228 @default.
- W3155737070 cites W2963640662 @default.
- W3155737070 cites W2963825865 @default.
- W3155737070 cites W2963903950 @default.
- W3155737070 cites W2963918774 @default.
- W3155737070 cites W2964352131 @default.
- W3155737070 cites W2979702391 @default.
- W3155737070 cites W2990563493 @default.
- W3155737070 cites W2995969307 @default.
- W3155737070 cites W2998494704 @default.
- W3155737070 cites W3034600233 @default.
- W3155737070 cites W3034715226 @default.
- W3155737070 cites W3034808773 @default.
- W3155737070 cites W3035252911 @default.
- W3155737070 cites W3035656139 @default.
- W3155737070 cites W3093632820 @default.
- W3155737070 cites W3104405162 @default.
- W3155737070 cites W77961983 @default.
- W3155737070 doi "https://doi.org/10.1109/taslp.2021.3074012" @default.
- W3155737070 hasPublicationYear "2021" @default.
- W3155737070 type Work @default.
- W3155737070 sameAs 3155737070 @default.
- W3155737070 citedByCount "4" @default.
- W3155737070 countsByYear W31557370702022 @default.
- W3155737070 countsByYear W31557370702023 @default.
- W3155737070 crossrefType "journal-article" @default.
- W3155737070 hasAuthorship W3155737070A5002040636 @default.
- W3155737070 hasAuthorship W3155737070A5024161267 @default.
- W3155737070 hasAuthorship W3155737070A5032690182 @default.
- W3155737070 hasAuthorship W3155737070A5056020864 @default.
- W3155737070 hasBestOaLocation W31557370701 @default.
- W3155737070 hasConcept C111368507 @default.
- W3155737070 hasConcept C111472728 @default.
- W3155737070 hasConcept C117220453 @default.
- W3155737070 hasConcept C119857082 @default.
- W3155737070 hasConcept C12725497 @default.
- W3155737070 hasConcept C127313418 @default.
- W3155737070 hasConcept C13280743 @default.
- W3155737070 hasConcept C138885662 @default.
- W3155737070 hasConcept C145420912 @default.
- W3155737070 hasConcept C151730666 @default.
- W3155737070 hasConcept C154945302 @default.
- W3155737070 hasConcept C15744967 @default.
- W3155737070 hasConcept C162324750 @default.
- W3155737070 hasConcept C17744445 @default.
- W3155737070 hasConcept C185798385 @default.
- W3155737070 hasConcept C187736073 @default.
- W3155737070 hasConcept C199539241 @default.
- W3155737070 hasConcept C204321447 @default.
- W3155737070 hasConcept C205649164 @default.
- W3155737070 hasConcept C2524010 @default.
- W3155737070 hasConcept C2776359362 @default.
- W3155737070 hasConcept C2776436953 @default.
- W3155737070 hasConcept C2776548248 @default.
- W3155737070 hasConcept C2777413886 @default.
- W3155737070 hasConcept C2779343474 @default.
- W3155737070 hasConcept C2779530757 @default.
- W3155737070 hasConcept C2780451532 @default.
- W3155737070 hasConcept C33923547 @default.
- W3155737070 hasConcept C41008148 @default.
- W3155737070 hasConcept C774472 @default.
- W3155737070 hasConcept C86803240 @default.
- W3155737070 hasConcept C94625758 @default.
- W3155737070 hasConceptScore W3155737070C111368507 @default.
- W3155737070 hasConceptScore W3155737070C111472728 @default.
- W3155737070 hasConceptScore W3155737070C117220453 @default.