Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385571142> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4385571142 abstract "Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity.Moreover, methods and labels in dialogue evaluation are not fully standardized, especially for open-domain chats, with a lack of work to compare and assess the validity of those approaches.The use of inconsistent evaluation can misinform the performance of a dialogue system, which becomes a major hurdle to enhance it.Thus, a dimensional evaluation of chat-oriented open-domain dialogue systems that reliably measures several aspects of dialogue capabilities is desired.This paper presents a novel human evaluation method to estimate the rates of many{pasted macro ‘LN’} dialogue system behaviors.Our method is used to evaluate four state-of-the-art open-domain dialogue systems and compared with existing approaches.The analysis demonstrates that our behavior method is more suitable than alternative Likert-style or comparative approaches for dimensional evaluation of these systems." @default.
- W4385571142 created "2023-08-05" @default.
- W4385571142 creator A5049461287 @default.
- W4385571142 creator A5051928055 @default.
- W4385571142 creator A5062928944 @default.
- W4385571142 date "2023-01-01" @default.
- W4385571142 modified "2023-09-24" @default.
- W4385571142 title "Don’t Forget Your ABC’s: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems" @default.
- W4385571142 doi "https://doi.org/10.18653/v1/2023.acl-long.839" @default.
- W4385571142 hasPublicationYear "2023" @default.
- W4385571142 type Work @default.
- W4385571142 citedByCount "0" @default.
- W4385571142 crossrefType "proceedings-article" @default.
- W4385571142 hasAuthorship W4385571142A5049461287 @default.
- W4385571142 hasAuthorship W4385571142A5051928055 @default.
- W4385571142 hasAuthorship W4385571142A5062928944 @default.
- W4385571142 hasBestOaLocation W43855711421 @default.
- W4385571142 hasConcept C105776082 @default.
- W4385571142 hasConcept C107457646 @default.
- W4385571142 hasConcept C121955636 @default.
- W4385571142 hasConcept C134306372 @default.
- W4385571142 hasConcept C138496976 @default.
- W4385571142 hasConcept C144133560 @default.
- W4385571142 hasConcept C154945302 @default.
- W4385571142 hasConcept C15744967 @default.
- W4385571142 hasConcept C196083921 @default.
- W4385571142 hasConcept C199360897 @default.
- W4385571142 hasConcept C2993776861 @default.
- W4385571142 hasConcept C33923547 @default.
- W4385571142 hasConcept C36503486 @default.
- W4385571142 hasConcept C41008148 @default.
- W4385571142 hasConcept C44291984 @default.
- W4385571142 hasConcept C48103436 @default.
- W4385571142 hasConceptScore W4385571142C105776082 @default.
- W4385571142 hasConceptScore W4385571142C107457646 @default.
- W4385571142 hasConceptScore W4385571142C121955636 @default.
- W4385571142 hasConceptScore W4385571142C134306372 @default.
- W4385571142 hasConceptScore W4385571142C138496976 @default.
- W4385571142 hasConceptScore W4385571142C144133560 @default.
- W4385571142 hasConceptScore W4385571142C154945302 @default.
- W4385571142 hasConceptScore W4385571142C15744967 @default.
- W4385571142 hasConceptScore W4385571142C196083921 @default.
- W4385571142 hasConceptScore W4385571142C199360897 @default.
- W4385571142 hasConceptScore W4385571142C2993776861 @default.
- W4385571142 hasConceptScore W4385571142C33923547 @default.
- W4385571142 hasConceptScore W4385571142C36503486 @default.
- W4385571142 hasConceptScore W4385571142C41008148 @default.
- W4385571142 hasConceptScore W4385571142C44291984 @default.
- W4385571142 hasConceptScore W4385571142C48103436 @default.
- W4385571142 hasLocation W43855711421 @default.
- W4385571142 hasOpenAccess W4385571142 @default.
- W4385571142 hasPrimaryLocation W43855711421 @default.
- W4385571142 hasRelatedWork W1991466308 @default.
- W4385571142 hasRelatedWork W2362192218 @default.
- W4385571142 hasRelatedWork W2559338413 @default.
- W4385571142 hasRelatedWork W2623347760 @default.
- W4385571142 hasRelatedWork W2743342830 @default.
- W4385571142 hasRelatedWork W2757542827 @default.
- W4385571142 hasRelatedWork W2801011252 @default.
- W4385571142 hasRelatedWork W2883555950 @default.
- W4385571142 hasRelatedWork W3034138874 @default.
- W4385571142 hasRelatedWork W4246426965 @default.
- W4385571142 isParatext "false" @default.
- W4385571142 isRetracted "false" @default.
- W4385571142 workType "article" @default.