Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320342620> ?p ?o ?g. }
Showing items 1 to 55 of
55
with 100 items per page.
- W4320342620 abstract "Many open-domain dialogue systems rely on multiple response generators, any of which can contribute a response to the dialogue in a particular context. Thus the ability to compare potential responses and then select the best plays an important role in ensuring a dialogue system is coherent and engaging. Dialogue coherence goes beyond simply remaining on topic -- some trivia may be on topic and engaging when mentioned out of the blue, but may not be coherent and grounded in the context of the conversation. We carry out experiments on response selection in the Athena system, an Alexa Prize SocialBot that has dedicated content and multiple topic-specific response generators for a large number of topics. First, we collect a corpus of Athena conversations with live human traffic, where potential responses from all enabled response generators are logged and subsequently annotated for response quality. We compare several off-the-shelf response ranking methods for open-domain dialogue to Athena-Heuristic, a heuristic response ranker that was field-tested in Athena during the third Alexa Prize competition. We also compare these to a transformer-based response ranker we call Athena-RR, that we train on our Athena conversations. Athena-RR uses both the conversational context and the dialogue state to rank the potential responses. We find that Athena-RR with a Recall@1 of 70.79% outperforms Athena-Heuristic and all of the off-the-shelf rankers by a large margin. We then conduct a live A/B study comparing Athena-Heuristic to Athena-RR in a 6,358 conversations with Alexa users. We show that Athena-RR leads to significantly longer conversations that receive significantly higher user ratings than the heuristic rule-based ranker." @default.
- W4320342620 created "2023-02-13" @default.
- W4320342620 creator A5019893567 @default.
- W4320342620 creator A5025844755 @default.
- W4320342620 creator A5036669949 @default.
- W4320342620 date "2023-02-08" @default.
- W4320342620 modified "2023-09-23" @default.
- W4320342620 title "A Transformer-based Response Evaluator for Open-Domain Spoken Conversation" @default.
- W4320342620 doi "https://doi.org/10.48550/arxiv.2302.04424" @default.
- W4320342620 hasPublicationYear "2023" @default.
- W4320342620 type Work @default.
- W4320342620 citedByCount "0" @default.
- W4320342620 crossrefType "posted-content" @default.
- W4320342620 hasAuthorship W4320342620A5019893567 @default.
- W4320342620 hasAuthorship W4320342620A5025844755 @default.
- W4320342620 hasAuthorship W4320342620A5036669949 @default.
- W4320342620 hasBestOaLocation W43203426201 @default.
- W4320342620 hasConcept C119599485 @default.
- W4320342620 hasConcept C127413603 @default.
- W4320342620 hasConcept C154945302 @default.
- W4320342620 hasConcept C15744967 @default.
- W4320342620 hasConcept C165801399 @default.
- W4320342620 hasConcept C173801870 @default.
- W4320342620 hasConcept C204321447 @default.
- W4320342620 hasConcept C2777200299 @default.
- W4320342620 hasConcept C41008148 @default.
- W4320342620 hasConcept C46312422 @default.
- W4320342620 hasConcept C66322947 @default.
- W4320342620 hasConceptScore W4320342620C119599485 @default.
- W4320342620 hasConceptScore W4320342620C127413603 @default.
- W4320342620 hasConceptScore W4320342620C154945302 @default.
- W4320342620 hasConceptScore W4320342620C15744967 @default.
- W4320342620 hasConceptScore W4320342620C165801399 @default.
- W4320342620 hasConceptScore W4320342620C173801870 @default.
- W4320342620 hasConceptScore W4320342620C204321447 @default.
- W4320342620 hasConceptScore W4320342620C2777200299 @default.
- W4320342620 hasConceptScore W4320342620C41008148 @default.
- W4320342620 hasConceptScore W4320342620C46312422 @default.
- W4320342620 hasConceptScore W4320342620C66322947 @default.
- W4320342620 hasLocation W43203426201 @default.
- W4320342620 hasOpenAccess W4320342620 @default.
- W4320342620 hasPrimaryLocation W43203426201 @default.
- W4320342620 hasRelatedWork W2071912017 @default.
- W4320342620 hasRelatedWork W2073045008 @default.
- W4320342620 hasRelatedWork W2274593003 @default.
- W4320342620 hasRelatedWork W2281963941 @default.
- W4320342620 hasRelatedWork W2368651715 @default.
- W4320342620 hasRelatedWork W2496949096 @default.
- W4320342620 hasRelatedWork W2611614995 @default.
- W4320342620 hasRelatedWork W2789919619 @default.
- W4320342620 hasRelatedWork W3107474891 @default.
- W4320342620 hasRelatedWork W1853743098 @default.
- W4320342620 isParatext "false" @default.
- W4320342620 isRetracted "false" @default.
- W4320342620 workType "article" @default.