Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385655506> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W4385655506 endingPage "9055" @default.
- W4385655506 startingPage "9055" @default.
- W4385655506 abstract "Current State-of-the-Art (SotA) chatbots are able to produce high-quality sentences, handling different conversation topics and larger interaction times. Unfortunately, the generated responses depend greatly on the data on which they have been trained, the specific dialogue history and current turn used for guiding the response, the internal decoding mechanisms, and ranking strategies, among others. Therefore, it may happen that for semantically similar questions asked by users, the chatbot may provide a different answer, which can be considered as a form of hallucination or producing confusion in long-term interactions. In this research paper, we propose a novel methodology consisting of two main phases: (a) hierarchical automatic detection of topics and subtopics in dialogue interactions using a zero-shot learning approach, and (b) detecting inconsistent answers using k-means and the Silhouette coefficient. To evaluate the efficacy of topic and subtopic detection, we use a subset of the DailyDialog dataset and real dialogue interactions gathered during the Alexa Socialbot Grand Challenge 5 (SGC5). The proposed approach enables the detection of up to 18 different topics and 102 subtopics. For the purpose of detecting inconsistencies, we manually generate multiple paraphrased questions and employ several pre-trained SotA chatbot models to generate responses. Our experimental results demonstrate a weighted F-1 value of 0.34 for topic detection, a weighted F-1 value of 0.78 for subtopic detection in DailyDialog, then 81% and 62% accuracy for topic and subtopic classification in SGC5, respectively. Finally, to predict the number of different responses, we obtained a mean squared error (MSE) of 3.4 when testing smaller generative models and 4.9 in recent large language models." @default.
- W4385655506 created "2023-08-09" @default.
- W4385655506 creator A5000038806 @default.
- W4385655506 creator A5024161267 @default.
- W4385655506 creator A5031054713 @default.
- W4385655506 creator A5064788846 @default.
- W4385655506 creator A5067867302 @default.
- W4385655506 date "2023-08-08" @default.
- W4385655506 modified "2023-10-16" @default.
- W4385655506 title "Automatic Detection of Inconsistencies and Hierarchical Topic Classification for Open-Domain Chatbots" @default.
- W4385655506 cites W2101105183 @default.
- W4385655506 cites W2180566385 @default.
- W4385655506 cites W2584220694 @default.
- W4385655506 cites W2963096510 @default.
- W4385655506 cites W2963640662 @default.
- W4385655506 cites W2970641574 @default.
- W4385655506 cites W2988937804 @default.
- W4385655506 cites W3034383590 @default.
- W4385655506 cites W3034999214 @default.
- W4385655506 cites W3035390927 @default.
- W4385655506 cites W3105218667 @default.
- W4385655506 cites W3153427360 @default.
- W4385655506 cites W3155584966 @default.
- W4385655506 cites W3186138538 @default.
- W4385655506 cites W3186804217 @default.
- W4385655506 cites W4214583587 @default.
- W4385655506 cites W4253203888 @default.
- W4385655506 cites W4285294723 @default.
- W4385655506 cites W4287854593 @default.
- W4385655506 cites W4304080626 @default.
- W4385655506 cites W4308521104 @default.
- W4385655506 cites W4362673335 @default.
- W4385655506 cites W4385573862 @default.
- W4385655506 doi "https://doi.org/10.3390/app13169055" @default.
- W4385655506 hasPublicationYear "2023" @default.
- W4385655506 type Work @default.
- W4385655506 citedByCount "0" @default.
- W4385655506 crossrefType "journal-article" @default.
- W4385655506 hasAuthorship W4385655506A5000038806 @default.
- W4385655506 hasAuthorship W4385655506A5024161267 @default.
- W4385655506 hasAuthorship W4385655506A5031054713 @default.
- W4385655506 hasAuthorship W4385655506A5064788846 @default.
- W4385655506 hasAuthorship W4385655506A5067867302 @default.
- W4385655506 hasBestOaLocation W43856555061 @default.
- W4385655506 hasConcept C11171543 @default.
- W4385655506 hasConcept C119857082 @default.
- W4385655506 hasConcept C154945302 @default.
- W4385655506 hasConcept C15744967 @default.
- W4385655506 hasConcept C189430467 @default.
- W4385655506 hasConcept C204321447 @default.
- W4385655506 hasConcept C23123220 @default.
- W4385655506 hasConcept C2777200299 @default.
- W4385655506 hasConcept C2779041454 @default.
- W4385655506 hasConcept C2781140086 @default.
- W4385655506 hasConcept C41008148 @default.
- W4385655506 hasConcept C46312422 @default.
- W4385655506 hasConceptScore W4385655506C11171543 @default.
- W4385655506 hasConceptScore W4385655506C119857082 @default.
- W4385655506 hasConceptScore W4385655506C154945302 @default.
- W4385655506 hasConceptScore W4385655506C15744967 @default.
- W4385655506 hasConceptScore W4385655506C189430467 @default.
- W4385655506 hasConceptScore W4385655506C204321447 @default.
- W4385655506 hasConceptScore W4385655506C23123220 @default.
- W4385655506 hasConceptScore W4385655506C2777200299 @default.
- W4385655506 hasConceptScore W4385655506C2779041454 @default.
- W4385655506 hasConceptScore W4385655506C2781140086 @default.
- W4385655506 hasConceptScore W4385655506C41008148 @default.
- W4385655506 hasConceptScore W4385655506C46312422 @default.
- W4385655506 hasIssue "16" @default.
- W4385655506 hasLocation W43856555061 @default.
- W4385655506 hasOpenAccess W4385655506 @default.
- W4385655506 hasPrimaryLocation W43856555061 @default.
- W4385655506 hasRelatedWork W2077201361 @default.
- W4385655506 hasRelatedWork W2785805847 @default.
- W4385655506 hasRelatedWork W2977610131 @default.
- W4385655506 hasRelatedWork W3013403319 @default.
- W4385655506 hasRelatedWork W3033819367 @default.
- W4385655506 hasRelatedWork W3138342447 @default.
- W4385655506 hasRelatedWork W3160439235 @default.
- W4385655506 hasRelatedWork W3175938739 @default.
- W4385655506 hasRelatedWork W4380363475 @default.
- W4385655506 hasRelatedWork W4384918632 @default.
- W4385655506 hasVolume "13" @default.
- W4385655506 isParatext "false" @default.
- W4385655506 isRetracted "false" @default.
- W4385655506 workType "article" @default.