FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288115655> ?p ?o ?g. }

• W4288115655 abstract "Task-oriented dialog systems need to know when a query falls outside their range of supported intents, but current text classification corpora only define label sets that cover every example. We introduce a new dataset that includes queries that are out-of-scope---i.e., queries that do not fall into any of the system's supported intents. This poses a new challenge because models cannot assume that every query at inference time belongs to a system-supported intent class. Our dataset also covers 150 intent classes over 10 domains, capturing the breadth that a production task-oriented agent must handle. We evaluate a range of benchmark classifiers on our dataset along with several different out-of-scope identification schemes. We find that while the classifiers perform well on in-scope intent classification, they struggle to identify out-of-scope queries. Our dataset and evaluation fill an important gap in the field, offering a way of more rigorously and realistically benchmarking text classification in task-driven dialog systems." @default.
• W4288115655 created "2022-07-28" @default.
• W4288115655 creator A5003303885 @default.
• W4288115655 creator A5023740689 @default.
• W4288115655 creator A5030030910 @default.
• W4288115655 creator A5041919450 @default.
• W4288115655 creator A5044722987 @default.
• W4288115655 creator A5053236545 @default.
• W4288115655 creator A5057970781 @default.
• W4288115655 creator A5058184922 @default.
• W4288115655 creator A5065128438 @default.
• W4288115655 creator A5071830287 @default.
• W4288115655 creator A5082989514 @default.
• W4288115655 date "2019-09-04" @default.
• W4288115655 modified "2023-10-16" @default.
• W4288115655 title "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction" @default.
• W4288115655 doi "https://doi.org/10.48550/arxiv.1909.02027" @default.
• W4288115655 hasPublicationYear "2019" @default.
• W4288115655 type Work @default.
• W4288115655 citedByCount "0" @default.
• W4288115655 crossrefType "posted-content" @default.
• W4288115655 hasAuthorship W4288115655A5003303885 @default.
• W4288115655 hasAuthorship W4288115655A5023740689 @default.
• W4288115655 hasAuthorship W4288115655A5030030910 @default.
• W4288115655 hasAuthorship W4288115655A5041919450 @default.
• W4288115655 hasAuthorship W4288115655A5044722987 @default.
• W4288115655 hasAuthorship W4288115655A5053236545 @default.
• W4288115655 hasAuthorship W4288115655A5057970781 @default.
• W4288115655 hasAuthorship W4288115655A5058184922 @default.
• W4288115655 hasAuthorship W4288115655A5065128438 @default.
• W4288115655 hasAuthorship W4288115655A5071830287 @default.
• W4288115655 hasAuthorship W4288115655A5082989514 @default.
• W4288115655 hasBestOaLocation W42881156551 @default.
• W4288115655 hasConcept C116834253 @default.
• W4288115655 hasConcept C119857082 @default.
• W4288115655 hasConcept C124101348 @default.
• W4288115655 hasConcept C13280743 @default.
• W4288115655 hasConcept C136764020 @default.
• W4288115655 hasConcept C144133560 @default.
• W4288115655 hasConcept C154945302 @default.
• W4288115655 hasConcept C159985019 @default.
• W4288115655 hasConcept C162324750 @default.
• W4288115655 hasConcept C162853370 @default.
• W4288115655 hasConcept C173853756 @default.
• W4288115655 hasConcept C185798385 @default.
• W4288115655 hasConcept C187736073 @default.
• W4288115655 hasConcept C192562407 @default.
• W4288115655 hasConcept C199360897 @default.
• W4288115655 hasConcept C202444582 @default.
• W4288115655 hasConcept C204323151 @default.
• W4288115655 hasConcept C205649164 @default.
• W4288115655 hasConcept C23123220 @default.
• W4288115655 hasConcept C2522767166 @default.
• W4288115655 hasConcept C2776214188 @default.
• W4288115655 hasConcept C2777212361 @default.
• W4288115655 hasConcept C2778012447 @default.
• W4288115655 hasConcept C2780451532 @default.
• W4288115655 hasConcept C33923547 @default.
• W4288115655 hasConcept C41008148 @default.
• W4288115655 hasConcept C59822182 @default.
• W4288115655 hasConcept C86251818 @default.
• W4288115655 hasConcept C86803240 @default.
• W4288115655 hasConcept C9652623 @default.
• W4288115655 hasConceptScore W4288115655C116834253 @default.
• W4288115655 hasConceptScore W4288115655C119857082 @default.
• W4288115655 hasConceptScore W4288115655C124101348 @default.
• W4288115655 hasConceptScore W4288115655C13280743 @default.
• W4288115655 hasConceptScore W4288115655C136764020 @default.
• W4288115655 hasConceptScore W4288115655C144133560 @default.
• W4288115655 hasConceptScore W4288115655C154945302 @default.
• W4288115655 hasConceptScore W4288115655C159985019 @default.
• W4288115655 hasConceptScore W4288115655C162324750 @default.
• W4288115655 hasConceptScore W4288115655C162853370 @default.
• W4288115655 hasConceptScore W4288115655C173853756 @default.
• W4288115655 hasConceptScore W4288115655C185798385 @default.
• W4288115655 hasConceptScore W4288115655C187736073 @default.
• W4288115655 hasConceptScore W4288115655C192562407 @default.
• W4288115655 hasConceptScore W4288115655C199360897 @default.
• W4288115655 hasConceptScore W4288115655C202444582 @default.
• W4288115655 hasConceptScore W4288115655C204323151 @default.
• W4288115655 hasConceptScore W4288115655C205649164 @default.
• W4288115655 hasConceptScore W4288115655C23123220 @default.
• W4288115655 hasConceptScore W4288115655C2522767166 @default.
• W4288115655 hasConceptScore W4288115655C2776214188 @default.
• W4288115655 hasConceptScore W4288115655C2777212361 @default.
• W4288115655 hasConceptScore W4288115655C2778012447 @default.
• W4288115655 hasConceptScore W4288115655C2780451532 @default.
• W4288115655 hasConceptScore W4288115655C33923547 @default.
• W4288115655 hasConceptScore W4288115655C41008148 @default.
• W4288115655 hasConceptScore W4288115655C59822182 @default.
• W4288115655 hasConceptScore W4288115655C86251818 @default.
• W4288115655 hasConceptScore W4288115655C86803240 @default.
• W4288115655 hasConceptScore W4288115655C9652623 @default.
• W4288115655 hasLocation W42881156551 @default.
• W4288115655 hasOpenAccess W4288115655 @default.
• W4288115655 hasPrimaryLocation W42881156551 @default.
• W4288115655 hasRelatedWork W172869079 @default.
• W4288115655 hasRelatedWork W2067502401 @default.
• W4288115655 hasRelatedWork W2129427361 @default.
• W4288115655 hasRelatedWork W2135467400 @default.

• next