Matches in SemOpenAlex for { <https://semopenalex.org/work/W4295693656> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W4295693656 abstract "This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modules: dialogue state tracker (DST) and response generator (RG). The dialogue state consists of the domain-slot-value triples, which are regarded as the user's constraints to search the domain-related databases. The large-scale task-oriented dialogue data with the annotated structured dialogue state usually are inaccessible. It prevents the development of the pretrained language model for the task-oriented dialogue. We propose a simple yet effective pretraining method to alleviate this problem, which consists of two pretraining phases. The first phase is to pretrain on large-scale contextual text data, where the structured information of the text is extracted by the information extracting tool. To bridge the gap between the pretraining method and downstream tasks, we design two pretraining tasks: ontology-like triple recovery and next-text generation, which simulates the DST and RG, respectively. The second phase is to fine-tune the pretrained model on the TOD data. The experimental results show that our proposed method achieves an exciting boost and get competitive performance even without any TOD data on CamRest676 and MultiWOZ benchmarks." @default.
- W4295693656 created "2022-09-14" @default.
- W4295693656 creator A5028969814 @default.
- W4295693656 creator A5049377420 @default.
- W4295693656 creator A5071074966 @default.
- W4295693656 creator A5077804071 @default.
- W4295693656 creator A5081865665 @default.
- W4295693656 creator A5087018671 @default.
- W4295693656 date "2022-09-10" @default.
- W4295693656 modified "2023-10-14" @default.
- W4295693656 title "OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue" @default.
- W4295693656 doi "https://doi.org/10.48550/arxiv.2209.04595" @default.
- W4295693656 hasPublicationYear "2022" @default.
- W4295693656 type Work @default.
- W4295693656 citedByCount "0" @default.
- W4295693656 crossrefType "posted-content" @default.
- W4295693656 hasAuthorship W4295693656A5028969814 @default.
- W4295693656 hasAuthorship W4295693656A5049377420 @default.
- W4295693656 hasAuthorship W4295693656A5071074966 @default.
- W4295693656 hasAuthorship W4295693656A5077804071 @default.
- W4295693656 hasAuthorship W4295693656A5081865665 @default.
- W4295693656 hasAuthorship W4295693656A5087018671 @default.
- W4295693656 hasBestOaLocation W42956936561 @default.
- W4295693656 hasConcept C111472728 @default.
- W4295693656 hasConcept C121332964 @default.
- W4295693656 hasConcept C134306372 @default.
- W4295693656 hasConcept C137293760 @default.
- W4295693656 hasConcept C138885662 @default.
- W4295693656 hasConcept C154945302 @default.
- W4295693656 hasConcept C162324750 @default.
- W4295693656 hasConcept C163258240 @default.
- W4295693656 hasConcept C187736073 @default.
- W4295693656 hasConcept C199360897 @default.
- W4295693656 hasConcept C204321447 @default.
- W4295693656 hasConcept C25810664 @default.
- W4295693656 hasConcept C2780451532 @default.
- W4295693656 hasConcept C2780992000 @default.
- W4295693656 hasConcept C33923547 @default.
- W4295693656 hasConcept C36503486 @default.
- W4295693656 hasConcept C41008148 @default.
- W4295693656 hasConcept C48103436 @default.
- W4295693656 hasConcept C62520636 @default.
- W4295693656 hasConceptScore W4295693656C111472728 @default.
- W4295693656 hasConceptScore W4295693656C121332964 @default.
- W4295693656 hasConceptScore W4295693656C134306372 @default.
- W4295693656 hasConceptScore W4295693656C137293760 @default.
- W4295693656 hasConceptScore W4295693656C138885662 @default.
- W4295693656 hasConceptScore W4295693656C154945302 @default.
- W4295693656 hasConceptScore W4295693656C162324750 @default.
- W4295693656 hasConceptScore W4295693656C163258240 @default.
- W4295693656 hasConceptScore W4295693656C187736073 @default.
- W4295693656 hasConceptScore W4295693656C199360897 @default.
- W4295693656 hasConceptScore W4295693656C204321447 @default.
- W4295693656 hasConceptScore W4295693656C25810664 @default.
- W4295693656 hasConceptScore W4295693656C2780451532 @default.
- W4295693656 hasConceptScore W4295693656C2780992000 @default.
- W4295693656 hasConceptScore W4295693656C33923547 @default.
- W4295693656 hasConceptScore W4295693656C36503486 @default.
- W4295693656 hasConceptScore W4295693656C41008148 @default.
- W4295693656 hasConceptScore W4295693656C48103436 @default.
- W4295693656 hasConceptScore W4295693656C62520636 @default.
- W4295693656 hasLocation W42956936561 @default.
- W4295693656 hasOpenAccess W4295693656 @default.
- W4295693656 hasPrimaryLocation W42956936561 @default.
- W4295693656 hasRelatedWork W142374489 @default.
- W4295693656 hasRelatedWork W1563618553 @default.
- W4295693656 hasRelatedWork W180507639 @default.
- W4295693656 hasRelatedWork W2081647779 @default.
- W4295693656 hasRelatedWork W2362192218 @default.
- W4295693656 hasRelatedWork W2773694660 @default.
- W4295693656 hasRelatedWork W3093097038 @default.
- W4295693656 hasRelatedWork W3107474891 @default.
- W4295693656 hasRelatedWork W3185852197 @default.
- W4295693656 hasRelatedWork W4205820553 @default.
- W4295693656 isParatext "false" @default.
- W4295693656 isRetracted "false" @default.
- W4295693656 workType "article" @default.