Matches in SemOpenAlex for { <https://semopenalex.org/work/W3022903564> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W3022903564 abstract "The recent success of large pre-trained language models such as BERT and GPT-2 has suggested the effectiveness of incorporating language priors in downstream dialog generation tasks. However, the performance of pre-trained models on the dialog task is not as optimal as expected. In this paper, we propose a Pre-trained Role Alternating Language model (PRAL), designed specifically for task-oriented conversational systems. We adopted (Wu et al., 2019) that models two speakers separately. We also design several techniques, such as start position randomization, knowledge distillation, and history discount to improve pre-training performance. We introduce a task-oriented dialog pretraining dataset by cleaning 13 existing data sets. We test PRAL on three different downstream tasks. The results show that PRAL performs better or on par with state-of-the-art methods." @default.
- W3022903564 created "2020-05-13" @default.
- W3022903564 creator A5052225474 @default.
- W3022903564 creator A5061025828 @default.
- W3022903564 creator A5074207327 @default.
- W3022903564 creator A5089522357 @default.
- W3022903564 creator A5089678310 @default.
- W3022903564 date "2020-04-24" @default.
- W3022903564 modified "2023-09-27" @default.
- W3022903564 title "A Tailored Pre-Training Model for Task-Oriented Dialog Generation" @default.
- W3022903564 cites W1821462560 @default.
- W3022903564 cites W2125320996 @default.
- W3022903564 cites W2560647685 @default.
- W3022903564 cites W2788388592 @default.
- W3022903564 cites W2798471701 @default.
- W3022903564 cites W2889581899 @default.
- W3022903564 cites W2891732163 @default.
- W3022903564 cites W2914204778 @default.
- W3022903564 cites W2951577137 @default.
- W3022903564 cites W2952607215 @default.
- W3022903564 cites W2959193832 @default.
- W3022903564 cites W2963341956 @default.
- W3022903564 cites W2963544536 @default.
- W3022903564 cites W2971737394 @default.
- W3022903564 cites W2972156721 @default.
- W3022903564 cites W2973004186 @default.
- W3022903564 cites W2988647680 @default.
- W3022903564 cites W3037026762 @default.
- W3022903564 doi "https://doi.org/10.48550/arxiv.2004.13835" @default.
- W3022903564 hasPublicationYear "2020" @default.
- W3022903564 type Work @default.
- W3022903564 sameAs 3022903564 @default.
- W3022903564 citedByCount "7" @default.
- W3022903564 countsByYear W30229035642021 @default.
- W3022903564 countsByYear W30229035642022 @default.
- W3022903564 crossrefType "posted-content" @default.
- W3022903564 hasAuthorship W3022903564A5052225474 @default.
- W3022903564 hasAuthorship W3022903564A5061025828 @default.
- W3022903564 hasAuthorship W3022903564A5074207327 @default.
- W3022903564 hasAuthorship W3022903564A5089522357 @default.
- W3022903564 hasAuthorship W3022903564A5089678310 @default.
- W3022903564 hasBestOaLocation W30229035641 @default.
- W3022903564 hasConcept C107673813 @default.
- W3022903564 hasConcept C119857082 @default.
- W3022903564 hasConcept C127413603 @default.
- W3022903564 hasConcept C136764020 @default.
- W3022903564 hasConcept C137293760 @default.
- W3022903564 hasConcept C154945302 @default.
- W3022903564 hasConcept C173853756 @default.
- W3022903564 hasConcept C177769412 @default.
- W3022903564 hasConcept C190954187 @default.
- W3022903564 hasConcept C201995342 @default.
- W3022903564 hasConcept C204321447 @default.
- W3022903564 hasConcept C21547014 @default.
- W3022903564 hasConcept C2776207758 @default.
- W3022903564 hasConcept C2780451532 @default.
- W3022903564 hasConcept C41008148 @default.
- W3022903564 hasConcept C51632099 @default.
- W3022903564 hasConceptScore W3022903564C107673813 @default.
- W3022903564 hasConceptScore W3022903564C119857082 @default.
- W3022903564 hasConceptScore W3022903564C127413603 @default.
- W3022903564 hasConceptScore W3022903564C136764020 @default.
- W3022903564 hasConceptScore W3022903564C137293760 @default.
- W3022903564 hasConceptScore W3022903564C154945302 @default.
- W3022903564 hasConceptScore W3022903564C173853756 @default.
- W3022903564 hasConceptScore W3022903564C177769412 @default.
- W3022903564 hasConceptScore W3022903564C190954187 @default.
- W3022903564 hasConceptScore W3022903564C201995342 @default.
- W3022903564 hasConceptScore W3022903564C204321447 @default.
- W3022903564 hasConceptScore W3022903564C21547014 @default.
- W3022903564 hasConceptScore W3022903564C2776207758 @default.
- W3022903564 hasConceptScore W3022903564C2780451532 @default.
- W3022903564 hasConceptScore W3022903564C41008148 @default.
- W3022903564 hasConceptScore W3022903564C51632099 @default.
- W3022903564 hasLocation W30229035641 @default.
- W3022903564 hasOpenAccess W3022903564 @default.
- W3022903564 hasPrimaryLocation W30229035641 @default.
- W3022903564 hasRelatedWork W1536731345 @default.
- W3022903564 hasRelatedWork W195462039 @default.
- W3022903564 hasRelatedWork W2004123325 @default.
- W3022903564 hasRelatedWork W2945324091 @default.
- W3022903564 hasRelatedWork W3022903564 @default.
- W3022903564 hasRelatedWork W3099519865 @default.
- W3022903564 hasRelatedWork W3203726166 @default.
- W3022903564 hasRelatedWork W4287594316 @default.
- W3022903564 hasRelatedWork W4294862481 @default.
- W3022903564 hasRelatedWork W4353012853 @default.
- W3022903564 isParatext "false" @default.
- W3022903564 isRetracted "false" @default.
- W3022903564 magId "3022903564" @default.
- W3022903564 workType "article" @default.