Matches in SemOpenAlex for { <https://semopenalex.org/work/W3184289507> ?p ?o ?g. }
- W3184289507 abstract "A medical dialogue system is essential for healthcare service as providing primary clinical advice and diagnoses. It has been gradually adopted and practiced in medical organizations in the form of a conversational bot, largely due to the advancement of NLP. In recent years, the introduction of state-of-the-art deep learning models and transfer learning techniques like Universal Language Model Fine Tuning (ULMFiT) and Knowledge Distillation (KD) largely contributes to the performance of NLP tasks. However, some deep neural networks are poorly calibrated and wrongly estimate the uncertainty. Hence the model is not trustworthy, especially in sensitive medical decision-making systems and safety tasks. In this paper, we investigate the well-calibrated model for ULMFiT and self-distillation (SD) in a medical dialogue system. The calibrated ULMFiT (CULMFiT) is obtained by incorporating label smoothing (LS), a commonly used regularization technique to achieve a well-calibrated model. Moreover, we apply the technique to recalibrate the confidence score called temperature scaling (TS) with KD to observe its correlation with network calibration. To further understand the relation between SD and calibration, we use both fixed and optimal temperatures to fine-tune the whole model. All experiments are conducted on the consultation backpain dataset collected by experts then further validated using a large publicly medial dialogue corpus. We empirically show that our proposed methodologies outperform conventional methods in terms of accuracy and robustness." @default.
- W3184289507 created "2021-08-02" @default.
- W3184289507 creator A5033318648 @default.
- W3184289507 creator A5083067688 @default.
- W3184289507 date "2021-07-20" @default.
- W3184289507 modified "2023-09-27" @default.
- W3184289507 title "Learning ULMFiT and Self-Distillation with Calibration for Medical Dialogue System." @default.
- W3184289507 cites W1779075490 @default.
- W3184289507 cites W1821462560 @default.
- W3184289507 cites W1979241469 @default.
- W3184289507 cites W2008857451 @default.
- W3184289507 cites W2117118000 @default.
- W3184289507 cites W2123301721 @default.
- W3184289507 cites W2165698076 @default.
- W3184289507 cites W2183341477 @default.
- W3184289507 cites W2254249950 @default.
- W3184289507 cites W2560321925 @default.
- W3184289507 cites W2626967530 @default.
- W3184289507 cites W2784121710 @default.
- W3184289507 cites W2950903920 @default.
- W3184289507 cites W2963026768 @default.
- W3184289507 cites W2963403868 @default.
- W3184289507 cites W2964508650 @default.
- W3184289507 cites W2965658867 @default.
- W3184289507 cites W2970206392 @default.
- W3184289507 cites W2976135203 @default.
- W3184289507 cites W2981528437 @default.
- W3184289507 cites W2987861506 @default.
- W3184289507 cites W3008219293 @default.
- W3184289507 cites W3016164449 @default.
- W3184289507 cites W3023541904 @default.
- W3184289507 cites W3034704352 @default.
- W3184289507 cites W3094508337 @default.
- W3184289507 cites W3102109197 @default.
- W3184289507 cites W3135071678 @default.
- W3184289507 hasPublicationYear "2021" @default.
- W3184289507 type Work @default.
- W3184289507 sameAs 3184289507 @default.
- W3184289507 citedByCount "0" @default.
- W3184289507 crossrefType "posted-content" @default.
- W3184289507 hasAuthorship W3184289507A5033318648 @default.
- W3184289507 hasAuthorship W3184289507A5083067688 @default.
- W3184289507 hasConcept C104317684 @default.
- W3184289507 hasConcept C105795698 @default.
- W3184289507 hasConcept C108583219 @default.
- W3184289507 hasConcept C119857082 @default.
- W3184289507 hasConcept C142724271 @default.
- W3184289507 hasConcept C153701036 @default.
- W3184289507 hasConcept C154945302 @default.
- W3184289507 hasConcept C165838908 @default.
- W3184289507 hasConcept C185592680 @default.
- W3184289507 hasConcept C204321447 @default.
- W3184289507 hasConcept C2776135515 @default.
- W3184289507 hasConcept C31972630 @default.
- W3184289507 hasConcept C33923547 @default.
- W3184289507 hasConcept C3770464 @default.
- W3184289507 hasConcept C38652104 @default.
- W3184289507 hasConcept C41008148 @default.
- W3184289507 hasConcept C534262118 @default.
- W3184289507 hasConcept C55493867 @default.
- W3184289507 hasConcept C63479239 @default.
- W3184289507 hasConcept C71924100 @default.
- W3184289507 hasConceptScore W3184289507C104317684 @default.
- W3184289507 hasConceptScore W3184289507C105795698 @default.
- W3184289507 hasConceptScore W3184289507C108583219 @default.
- W3184289507 hasConceptScore W3184289507C119857082 @default.
- W3184289507 hasConceptScore W3184289507C142724271 @default.
- W3184289507 hasConceptScore W3184289507C153701036 @default.
- W3184289507 hasConceptScore W3184289507C154945302 @default.
- W3184289507 hasConceptScore W3184289507C165838908 @default.
- W3184289507 hasConceptScore W3184289507C185592680 @default.
- W3184289507 hasConceptScore W3184289507C204321447 @default.
- W3184289507 hasConceptScore W3184289507C2776135515 @default.
- W3184289507 hasConceptScore W3184289507C31972630 @default.
- W3184289507 hasConceptScore W3184289507C33923547 @default.
- W3184289507 hasConceptScore W3184289507C3770464 @default.
- W3184289507 hasConceptScore W3184289507C38652104 @default.
- W3184289507 hasConceptScore W3184289507C41008148 @default.
- W3184289507 hasConceptScore W3184289507C534262118 @default.
- W3184289507 hasConceptScore W3184289507C55493867 @default.
- W3184289507 hasConceptScore W3184289507C63479239 @default.
- W3184289507 hasConceptScore W3184289507C71924100 @default.
- W3184289507 hasLocation W31842895071 @default.
- W3184289507 hasOpenAccess W3184289507 @default.
- W3184289507 hasPrimaryLocation W31842895071 @default.
- W3184289507 hasRelatedWork W2018167703 @default.
- W3184289507 hasRelatedWork W2033025724 @default.
- W3184289507 hasRelatedWork W2132836414 @default.
- W3184289507 hasRelatedWork W2184232439 @default.
- W3184289507 hasRelatedWork W228407633 @default.
- W3184289507 hasRelatedWork W2548307888 @default.
- W3184289507 hasRelatedWork W2623906388 @default.
- W3184289507 hasRelatedWork W2902107805 @default.
- W3184289507 hasRelatedWork W2947012480 @default.
- W3184289507 hasRelatedWork W2966716789 @default.
- W3184289507 hasRelatedWork W2996737117 @default.
- W3184289507 hasRelatedWork W3000098859 @default.
- W3184289507 hasRelatedWork W3035527463 @default.
- W3184289507 hasRelatedWork W3042022206 @default.
- W3184289507 hasRelatedWork W3137020110 @default.