Matches in SemOpenAlex for { <https://semopenalex.org/work/W4383909651> ?p ?o ?g. }
- W4383909651 endingPage "8041" @default.
- W4383909651 startingPage "8041" @default.
- W4383909651 abstract "Query auto-completion (QAC) serves as a critical functionality in contemporary textual search systems by generating real-time query completion suggestions based on a user’s input prefix. Despite the prevalent use of language models (LMs) in QAC candidate generation, LM-based approaches frequently suffer from overcorrection issues during pair-wise loss training and efficiency deficiencies. To address these challenges, this paper presents a novel framework—discriminator-enhanced knowledge distillation (Dis-KD)—for the QAC task. This framework combines three core components: a large-scale pre-trained teacher model, a lightweight student model, and a discriminator for adversarial learning. Specifically, the discriminator aids in discerning generative-level differences between the teacher and the student models. An additional discriminator score loss is amalgamated with the traditional knowledge-distillation loss, resulting in enhanced performance of the student model. Contrary to the stepwise evaluation of each generated word, our approach assesses the entire generation sequence. This method alleviates the prevalent overcorrection issue in the generation process. Consequently, our proposed framework boasts improvements in model accuracy and a reduction in parameter size. Empirical results highlight the superiority of Dis-KD over established baseline methods, with the student model surpassing the teacher model in QAC tasks for sub-word languages." @default.
- W4383909651 created "2023-07-12" @default.
- W4383909651 creator A5014394467 @default.
- W4383909651 creator A5019945476 @default.
- W4383909651 creator A5045018604 @default.
- W4383909651 creator A5065104736 @default.
- W4383909651 creator A5075903928 @default.
- W4383909651 date "2023-07-10" @default.
- W4383909651 modified "2023-09-27" @default.
- W4383909651 title "Discriminator-Enhanced Knowledge-Distillation Networks" @default.
- W4383909651 cites W1989234058 @default.
- W4383909651 cites W1993378086 @default.
- W4383909651 cites W2011374947 @default.
- W4383909651 cites W2027691696 @default.
- W4383909651 cites W2030960598 @default.
- W4383909651 cites W2042373492 @default.
- W4383909651 cites W2060575618 @default.
- W4383909651 cites W2093646604 @default.
- W4383909651 cites W2118395326 @default.
- W4383909651 cites W2124814993 @default.
- W4383909651 cites W2186845332 @default.
- W4383909651 cites W2270569605 @default.
- W4383909651 cites W2376507230 @default.
- W4383909651 cites W2604700701 @default.
- W4383909651 cites W2740195281 @default.
- W4383909651 cites W2775590881 @default.
- W4383909651 cites W2798523458 @default.
- W4383909651 cites W2908160485 @default.
- W4383909651 cites W2962784628 @default.
- W4383909651 cites W2963691697 @default.
- W4383909651 cites W2963736842 @default.
- W4383909651 cites W2964268978 @default.
- W4383909651 cites W2970454332 @default.
- W4383909651 cites W2970510999 @default.
- W4383909651 cites W3041290354 @default.
- W4383909651 cites W3047718985 @default.
- W4383909651 cites W3093816530 @default.
- W4383909651 cites W3105966348 @default.
- W4383909651 cites W3138773240 @default.
- W4383909651 cites W3171155106 @default.
- W4383909651 cites W4211083023 @default.
- W4383909651 cites W4281988921 @default.
- W4383909651 cites W4321377225 @default.
- W4383909651 doi "https://doi.org/10.3390/app13148041" @default.
- W4383909651 hasPublicationYear "2023" @default.
- W4383909651 type Work @default.
- W4383909651 citedByCount "0" @default.
- W4383909651 crossrefType "journal-article" @default.
- W4383909651 hasAuthorship W4383909651A5014394467 @default.
- W4383909651 hasAuthorship W4383909651A5019945476 @default.
- W4383909651 hasAuthorship W4383909651A5045018604 @default.
- W4383909651 hasAuthorship W4383909651A5065104736 @default.
- W4383909651 hasAuthorship W4383909651A5075903928 @default.
- W4383909651 hasBestOaLocation W43839096511 @default.
- W4383909651 hasConcept C108010975 @default.
- W4383909651 hasConcept C111368507 @default.
- W4383909651 hasConcept C119857082 @default.
- W4383909651 hasConcept C12725497 @default.
- W4383909651 hasConcept C127313418 @default.
- W4383909651 hasConcept C127413603 @default.
- W4383909651 hasConcept C137293760 @default.
- W4383909651 hasConcept C138885662 @default.
- W4383909651 hasConcept C141603448 @default.
- W4383909651 hasConcept C154945302 @default.
- W4383909651 hasConcept C178790620 @default.
- W4383909651 hasConcept C185592680 @default.
- W4383909651 hasConcept C199360897 @default.
- W4383909651 hasConcept C201995342 @default.
- W4383909651 hasConcept C204030448 @default.
- W4383909651 hasConcept C204321447 @default.
- W4383909651 hasConcept C2524010 @default.
- W4383909651 hasConcept C2779803651 @default.
- W4383909651 hasConcept C2780451532 @default.
- W4383909651 hasConcept C33923547 @default.
- W4383909651 hasConcept C39890363 @default.
- W4383909651 hasConcept C41008148 @default.
- W4383909651 hasConcept C41895202 @default.
- W4383909651 hasConcept C6557445 @default.
- W4383909651 hasConcept C76155785 @default.
- W4383909651 hasConcept C86803240 @default.
- W4383909651 hasConcept C90805587 @default.
- W4383909651 hasConcept C94915269 @default.
- W4383909651 hasConcept C98045186 @default.
- W4383909651 hasConceptScore W4383909651C108010975 @default.
- W4383909651 hasConceptScore W4383909651C111368507 @default.
- W4383909651 hasConceptScore W4383909651C119857082 @default.
- W4383909651 hasConceptScore W4383909651C12725497 @default.
- W4383909651 hasConceptScore W4383909651C127313418 @default.
- W4383909651 hasConceptScore W4383909651C127413603 @default.
- W4383909651 hasConceptScore W4383909651C137293760 @default.
- W4383909651 hasConceptScore W4383909651C138885662 @default.
- W4383909651 hasConceptScore W4383909651C141603448 @default.
- W4383909651 hasConceptScore W4383909651C154945302 @default.
- W4383909651 hasConceptScore W4383909651C178790620 @default.
- W4383909651 hasConceptScore W4383909651C185592680 @default.
- W4383909651 hasConceptScore W4383909651C199360897 @default.
- W4383909651 hasConceptScore W4383909651C201995342 @default.
- W4383909651 hasConceptScore W4383909651C204030448 @default.