Matches in SemOpenAlex for { <https://semopenalex.org/work/W3205893931> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W3205893931 abstract "Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for memory and compute-efficient domain adaptation is obvious. Particularly, adapting parameter-heavy transformer-based language models used for rescoring ASR hypothesis is challenging. In this work, we overcome the problem using prompt-tuning, a methodology that trains a small number of domain token embedding parameters to prime a transformer-based LM to a particular domain. With just a handful of extra parameters per domain, we achieve much better perplexity scores over the baseline of using an unadapted LM. Despite being parameter-efficient, these improvements are comparable to those of fully-fine-tuned models with hundreds of millions of parameters. We replicate our findings in perplexity numbers to Word Error Rate in a domain-specific ASR system for one such domain." @default.
- W3205893931 created "2021-10-25" @default.
- W3205893931 creator A5014054572 @default.
- W3205893931 creator A5027419911 @default.
- W3205893931 creator A5030041600 @default.
- W3205893931 creator A5050071432 @default.
- W3205893931 creator A5050325468 @default.
- W3205893931 creator A5050552820 @default.
- W3205893931 date "2021-10-13" @default.
- W3205893931 modified "2023-09-23" @default.
- W3205893931 title "Efficient domain adaptation of language models in ASR systems using Prompt-tuning." @default.
- W3205893931 hasPublicationYear "2021" @default.
- W3205893931 type Work @default.
- W3205893931 sameAs 3205893931 @default.
- W3205893931 citedByCount "0" @default.
- W3205893931 crossrefType "posted-content" @default.
- W3205893931 hasAuthorship W3205893931A5014054572 @default.
- W3205893931 hasAuthorship W3205893931A5027419911 @default.
- W3205893931 hasAuthorship W3205893931A5030041600 @default.
- W3205893931 hasAuthorship W3205893931A5050071432 @default.
- W3205893931 hasAuthorship W3205893931A5050325468 @default.
- W3205893931 hasAuthorship W3205893931A5050552820 @default.
- W3205893931 hasConcept C100279451 @default.
- W3205893931 hasConcept C105795698 @default.
- W3205893931 hasConcept C121332964 @default.
- W3205893931 hasConcept C134306372 @default.
- W3205893931 hasConcept C137293760 @default.
- W3205893931 hasConcept C154945302 @default.
- W3205893931 hasConcept C157524613 @default.
- W3205893931 hasConcept C165801399 @default.
- W3205893931 hasConcept C2776434776 @default.
- W3205893931 hasConcept C2781162219 @default.
- W3205893931 hasConcept C28490314 @default.
- W3205893931 hasConcept C33923547 @default.
- W3205893931 hasConcept C36503486 @default.
- W3205893931 hasConcept C41008148 @default.
- W3205893931 hasConcept C41608201 @default.
- W3205893931 hasConcept C62520636 @default.
- W3205893931 hasConcept C66322947 @default.
- W3205893931 hasConcept C95623464 @default.
- W3205893931 hasConceptScore W3205893931C100279451 @default.
- W3205893931 hasConceptScore W3205893931C105795698 @default.
- W3205893931 hasConceptScore W3205893931C121332964 @default.
- W3205893931 hasConceptScore W3205893931C134306372 @default.
- W3205893931 hasConceptScore W3205893931C137293760 @default.
- W3205893931 hasConceptScore W3205893931C154945302 @default.
- W3205893931 hasConceptScore W3205893931C157524613 @default.
- W3205893931 hasConceptScore W3205893931C165801399 @default.
- W3205893931 hasConceptScore W3205893931C2776434776 @default.
- W3205893931 hasConceptScore W3205893931C2781162219 @default.
- W3205893931 hasConceptScore W3205893931C28490314 @default.
- W3205893931 hasConceptScore W3205893931C33923547 @default.
- W3205893931 hasConceptScore W3205893931C36503486 @default.
- W3205893931 hasConceptScore W3205893931C41008148 @default.
- W3205893931 hasConceptScore W3205893931C41608201 @default.
- W3205893931 hasConceptScore W3205893931C62520636 @default.
- W3205893931 hasConceptScore W3205893931C66322947 @default.
- W3205893931 hasConceptScore W3205893931C95623464 @default.
- W3205893931 hasLocation W32058939311 @default.
- W3205893931 hasOpenAccess W3205893931 @default.
- W3205893931 hasPrimaryLocation W32058939311 @default.
- W3205893931 hasRelatedWork W1504449689 @default.
- W3205893931 hasRelatedWork W2522791656 @default.
- W3205893931 hasRelatedWork W2548256801 @default.
- W3205893931 hasRelatedWork W2766058732 @default.
- W3205893931 hasRelatedWork W2886246524 @default.
- W3205893931 hasRelatedWork W2900312178 @default.
- W3205893931 hasRelatedWork W2950249261 @default.
- W3205893931 hasRelatedWork W2992448548 @default.
- W3205893931 hasRelatedWork W3010079784 @default.
- W3205893931 hasRelatedWork W3025521026 @default.
- W3205893931 hasRelatedWork W3081494755 @default.
- W3205893931 hasRelatedWork W3105804405 @default.
- W3205893931 hasRelatedWork W3137489363 @default.
- W3205893931 hasRelatedWork W3155343771 @default.
- W3205893931 hasRelatedWork W3162334527 @default.
- W3205893931 hasRelatedWork W3163339532 @default.
- W3205893931 hasRelatedWork W3198836239 @default.
- W3205893931 hasRelatedWork W3201225328 @default.
- W3205893931 hasRelatedWork W3202419788 @default.
- W3205893931 hasRelatedWork W3208017279 @default.
- W3205893931 isParatext "false" @default.
- W3205893931 isRetracted "false" @default.
- W3205893931 magId "3205893931" @default.
- W3205893931 workType "article" @default.