Matches in SemOpenAlex for { <https://semopenalex.org/work/W3024182269> ?p ?o ?g. }
Showing items 1 to 68 of
68
with 100 items per page.
- W3024182269 abstract "We introduce BERTphone, a Transformer encoder trained on large speech corpora that outputs phonetically-aware contextual representation vectors that can be used for both speaker and language recognition. This is accomplished by training on two objectives: the first, inspired by adapting BERT to the continuous domain, involves masking spans of input frames and reconstructing the whole sequence for acoustic representation learning; the second, inspired by the success of bottleneck features from ASR, is a sequence-level CTC loss applied to phoneme labels for phonetic representation learning. We pretrain two BERTphone models (one on Fisher and one on TED-LIUM) and use them as feature extractors into x-vector-style DNNs for both tasks. We attain a state-of-the-art $C_{text{avg}}$ of 6.16 on the challenging LRE07 3sec closed-set language recognition task. On Fisher and VoxCeleb speaker recognition tasks, we see an 18% relative reduction in speaker EER when training on BERTphone vectors instead of MFCCs. In general, BERTphone outperforms previous phonetic pretraining approaches on the same data. We release our code and models at https://github.com/awslabs/speech-representations." @default.
- W3024182269 created "2020-05-21" @default.
- W3024182269 creator A5000919546 @default.
- W3024182269 creator A5037283647 @default.
- W3024182269 creator A5050325468 @default.
- W3024182269 creator A5077518802 @default.
- W3024182269 date "2020-11-01" @default.
- W3024182269 modified "2023-09-28" @default.
- W3024182269 title "BERTphone: Phonetically-aware Encoder Representations for Utterance-level Speaker and Language Recognition" @default.
- W3024182269 doi "https://doi.org/10.21437/odyssey.2020-2" @default.
- W3024182269 hasPublicationYear "2020" @default.
- W3024182269 type Work @default.
- W3024182269 sameAs 3024182269 @default.
- W3024182269 citedByCount "23" @default.
- W3024182269 countsByYear W30241822692020 @default.
- W3024182269 countsByYear W30241822692021 @default.
- W3024182269 countsByYear W30241822692022 @default.
- W3024182269 countsByYear W30241822692023 @default.
- W3024182269 crossrefType "proceedings-article" @default.
- W3024182269 hasAuthorship W3024182269A5000919546 @default.
- W3024182269 hasAuthorship W3024182269A5037283647 @default.
- W3024182269 hasAuthorship W3024182269A5050325468 @default.
- W3024182269 hasAuthorship W3024182269A5077518802 @default.
- W3024182269 hasBestOaLocation W30241822692 @default.
- W3024182269 hasConcept C111919701 @default.
- W3024182269 hasConcept C118505674 @default.
- W3024182269 hasConcept C133892786 @default.
- W3024182269 hasConcept C137293760 @default.
- W3024182269 hasConcept C154945302 @default.
- W3024182269 hasConcept C17744445 @default.
- W3024182269 hasConcept C199539241 @default.
- W3024182269 hasConcept C204321447 @default.
- W3024182269 hasConcept C2775852435 @default.
- W3024182269 hasConcept C2776359362 @default.
- W3024182269 hasConcept C28490314 @default.
- W3024182269 hasConcept C41008148 @default.
- W3024182269 hasConcept C94625758 @default.
- W3024182269 hasConceptScore W3024182269C111919701 @default.
- W3024182269 hasConceptScore W3024182269C118505674 @default.
- W3024182269 hasConceptScore W3024182269C133892786 @default.
- W3024182269 hasConceptScore W3024182269C137293760 @default.
- W3024182269 hasConceptScore W3024182269C154945302 @default.
- W3024182269 hasConceptScore W3024182269C17744445 @default.
- W3024182269 hasConceptScore W3024182269C199539241 @default.
- W3024182269 hasConceptScore W3024182269C204321447 @default.
- W3024182269 hasConceptScore W3024182269C2775852435 @default.
- W3024182269 hasConceptScore W3024182269C2776359362 @default.
- W3024182269 hasConceptScore W3024182269C28490314 @default.
- W3024182269 hasConceptScore W3024182269C41008148 @default.
- W3024182269 hasConceptScore W3024182269C94625758 @default.
- W3024182269 hasLocation W30241822691 @default.
- W3024182269 hasLocation W30241822692 @default.
- W3024182269 hasOpenAccess W3024182269 @default.
- W3024182269 hasPrimaryLocation W30241822691 @default.
- W3024182269 hasRelatedWork W1901037250 @default.
- W3024182269 hasRelatedWork W1901264808 @default.
- W3024182269 hasRelatedWork W1946464671 @default.
- W3024182269 hasRelatedWork W2088522790 @default.
- W3024182269 hasRelatedWork W2136038945 @default.
- W3024182269 hasRelatedWork W2291725357 @default.
- W3024182269 hasRelatedWork W2401203293 @default.
- W3024182269 hasRelatedWork W2804625088 @default.
- W3024182269 hasRelatedWork W2997340161 @default.
- W3024182269 hasRelatedWork W58284675 @default.
- W3024182269 isParatext "false" @default.
- W3024182269 isRetracted "false" @default.
- W3024182269 magId "3024182269" @default.
- W3024182269 workType "article" @default.