FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3135676170> ?p ?o ?g. }

• W3135676170 abstract "Pseudo-labeling is the most adopted method for pre-training automatic speech recognition (ASR) models. However, its performance suffers from the supervised teacher model's degrading quality in low-resource setups and under domain transfer. Inspired by the successes of contrastive representation learning for computer vision and speech applications, and more recently for supervised learning of visual objects, we propose Contrastive Semi-supervised Learning (CSL). CSL eschews directly predicting teacher-generated pseudo-labels in favor of utilizing them to select positive and negative examples. In the challenging task of transcribing public social media videos, using CSL reduces the WER by 8% compared to the standard Cross-Entropy pseudo-labeling (CE-PL) when 10hr of supervised data is used to annotate 75,000hr of videos. The WER reduction jumps to 19% under the ultra low-resource condition of using 1hr labels for teacher supervision. CSL generalizes much better in out-of-domain conditions, showing up to 17% WER reduction compared to the best CE-PL pre-trained model." @default.
• W3135676170 created "2021-03-15" @default.
• W3135676170 creator A5042186348 @default.
• W3135676170 creator A5047073253 @default.
• W3135676170 creator A5056584611 @default.
• W3135676170 date "2021-03-08" @default.
• W3135676170 modified "2023-10-18" @default.
• W3135676170 title "Contrastive Semi-supervised Learning for ASR" @default.
• W3135676170 cites W15497043 @default.
• W3135676170 cites W1555037511 @default.
• W3135676170 cites W2033256038 @default.
• W3135676170 cites W2056786202 @default.
• W3135676170 cites W2110073835 @default.
• W3135676170 cites W2127141656 @default.
• W3135676170 cites W2134797427 @default.
• W3135676170 cites W2139698650 @default.
• W3135676170 cites W2407080277 @default.
• W3135676170 cites W2622263826 @default.
• W3135676170 cites W2842511635 @default.
• W3135676170 cites W2936774411 @default.
• W3135676170 cites W2963112338 @default.
• W3135676170 cites W2964121744 @default.
• W3135676170 cites W2973049979 @default.
• W3135676170 cites W2981857663 @default.
• W3135676170 cites W2982223350 @default.
• W3135676170 cites W2988736778 @default.
• W3135676170 cites W2991213871 @default.
• W3135676170 cites W3008525923 @default.
• W3135676170 cites W3015265920 @default.
• W3135676170 cites W3015522062 @default.
• W3135676170 cites W3016011332 @default.
• W3135676170 cites W3026041220 @default.
• W3135676170 cites W3035524453 @default.
• W3135676170 cites W3094647783 @default.
• W3135676170 cites W3096338464 @default.
• W3135676170 cites W3099782249 @default.
• W3135676170 cites W3100345210 @default.
• W3135676170 cites W3160799772 @default.
• W3135676170 doi "https://doi.org/10.48550/arxiv.2103.05149" @default.
• W3135676170 hasPublicationYear "2021" @default.
• W3135676170 type Work @default.
• W3135676170 sameAs 3135676170 @default.
• W3135676170 citedByCount "1" @default.
• W3135676170 countsByYear W31356761702021 @default.
• W3135676170 crossrefType "posted-content" @default.
• W3135676170 hasAuthorship W3135676170A5042186348 @default.
• W3135676170 hasAuthorship W3135676170A5047073253 @default.
• W3135676170 hasAuthorship W3135676170A5056584611 @default.
• W3135676170 hasBestOaLocation W31356761701 @default.
• W3135676170 hasConcept C106301342 @default.
• W3135676170 hasConcept C111335779 @default.
• W3135676170 hasConcept C111472728 @default.
• W3135676170 hasConcept C119857082 @default.
• W3135676170 hasConcept C121332964 @default.
• W3135676170 hasConcept C134306372 @default.
• W3135676170 hasConcept C136389625 @default.
• W3135676170 hasConcept C138885662 @default.
• W3135676170 hasConcept C150899416 @default.
• W3135676170 hasConcept C153180895 @default.
• W3135676170 hasConcept C154945302 @default.
• W3135676170 hasConcept C162324750 @default.
• W3135676170 hasConcept C167981619 @default.
• W3135676170 hasConcept C17744445 @default.
• W3135676170 hasConcept C187736073 @default.
• W3135676170 hasConcept C199539241 @default.
• W3135676170 hasConcept C204321447 @default.
• W3135676170 hasConcept C2524010 @default.
• W3135676170 hasConcept C2776145971 @default.
• W3135676170 hasConcept C2776359362 @default.
• W3135676170 hasConcept C2779530757 @default.
• W3135676170 hasConcept C2780451532 @default.
• W3135676170 hasConcept C28490314 @default.
• W3135676170 hasConcept C33923547 @default.
• W3135676170 hasConcept C36503486 @default.
• W3135676170 hasConcept C41008148 @default.
• W3135676170 hasConcept C50644808 @default.
• W3135676170 hasConcept C51632099 @default.
• W3135676170 hasConcept C58973888 @default.
• W3135676170 hasConcept C62520636 @default.
• W3135676170 hasConcept C94625758 @default.
• W3135676170 hasConceptScore W3135676170C106301342 @default.
• W3135676170 hasConceptScore W3135676170C111335779 @default.
• W3135676170 hasConceptScore W3135676170C111472728 @default.
• W3135676170 hasConceptScore W3135676170C119857082 @default.
• W3135676170 hasConceptScore W3135676170C121332964 @default.
• W3135676170 hasConceptScore W3135676170C134306372 @default.
• W3135676170 hasConceptScore W3135676170C136389625 @default.
• W3135676170 hasConceptScore W3135676170C138885662 @default.
• W3135676170 hasConceptScore W3135676170C150899416 @default.
• W3135676170 hasConceptScore W3135676170C153180895 @default.
• W3135676170 hasConceptScore W3135676170C154945302 @default.
• W3135676170 hasConceptScore W3135676170C162324750 @default.
• W3135676170 hasConceptScore W3135676170C167981619 @default.
• W3135676170 hasConceptScore W3135676170C17744445 @default.
• W3135676170 hasConceptScore W3135676170C187736073 @default.
• W3135676170 hasConceptScore W3135676170C199539241 @default.
• W3135676170 hasConceptScore W3135676170C204321447 @default.
• W3135676170 hasConceptScore W3135676170C2524010 @default.
• W3135676170 hasConceptScore W3135676170C2776145971 @default.
• W3135676170 hasConceptScore W3135676170C2776359362 @default.

• next