Matches in SemOpenAlex for { <https://semopenalex.org/work/W3162133897> ?p ?o ?g. }
- W3162133897 abstract "Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of speech tasks have also been investigated. However, there has been little research focusing on understanding the properties of existing approaches. In this work, we aim to provide a comparative study of some of the most representative self-supervised algorithms. Specifically, we quantify the similarities between different self-supervised representations using existing similarity measures. We also design probing tasks to study the correlation between the models’ pre-training loss and the amount of specific speech information contained in their learned representations. In addition to showing how various self-supervised models behave differently given the same input, our study also finds that the training objective has a higher impact on representation similarity than architectural choices such as building blocks (RNN/Transformer/CNN) and directionality (uni/bidirectional). Our results also suggest that there exists a strong correlation between pre-training loss and downstream performance for some self-supervised algorithms." @default.
- W3162133897 created "2021-05-24" @default.
- W3162133897 creator A5008107321 @default.
- W3162133897 creator A5039081803 @default.
- W3162133897 creator A5051184573 @default.
- W3162133897 date "2021-06-06" @default.
- W3162133897 modified "2023-10-14" @default.
- W3162133897 title "Similarity Analysis of Self-Supervised Speech Representations" @default.
- W3162133897 cites W1494198834 @default.
- W3162133897 cites W2160654481 @default.
- W3162133897 cites W2748318213 @default.
- W3162133897 cites W2936774411 @default.
- W3162133897 cites W2962739339 @default.
- W3162133897 cites W2972943112 @default.
- W3162133897 cites W2973049979 @default.
- W3162133897 cites W2973157397 @default.
- W3162133897 cites W2982223350 @default.
- W3162133897 cites W3003875258 @default.
- W3162133897 cites W3015265920 @default.
- W3162133897 cites W3015356564 @default.
- W3162133897 cites W3016011332 @default.
- W3162133897 cites W3016181583 @default.
- W3162133897 cites W3035202887 @default.
- W3162133897 cites W3044483536 @default.
- W3162133897 cites W3049256661 @default.
- W3162133897 cites W3096485810 @default.
- W3162133897 cites W3096656254 @default.
- W3162133897 cites W3097053302 @default.
- W3162133897 cites W3097286738 @default.
- W3162133897 cites W3097787369 @default.
- W3162133897 doi "https://doi.org/10.1109/icassp39728.2021.9414321" @default.
- W3162133897 hasPublicationYear "2021" @default.
- W3162133897 type Work @default.
- W3162133897 sameAs 3162133897 @default.
- W3162133897 citedByCount "14" @default.
- W3162133897 countsByYear W31621338972021 @default.
- W3162133897 countsByYear W31621338972022 @default.
- W3162133897 countsByYear W31621338972023 @default.
- W3162133897 crossrefType "proceedings-article" @default.
- W3162133897 hasAuthorship W3162133897A5008107321 @default.
- W3162133897 hasAuthorship W3162133897A5039081803 @default.
- W3162133897 hasAuthorship W3162133897A5051184573 @default.
- W3162133897 hasBestOaLocation W31621338972 @default.
- W3162133897 hasConcept C103278499 @default.
- W3162133897 hasConcept C115961682 @default.
- W3162133897 hasConcept C117220453 @default.
- W3162133897 hasConcept C119857082 @default.
- W3162133897 hasConcept C121332964 @default.
- W3162133897 hasConcept C136389625 @default.
- W3162133897 hasConcept C154945302 @default.
- W3162133897 hasConcept C165801399 @default.
- W3162133897 hasConcept C17744445 @default.
- W3162133897 hasConcept C199539241 @default.
- W3162133897 hasConcept C204321447 @default.
- W3162133897 hasConcept C2524010 @default.
- W3162133897 hasConcept C2776359362 @default.
- W3162133897 hasConcept C33923547 @default.
- W3162133897 hasConcept C41008148 @default.
- W3162133897 hasConcept C50644808 @default.
- W3162133897 hasConcept C58973888 @default.
- W3162133897 hasConcept C59404180 @default.
- W3162133897 hasConcept C62520636 @default.
- W3162133897 hasConcept C66322947 @default.
- W3162133897 hasConcept C94625758 @default.
- W3162133897 hasConceptScore W3162133897C103278499 @default.
- W3162133897 hasConceptScore W3162133897C115961682 @default.
- W3162133897 hasConceptScore W3162133897C117220453 @default.
- W3162133897 hasConceptScore W3162133897C119857082 @default.
- W3162133897 hasConceptScore W3162133897C121332964 @default.
- W3162133897 hasConceptScore W3162133897C136389625 @default.
- W3162133897 hasConceptScore W3162133897C154945302 @default.
- W3162133897 hasConceptScore W3162133897C165801399 @default.
- W3162133897 hasConceptScore W3162133897C17744445 @default.
- W3162133897 hasConceptScore W3162133897C199539241 @default.
- W3162133897 hasConceptScore W3162133897C204321447 @default.
- W3162133897 hasConceptScore W3162133897C2524010 @default.
- W3162133897 hasConceptScore W3162133897C2776359362 @default.
- W3162133897 hasConceptScore W3162133897C33923547 @default.
- W3162133897 hasConceptScore W3162133897C41008148 @default.
- W3162133897 hasConceptScore W3162133897C50644808 @default.
- W3162133897 hasConceptScore W3162133897C58973888 @default.
- W3162133897 hasConceptScore W3162133897C59404180 @default.
- W3162133897 hasConceptScore W3162133897C62520636 @default.
- W3162133897 hasConceptScore W3162133897C66322947 @default.
- W3162133897 hasConceptScore W3162133897C94625758 @default.
- W3162133897 hasLocation W31621338971 @default.
- W3162133897 hasLocation W31621338972 @default.
- W3162133897 hasOpenAccess W3162133897 @default.
- W3162133897 hasPrimaryLocation W31621338971 @default.
- W3162133897 hasRelatedWork W1243554 @default.
- W3162133897 hasRelatedWork W149980 @default.
- W3162133897 hasRelatedWork W1808847 @default.
- W3162133897 hasRelatedWork W5192282 @default.
- W3162133897 hasRelatedWork W6836841 @default.
- W3162133897 hasRelatedWork W7382899 @default.
- W3162133897 hasRelatedWork W8671328 @default.
- W3162133897 hasRelatedWork W9321062 @default.
- W3162133897 hasRelatedWork W9770290 @default.
- W3162133897 hasRelatedWork W11830398 @default.
- W3162133897 isParatext "false" @default.