Matches in SemOpenAlex for { <https://semopenalex.org/work/W3186178610> ?p ?o ?g. }
- W3186178610 abstract "For articulatory-to-acoustic mapping, typically only limited parallel training data is available, making it impossible to apply fully end-to-end solutions like Tacotron2. In this paper, we experimented with transfer learning and adaptation of a Tacotron2 text-to-speech model to improve the final synthesis quality of ultrasound-based articulatory-to-acoustic mapping with a limited database. We use a multi-speaker pre-trained Tacotron2 TTS model and a pre-trained WaveGlow neural vocoder. The articulatory-to-acoustic conversion contains three steps: 1) from a sequence of ultrasound tongue image recordings, a 3D convolutional neural network predicts the inputs of the pre-trained Tacotron2 model, 2) the Tacotron2 model converts this intermediate representation to an 80-dimensional mel-spectrogram, and 3) the WaveGlow model is applied for final inference. This generated speech contains the timing of the original articulatory data from the ultrasound recording, but the F0 contour and the spectral information is predicted by the Tacotron2 model. The F0 values are independent of the original ultrasound images, but represent the target speaker, as they are inferred from the pre-trained Tacotron2 model. In our experiments, we demonstrated that the synthesized speech quality is more natural with the proposed solutions than with our earlier model." @default.
- W3186178610 created "2021-08-02" @default.
- W3186178610 creator A5016031960 @default.
- W3186178610 creator A5020608163 @default.
- W3186178610 creator A5026493983 @default.
- W3186178610 creator A5031237235 @default.
- W3186178610 creator A5069988513 @default.
- W3186178610 creator A5085147054 @default.
- W3186178610 creator A5088559776 @default.
- W3186178610 date "2021-07-26" @default.
- W3186178610 modified "2023-09-28" @default.
- W3186178610 title "Adaptation of Tacotron2-based Text-To-Speech for Articulatory-to-Acoustic Mapping using Ultrasound Tongue Imaging" @default.
- W3186178610 cites W1983364832 @default.
- W3186178610 cites W1995735739 @default.
- W3186178610 cites W2008120082 @default.
- W3186178610 cites W2064675550 @default.
- W3186178610 cites W2145442746 @default.
- W3186178610 cites W2163605009 @default.
- W3186178610 cites W2294901616 @default.
- W3186178610 cites W2296650368 @default.
- W3186178610 cites W2419247625 @default.
- W3186178610 cites W2482033662 @default.
- W3186178610 cites W2515755543 @default.
- W3186178610 cites W2519091744 @default.
- W3186178610 cites W2546134918 @default.
- W3186178610 cites W2585227925 @default.
- W3186178610 cites W2585824449 @default.
- W3186178610 cites W2603597171 @default.
- W3186178610 cites W2746109435 @default.
- W3186178610 cites W2768153200 @default.
- W3186178610 cites W2770785043 @default.
- W3186178610 cites W2888796252 @default.
- W3186178610 cites W2888815552 @default.
- W3186178610 cites W2888917702 @default.
- W3186178610 cites W2889853672 @default.
- W3186178610 cites W2897318954 @default.
- W3186178610 cites W2952436057 @default.
- W3186178610 cites W2955236751 @default.
- W3186178610 cites W2963155035 @default.
- W3186178610 cites W2963300588 @default.
- W3186178610 cites W2964243274 @default.
- W3186178610 cites W2972959620 @default.
- W3186178610 cites W2978506536 @default.
- W3186178610 cites W3013952251 @default.
- W3186178610 cites W3083438180 @default.
- W3186178610 cites W3086311074 @default.
- W3186178610 cites W3094463005 @default.
- W3186178610 cites W3095801312 @default.
- W3186178610 cites W3117304755 @default.
- W3186178610 cites W3135248196 @default.
- W3186178610 cites W3143787022 @default.
- W3186178610 cites W3157840621 @default.
- W3186178610 cites W3173314831 @default.
- W3186178610 cites W3174954176 @default.
- W3186178610 hasPublicationYear "2021" @default.
- W3186178610 type Work @default.
- W3186178610 sameAs 3186178610 @default.
- W3186178610 citedByCount "0" @default.
- W3186178610 crossrefType "posted-content" @default.
- W3186178610 hasAuthorship W3186178610A5016031960 @default.
- W3186178610 hasAuthorship W3186178610A5020608163 @default.
- W3186178610 hasAuthorship W3186178610A5026493983 @default.
- W3186178610 hasAuthorship W3186178610A5031237235 @default.
- W3186178610 hasAuthorship W3186178610A5069988513 @default.
- W3186178610 hasAuthorship W3186178610A5085147054 @default.
- W3186178610 hasAuthorship W3186178610A5088559776 @default.
- W3186178610 hasConcept C120665830 @default.
- W3186178610 hasConcept C121332964 @default.
- W3186178610 hasConcept C139807058 @default.
- W3186178610 hasConcept C14999030 @default.
- W3186178610 hasConcept C153180895 @default.
- W3186178610 hasConcept C154945302 @default.
- W3186178610 hasConcept C17744445 @default.
- W3186178610 hasConcept C199539241 @default.
- W3186178610 hasConcept C2776359362 @default.
- W3186178610 hasConcept C28490314 @default.
- W3186178610 hasConcept C41008148 @default.
- W3186178610 hasConcept C45273575 @default.
- W3186178610 hasConcept C50644808 @default.
- W3186178610 hasConcept C81363708 @default.
- W3186178610 hasConcept C94625758 @default.
- W3186178610 hasConceptScore W3186178610C120665830 @default.
- W3186178610 hasConceptScore W3186178610C121332964 @default.
- W3186178610 hasConceptScore W3186178610C139807058 @default.
- W3186178610 hasConceptScore W3186178610C14999030 @default.
- W3186178610 hasConceptScore W3186178610C153180895 @default.
- W3186178610 hasConceptScore W3186178610C154945302 @default.
- W3186178610 hasConceptScore W3186178610C17744445 @default.
- W3186178610 hasConceptScore W3186178610C199539241 @default.
- W3186178610 hasConceptScore W3186178610C2776359362 @default.
- W3186178610 hasConceptScore W3186178610C28490314 @default.
- W3186178610 hasConceptScore W3186178610C41008148 @default.
- W3186178610 hasConceptScore W3186178610C45273575 @default.
- W3186178610 hasConceptScore W3186178610C50644808 @default.
- W3186178610 hasConceptScore W3186178610C81363708 @default.
- W3186178610 hasConceptScore W3186178610C94625758 @default.
- W3186178610 hasLocation W31861786101 @default.
- W3186178610 hasOpenAccess W3186178610 @default.
- W3186178610 hasPrimaryLocation W31861786101 @default.
- W3186178610 hasRelatedWork W1004616342 @default.