Matches in SemOpenAlex for { <https://semopenalex.org/work/W4309657976> ?p ?o ?g. }
- W4309657976 endingPage "233121652211369" @default.
- W4309657976 startingPage "233121652211369" @default.
- W4309657976 abstract "Listening in a noisy environment is challenging, but many previous studies have demonstrated that comprehension of speech can be substantially improved by looking at the talker's face. We recently developed a deep neural network (DNN) based system that generates movies of a talking face from speech audio and a single face image. In this study, we aimed to quantify the benefits that such a system can bring to speech comprehension, especially in noise. The target speech audio was masked with signal to noise ratios of −9, −6, −3, and 0 dB and was presented to subjects in three audio-visual (AV) stimulus conditions: (1) synthesized AV: audio with the synthesized talking face movie; (2) natural AV: audio with the original movie from the corpus; and (3) audio-only: audio with a static image of the talker. Subjects were asked to type the sentences they heard in each trial and keyword recognition was quantified for each condition. Overall, performance in the synthesized AV condition fell approximately halfway between the other two conditions, showing a marked improvement over the audio-only control but still falling short of the natural AV condition. Every subject showed some benefit from the synthetic AV stimulus. The results of this study support the idea that a DNN-based model that generates a talking face from speech audio can meaningfully enhance comprehension in noisy environments, and has the potential to be used as a visual hearing aid." @default.
- W4309657976 created "2022-11-29" @default.
- W4309657976 creator A5007032744 @default.
- W4309657976 creator A5019459157 @default.
- W4309657976 creator A5024193640 @default.
- W4309657976 creator A5031488938 @default.
- W4309657976 creator A5064805926 @default.
- W4309657976 date "2022-01-01" @default.
- W4309657976 modified "2023-10-14" @default.
- W4309657976 title "Speech-In-Noise Comprehension is Improved When Viewing a Deep-Neural-Network-Generated Talking Face" @default.
- W4309657976 cites W1543892424 @default.
- W4309657976 cites W1670311576 @default.
- W4309657976 cites W1891702304 @default.
- W4309657976 cites W1971168548 @default.
- W4309657976 cites W1974604838 @default.
- W4309657976 cites W1974768933 @default.
- W4309657976 cites W1975259674 @default.
- W4309657976 cites W1976985738 @default.
- W4309657976 cites W1981807064 @default.
- W4309657976 cites W1991139021 @default.
- W4309657976 cites W2014621385 @default.
- W4309657976 cites W2021843855 @default.
- W4309657976 cites W2022214202 @default.
- W4309657976 cites W2032693983 @default.
- W4309657976 cites W2141477623 @default.
- W4309657976 cites W2147222770 @default.
- W4309657976 cites W2150625370 @default.
- W4309657976 cites W2163334800 @default.
- W4309657976 cites W2319740665 @default.
- W4309657976 cites W2738406145 @default.
- W4309657976 cites W2795230330 @default.
- W4309657976 cites W2914217321 @default.
- W4309657976 cites W2944294033 @default.
- W4309657976 cites W2950632174 @default.
- W4309657976 cites W2963081548 @default.
- W4309657976 cites W2970594866 @default.
- W4309657976 cites W2979894294 @default.
- W4309657976 cites W3009546922 @default.
- W4309657976 cites W3011016137 @default.
- W4309657976 cites W3015814181 @default.
- W4309657976 cites W3107666850 @default.
- W4309657976 cites W3132093913 @default.
- W4309657976 cites W3168046499 @default.
- W4309657976 cites W3175120665 @default.
- W4309657976 cites W4220776197 @default.
- W4309657976 cites W4226039695 @default.
- W4309657976 cites W4283787891 @default.
- W4309657976 doi "https://doi.org/10.1177/23312165221136934" @default.
- W4309657976 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/36384325" @default.
- W4309657976 hasPublicationYear "2022" @default.
- W4309657976 type Work @default.
- W4309657976 citedByCount "0" @default.
- W4309657976 crossrefType "journal-article" @default.
- W4309657976 hasAuthorship W4309657976A5007032744 @default.
- W4309657976 hasAuthorship W4309657976A5019459157 @default.
- W4309657976 hasAuthorship W4309657976A5024193640 @default.
- W4309657976 hasAuthorship W4309657976A5031488938 @default.
- W4309657976 hasAuthorship W4309657976A5064805926 @default.
- W4309657976 hasBestOaLocation W43096579761 @default.
- W4309657976 hasConcept C115961682 @default.
- W4309657976 hasConcept C154945302 @default.
- W4309657976 hasConcept C15744967 @default.
- W4309657976 hasConcept C177291462 @default.
- W4309657976 hasConcept C180747234 @default.
- W4309657976 hasConcept C199360897 @default.
- W4309657976 hasConcept C2779918689 @default.
- W4309657976 hasConcept C28490314 @default.
- W4309657976 hasConcept C41008148 @default.
- W4309657976 hasConcept C46312422 @default.
- W4309657976 hasConcept C50644808 @default.
- W4309657976 hasConcept C511192102 @default.
- W4309657976 hasConcept C99498987 @default.
- W4309657976 hasConceptScore W4309657976C115961682 @default.
- W4309657976 hasConceptScore W4309657976C154945302 @default.
- W4309657976 hasConceptScore W4309657976C15744967 @default.
- W4309657976 hasConceptScore W4309657976C177291462 @default.
- W4309657976 hasConceptScore W4309657976C180747234 @default.
- W4309657976 hasConceptScore W4309657976C199360897 @default.
- W4309657976 hasConceptScore W4309657976C2779918689 @default.
- W4309657976 hasConceptScore W4309657976C28490314 @default.
- W4309657976 hasConceptScore W4309657976C41008148 @default.
- W4309657976 hasConceptScore W4309657976C46312422 @default.
- W4309657976 hasConceptScore W4309657976C50644808 @default.
- W4309657976 hasConceptScore W4309657976C511192102 @default.
- W4309657976 hasConceptScore W4309657976C99498987 @default.
- W4309657976 hasFunder F4320337352 @default.
- W4309657976 hasLocation W43096579761 @default.
- W4309657976 hasLocation W43096579762 @default.
- W4309657976 hasLocation W43096579763 @default.
- W4309657976 hasLocation W43096579764 @default.
- W4309657976 hasOpenAccess W4309657976 @default.
- W4309657976 hasPrimaryLocation W43096579761 @default.
- W4309657976 hasRelatedWork W1997653553 @default.
- W4309657976 hasRelatedWork W1999953756 @default.
- W4309657976 hasRelatedWork W2030634252 @default.
- W4309657976 hasRelatedWork W2051128929 @default.
- W4309657976 hasRelatedWork W2084741236 @default.
- W4309657976 hasRelatedWork W2087140573 @default.