Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287219610> ?p ?o ?g. }
- W4287219610 endingPage "5501" @default.
- W4287219610 startingPage "5501" @default.
- W4287219610 abstract "Audio-visual speech recognition (AVSR) can significantly improve performance over audio-only recognition for small or medium vocabularies. However, current AVSR, whether hybrid or end-to-end (E2E), still does not appear to make optimal use of this secondary information stream as the performance is still clearly diminished in noisy conditions for large-vocabulary systems. We, therefore, propose a new fusion architecture—the decision fusion net (DFN). A broad range of time-variant reliability measures are used as an auxiliary input to improve performance. The DFN is used in both hybrid and E2E models. Our experiments on two large-vocabulary datasets, the Lip Reading Sentences 2 and 3 (LRS2 and LRS3) corpora, show highly significant improvements in performance over previous AVSR systems for large-vocabulary datasets. The hybrid model with the proposed DFN integration component even outperforms oracle dynamic stream-weighting, which is considered to be the theoretical upper bound for conventional dynamic stream-weighting approaches. Compared to the hybrid audio-only model, the proposed DFN achieves a relative word-error-rate reduction of 51% on average, while the E2E-DFN model, with its more competitive audio-only baseline system, achieves a relative word error rate reduction of 43%, both showing the efficacy of our proposed fusion architecture." @default.
- W4287219610 created "2022-07-25" @default.
- W4287219610 creator A5007017640 @default.
- W4287219610 creator A5019861809 @default.
- W4287219610 creator A5046724251 @default.
- W4287219610 date "2022-07-23" @default.
- W4287219610 modified "2023-09-26" @default.
- W4287219610 title "Reliability-Based Large-Vocabulary Audio-Visual Speech Recognition" @default.
- W4287219610 cites W1576996184 @default.
- W4287219610 cites W1978380426 @default.
- W4287219610 cites W2015394094 @default.
- W4287219610 cites W2023334087 @default.
- W4287219610 cites W2024490110 @default.
- W4287219610 cites W2035777533 @default.
- W4287219610 cites W2047619634 @default.
- W4287219610 cites W2096391593 @default.
- W4287219610 cites W2098562545 @default.
- W4287219610 cites W2101200205 @default.
- W4287219610 cites W2133115605 @default.
- W4287219610 cites W2144121180 @default.
- W4287219610 cites W2151802380 @default.
- W4287219610 cites W2303024254 @default.
- W4287219610 cites W2521686623 @default.
- W4287219610 cites W2696731410 @default.
- W4287219610 cites W2890952074 @default.
- W4287219610 cites W2952979007 @default.
- W4287219610 cites W3000086239 @default.
- W4287219610 cites W3011234510 @default.
- W4287219610 cites W3115365386 @default.
- W4287219610 doi "https://doi.org/10.3390/s22155501" @default.
- W4287219610 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/35898005" @default.
- W4287219610 hasPublicationYear "2022" @default.
- W4287219610 type Work @default.
- W4287219610 citedByCount "1" @default.
- W4287219610 countsByYear W42872196102023 @default.
- W4287219610 crossrefType "journal-article" @default.
- W4287219610 hasAuthorship W4287219610A5007017640 @default.
- W4287219610 hasAuthorship W4287219610A5019861809 @default.
- W4287219610 hasAuthorship W4287219610A5046724251 @default.
- W4287219610 hasBestOaLocation W42872196101 @default.
- W4287219610 hasConcept C111335779 @default.
- W4287219610 hasConcept C115903868 @default.
- W4287219610 hasConcept C121332964 @default.
- W4287219610 hasConcept C126838900 @default.
- W4287219610 hasConcept C138885662 @default.
- W4287219610 hasConcept C154945302 @default.
- W4287219610 hasConcept C163258240 @default.
- W4287219610 hasConcept C183115368 @default.
- W4287219610 hasConcept C23224414 @default.
- W4287219610 hasConcept C2524010 @default.
- W4287219610 hasConcept C2777601683 @default.
- W4287219610 hasConcept C28490314 @default.
- W4287219610 hasConcept C33923547 @default.
- W4287219610 hasConcept C40969351 @default.
- W4287219610 hasConcept C41008148 @default.
- W4287219610 hasConcept C41895202 @default.
- W4287219610 hasConcept C43214815 @default.
- W4287219610 hasConcept C55166926 @default.
- W4287219610 hasConcept C62520636 @default.
- W4287219610 hasConcept C71924100 @default.
- W4287219610 hasConcept C90805587 @default.
- W4287219610 hasConceptScore W4287219610C111335779 @default.
- W4287219610 hasConceptScore W4287219610C115903868 @default.
- W4287219610 hasConceptScore W4287219610C121332964 @default.
- W4287219610 hasConceptScore W4287219610C126838900 @default.
- W4287219610 hasConceptScore W4287219610C138885662 @default.
- W4287219610 hasConceptScore W4287219610C154945302 @default.
- W4287219610 hasConceptScore W4287219610C163258240 @default.
- W4287219610 hasConceptScore W4287219610C183115368 @default.
- W4287219610 hasConceptScore W4287219610C23224414 @default.
- W4287219610 hasConceptScore W4287219610C2524010 @default.
- W4287219610 hasConceptScore W4287219610C2777601683 @default.
- W4287219610 hasConceptScore W4287219610C28490314 @default.
- W4287219610 hasConceptScore W4287219610C33923547 @default.
- W4287219610 hasConceptScore W4287219610C40969351 @default.
- W4287219610 hasConceptScore W4287219610C41008148 @default.
- W4287219610 hasConceptScore W4287219610C41895202 @default.
- W4287219610 hasConceptScore W4287219610C43214815 @default.
- W4287219610 hasConceptScore W4287219610C55166926 @default.
- W4287219610 hasConceptScore W4287219610C62520636 @default.
- W4287219610 hasConceptScore W4287219610C71924100 @default.
- W4287219610 hasConceptScore W4287219610C90805587 @default.
- W4287219610 hasFunder F4320320879 @default.
- W4287219610 hasIssue "15" @default.
- W4287219610 hasLocation W42872196101 @default.
- W4287219610 hasLocation W42872196102 @default.
- W4287219610 hasLocation W42872196103 @default.
- W4287219610 hasOpenAccess W4287219610 @default.
- W4287219610 hasPrimaryLocation W42872196101 @default.
- W4287219610 hasRelatedWork W1570102481 @default.
- W4287219610 hasRelatedWork W1717589883 @default.
- W4287219610 hasRelatedWork W1963734729 @default.
- W4287219610 hasRelatedWork W2101346879 @default.
- W4287219610 hasRelatedWork W2112039799 @default.
- W4287219610 hasRelatedWork W2118293761 @default.
- W4287219610 hasRelatedWork W2123092024 @default.
- W4287219610 hasRelatedWork W2134995938 @default.
- W4287219610 hasRelatedWork W2116192687 @default.