Matches in SemOpenAlex for { <https://semopenalex.org/work/W2948081755> ?p ?o ?g. }
- W2948081755 abstract "Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multiple linguistic analyses. Previous work has extended recurrent neural networks to model lattice inputs and achieved improvements in various tasks, but these models suffer from very slow computation speeds. This paper extends the recently proposed paradigm of self-attention to handle lattice inputs. Self-attention is a sequence modeling technique that relates inputs to one another by computing pairwise similarities and has gained popularity for both its strong results and its computational efficiency. To extend such models to handle lattices, we introduce probabilistic reachability masks that incorporate lattice structure into the model and support lattice scores if available. We also propose a method for adapting positional embeddings to lattice structures. We apply the proposed model to a speech translation task and find that it outperforms all examined baselines while being much faster to compute than previous neural lattice models during both training and inference." @default.
- W2948081755 created "2019-06-14" @default.
- W2948081755 creator A5004365148 @default.
- W2948081755 creator A5007526409 @default.
- W2948081755 creator A5024736091 @default.
- W2948081755 creator A5068811427 @default.
- W2948081755 date "2019-06-04" @default.
- W2948081755 modified "2023-09-27" @default.
- W2948081755 title "Self-Attentional Models for Lattice Inputs" @default.
- W2948081755 cites W1596841185 @default.
- W2948081755 cites W1879966306 @default.
- W2948081755 cites W1902237438 @default.
- W2948081755 cites W2011783148 @default.
- W2948081755 cites W2095705004 @default.
- W2948081755 cites W2113106066 @default.
- W2948081755 cites W2157435188 @default.
- W2948081755 cites W2164370343 @default.
- W2948081755 cites W2183341477 @default.
- W2948081755 cites W2194775991 @default.
- W2948081755 cites W2251939518 @default.
- W2948081755 cites W2267186426 @default.
- W2948081755 cites W2408724534 @default.
- W2948081755 cites W2413794162 @default.
- W2948081755 cites W2511962886 @default.
- W2948081755 cites W2577255746 @default.
- W2948081755 cites W2605202026 @default.
- W2948081755 cites W2757026815 @default.
- W2948081755 cites W2773734397 @default.
- W2948081755 cites W2798749466 @default.
- W2948081755 cites W2799119017 @default.
- W2948081755 cites W2899280787 @default.
- W2948081755 cites W2950898568 @default.
- W2948081755 cites W2962820991 @default.
- W2948081755 cites W2963069010 @default.
- W2948081755 cites W2963201387 @default.
- W2948081755 cites W2963266340 @default.
- W2948081755 cites W2963355447 @default.
- W2948081755 cites W2963386218 @default.
- W2948081755 cites W2963403868 @default.
- W2948081755 cites W2963653811 @default.
- W2948081755 cites W2963858333 @default.
- W2948081755 cites W2963964898 @default.
- W2948081755 cites W2964113829 @default.
- W2948081755 cites W2964121744 @default.
- W2948081755 cites W2964265128 @default.
- W2948081755 cites W2964308564 @default.
- W2948081755 cites W2964321699 @default.
- W2948081755 cites W3012492057 @default.
- W2948081755 cites W53604701 @default.
- W2948081755 hasPublicationYear "2019" @default.
- W2948081755 type Work @default.
- W2948081755 sameAs 2948081755 @default.
- W2948081755 citedByCount "0" @default.
- W2948081755 crossrefType "posted-content" @default.
- W2948081755 hasAuthorship W2948081755A5004365148 @default.
- W2948081755 hasAuthorship W2948081755A5007526409 @default.
- W2948081755 hasAuthorship W2948081755A5024736091 @default.
- W2948081755 hasAuthorship W2948081755A5068811427 @default.
- W2948081755 hasConcept C11413529 @default.
- W2948081755 hasConcept C121332964 @default.
- W2948081755 hasConcept C136643341 @default.
- W2948081755 hasConcept C137293760 @default.
- W2948081755 hasConcept C154945302 @default.
- W2948081755 hasConcept C184898388 @default.
- W2948081755 hasConcept C199360897 @default.
- W2948081755 hasConcept C24890656 @default.
- W2948081755 hasConcept C2776214188 @default.
- W2948081755 hasConcept C2780522230 @default.
- W2948081755 hasConcept C2781204021 @default.
- W2948081755 hasConcept C41008148 @default.
- W2948081755 hasConcept C45374587 @default.
- W2948081755 hasConcept C80444323 @default.
- W2948081755 hasConceptScore W2948081755C11413529 @default.
- W2948081755 hasConceptScore W2948081755C121332964 @default.
- W2948081755 hasConceptScore W2948081755C136643341 @default.
- W2948081755 hasConceptScore W2948081755C137293760 @default.
- W2948081755 hasConceptScore W2948081755C154945302 @default.
- W2948081755 hasConceptScore W2948081755C184898388 @default.
- W2948081755 hasConceptScore W2948081755C199360897 @default.
- W2948081755 hasConceptScore W2948081755C24890656 @default.
- W2948081755 hasConceptScore W2948081755C2776214188 @default.
- W2948081755 hasConceptScore W2948081755C2780522230 @default.
- W2948081755 hasConceptScore W2948081755C2781204021 @default.
- W2948081755 hasConceptScore W2948081755C41008148 @default.
- W2948081755 hasConceptScore W2948081755C45374587 @default.
- W2948081755 hasConceptScore W2948081755C80444323 @default.
- W2948081755 hasLocation W29480817551 @default.
- W2948081755 hasOpenAccess W2948081755 @default.
- W2948081755 hasPrimaryLocation W29480817551 @default.
- W2948081755 hasRelatedWork W1831449718 @default.
- W2948081755 hasRelatedWork W1843494895 @default.
- W2948081755 hasRelatedWork W2160660594 @default.
- W2948081755 hasRelatedWork W2208906386 @default.
- W2948081755 hasRelatedWork W2341757675 @default.
- W2948081755 hasRelatedWork W2468625129 @default.
- W2948081755 hasRelatedWork W2619042136 @default.
- W2948081755 hasRelatedWork W2786915849 @default.
- W2948081755 hasRelatedWork W2796075534 @default.
- W2948081755 hasRelatedWork W2883341762 @default.
- W2948081755 hasRelatedWork W2911896682 @default.