Matches in SemOpenAlex for { <https://semopenalex.org/work/W2952079278> ?p ?o ?g. }
- W2952079278 abstract "Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multiple linguistic analyses. Previous work has extended recurrent neural networks to model lattice inputs and achieved improvements in various tasks, but these models suffer from very slow computation speeds. This paper extends the recently proposed paradigm of self-attention to handle lattice inputs. Self-attention is a sequence modeling technique that relates inputs to one another by computing pairwise similarities and has gained popularity for both its strong results and its computational efficiency. To extend such models to handle lattices, we introduce probabilistic reachability masks that incorporate lattice structure into the model and support lattice scores if available. We also propose a method for adapting positional embeddings to lattice structures. We apply the proposed model to a speech translation task and find that it outperforms all examined baselines while being much faster to compute than previous neural lattice models during both training and inference." @default.
- W2952079278 created "2019-06-27" @default.
- W2952079278 creator A5004365148 @default.
- W2952079278 creator A5007526409 @default.
- W2952079278 creator A5024736091 @default.
- W2952079278 creator A5068811427 @default.
- W2952079278 date "2019-01-01" @default.
- W2952079278 modified "2023-10-01" @default.
- W2952079278 title "Self-Attentional Models for Lattice Inputs" @default.
- W2952079278 cites W1596841185 @default.
- W2952079278 cites W1879966306 @default.
- W2952079278 cites W1902237438 @default.
- W2952079278 cites W2095705004 @default.
- W2952079278 cites W2113106066 @default.
- W2952079278 cites W2157435188 @default.
- W2952079278 cites W2164370343 @default.
- W2952079278 cites W2183341477 @default.
- W2952079278 cites W2194775991 @default.
- W2952079278 cites W2251939518 @default.
- W2952079278 cites W2267186426 @default.
- W2952079278 cites W2290847742 @default.
- W2952079278 cites W2408724534 @default.
- W2952079278 cites W2413794162 @default.
- W2952079278 cites W2511962886 @default.
- W2952079278 cites W2577255746 @default.
- W2952079278 cites W2605202026 @default.
- W2952079278 cites W2757026815 @default.
- W2952079278 cites W2773734397 @default.
- W2952079278 cites W2798749466 @default.
- W2952079278 cites W2799119017 @default.
- W2952079278 cites W2899280787 @default.
- W2952079278 cites W2950898568 @default.
- W2952079278 cites W2962820991 @default.
- W2952079278 cites W2963069010 @default.
- W2952079278 cites W2963201387 @default.
- W2952079278 cites W2963266340 @default.
- W2952079278 cites W2963355447 @default.
- W2952079278 cites W2963386218 @default.
- W2952079278 cites W2963403868 @default.
- W2952079278 cites W2963653811 @default.
- W2952079278 cites W2963858333 @default.
- W2952079278 cites W2963964898 @default.
- W2952079278 cites W2964113829 @default.
- W2952079278 cites W2964121744 @default.
- W2952079278 cites W2964265128 @default.
- W2952079278 cites W2964308564 @default.
- W2952079278 cites W2964321699 @default.
- W2952079278 cites W3012492057 @default.
- W2952079278 cites W53604701 @default.
- W2952079278 doi "https://doi.org/10.18653/v1/p19-1115" @default.
- W2952079278 hasPublicationYear "2019" @default.
- W2952079278 type Work @default.
- W2952079278 sameAs 2952079278 @default.
- W2952079278 citedByCount "32" @default.
- W2952079278 countsByYear W29520792782019 @default.
- W2952079278 countsByYear W29520792782020 @default.
- W2952079278 countsByYear W29520792782021 @default.
- W2952079278 countsByYear W29520792782022 @default.
- W2952079278 countsByYear W29520792782023 @default.
- W2952079278 crossrefType "proceedings-article" @default.
- W2952079278 hasAuthorship W2952079278A5004365148 @default.
- W2952079278 hasAuthorship W2952079278A5007526409 @default.
- W2952079278 hasAuthorship W2952079278A5024736091 @default.
- W2952079278 hasAuthorship W2952079278A5068811427 @default.
- W2952079278 hasBestOaLocation W29520792781 @default.
- W2952079278 hasConcept C11413529 @default.
- W2952079278 hasConcept C119857082 @default.
- W2952079278 hasConcept C121332964 @default.
- W2952079278 hasConcept C136643341 @default.
- W2952079278 hasConcept C154945302 @default.
- W2952079278 hasConcept C184898388 @default.
- W2952079278 hasConcept C199360897 @default.
- W2952079278 hasConcept C24890656 @default.
- W2952079278 hasConcept C2776214188 @default.
- W2952079278 hasConcept C2780522230 @default.
- W2952079278 hasConcept C2781204021 @default.
- W2952079278 hasConcept C41008148 @default.
- W2952079278 hasConcept C45374587 @default.
- W2952079278 hasConcept C49937458 @default.
- W2952079278 hasConcept C80444323 @default.
- W2952079278 hasConceptScore W2952079278C11413529 @default.
- W2952079278 hasConceptScore W2952079278C119857082 @default.
- W2952079278 hasConceptScore W2952079278C121332964 @default.
- W2952079278 hasConceptScore W2952079278C136643341 @default.
- W2952079278 hasConceptScore W2952079278C154945302 @default.
- W2952079278 hasConceptScore W2952079278C184898388 @default.
- W2952079278 hasConceptScore W2952079278C199360897 @default.
- W2952079278 hasConceptScore W2952079278C24890656 @default.
- W2952079278 hasConceptScore W2952079278C2776214188 @default.
- W2952079278 hasConceptScore W2952079278C2780522230 @default.
- W2952079278 hasConceptScore W2952079278C2781204021 @default.
- W2952079278 hasConceptScore W2952079278C41008148 @default.
- W2952079278 hasConceptScore W2952079278C45374587 @default.
- W2952079278 hasConceptScore W2952079278C49937458 @default.
- W2952079278 hasConceptScore W2952079278C80444323 @default.
- W2952079278 hasLocation W29520792781 @default.
- W2952079278 hasLocation W29520792782 @default.
- W2952079278 hasOpenAccess W2952079278 @default.
- W2952079278 hasPrimaryLocation W29520792781 @default.
- W2952079278 hasRelatedWork W1588952892 @default.