Matches in SemOpenAlex for { <https://semopenalex.org/work/W2525778437> ?p ?o ?g. }
- W2525778437 abstract "Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference. Also, most NMT systems have difficulty with rare words. These issues have hindered NMT's use in practical deployments and services, where both accuracy and speed are essential. In this work, we present GNMT, Google's Neural Machine Translation system, which attempts to address many of these issues. Our model consists of a deep LSTM network with 8 encoder and 8 decoder layers using attention and residual connections. To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder. To accelerate the final translation speed, we employ low-precision arithmetic during inference computations. To improve handling of rare words, we divide words into a limited set of common sub-word units (wordpieces) for both input and output. This method provides a good balance between the flexibility of character-delimited models and the efficiency of word-delimited models, naturally handles translation of rare words, and ultimately improves the overall accuracy of the system. Our beam search technique employs a length-normalization procedure and uses a coverage penalty, which encourages generation of an output sentence that is most likely to cover all the words in the source sentence. On the WMT'14 English-to-French and English-to-German benchmarks, GNMT achieves competitive results to state-of-the-art. Using a human side-by-side evaluation on a set of isolated simple sentences, it reduces translation errors by an average of 60% compared to Google's phrase-based production system." @default.
- W2525778437 created "2016-10-07" @default.
- W2525778437 creator A5002806249 @default.
- W2525778437 creator A5003562101 @default.
- W2525778437 creator A5008084569 @default.
- W2525778437 creator A5010253402 @default.
- W2525778437 creator A5012800230 @default.
- W2525778437 creator A5014055962 @default.
- W2525778437 creator A5015547427 @default.
- W2525778437 creator A5018646392 @default.
- W2525778437 creator A5018912210 @default.
- W2525778437 creator A5029864677 @default.
- W2525778437 creator A5031789995 @default.
- W2525778437 creator A5034416480 @default.
- W2525778437 creator A5034451145 @default.
- W2525778437 creator A5035427716 @default.
- W2525778437 creator A5037285672 @default.
- W2525778437 creator A5043872671 @default.
- W2525778437 creator A5046597133 @default.
- W2525778437 creator A5052500398 @default.
- W2525778437 creator A5056830118 @default.
- W2525778437 creator A5060065053 @default.
- W2525778437 creator A5064357077 @default.
- W2525778437 creator A5067705729 @default.
- W2525778437 creator A5068955381 @default.
- W2525778437 creator A5076150774 @default.
- W2525778437 creator A5079489298 @default.
- W2525778437 creator A5081307073 @default.
- W2525778437 creator A5081928534 @default.
- W2525778437 creator A5085787384 @default.
- W2525778437 creator A5086329948 @default.
- W2525778437 creator A5088551093 @default.
- W2525778437 creator A5089114137 @default.
- W2525778437 date "2016-09-26" @default.
- W2525778437 modified "2023-09-28" @default.
- W2525778437 title "Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation" @default.
- W2525778437 cites W1968594024 @default.
- W2525778437 cites W2121879602 @default.
- W2525778437 cites W2251743902 @default.
- W2525778437 cites W2964121744 @default.
- W2525778437 hasPublicationYear "2016" @default.
- W2525778437 type Work @default.
- W2525778437 sameAs 2525778437 @default.
- W2525778437 citedByCount "2408" @default.
- W2525778437 countsByYear W25257784372015 @default.
- W2525778437 countsByYear W25257784372016 @default.
- W2525778437 countsByYear W25257784372017 @default.
- W2525778437 countsByYear W25257784372018 @default.
- W2525778437 countsByYear W25257784372019 @default.
- W2525778437 countsByYear W25257784372020 @default.
- W2525778437 countsByYear W25257784372021 @default.
- W2525778437 countsByYear W25257784372022 @default.
- W2525778437 countsByYear W25257784372023 @default.
- W2525778437 crossrefType "posted-content" @default.
- W2525778437 hasAuthorship W2525778437A5002806249 @default.
- W2525778437 hasAuthorship W2525778437A5003562101 @default.
- W2525778437 hasAuthorship W2525778437A5008084569 @default.
- W2525778437 hasAuthorship W2525778437A5010253402 @default.
- W2525778437 hasAuthorship W2525778437A5012800230 @default.
- W2525778437 hasAuthorship W2525778437A5014055962 @default.
- W2525778437 hasAuthorship W2525778437A5015547427 @default.
- W2525778437 hasAuthorship W2525778437A5018646392 @default.
- W2525778437 hasAuthorship W2525778437A5018912210 @default.
- W2525778437 hasAuthorship W2525778437A5029864677 @default.
- W2525778437 hasAuthorship W2525778437A5031789995 @default.
- W2525778437 hasAuthorship W2525778437A5034416480 @default.
- W2525778437 hasAuthorship W2525778437A5034451145 @default.
- W2525778437 hasAuthorship W2525778437A5035427716 @default.
- W2525778437 hasAuthorship W2525778437A5037285672 @default.
- W2525778437 hasAuthorship W2525778437A5043872671 @default.
- W2525778437 hasAuthorship W2525778437A5046597133 @default.
- W2525778437 hasAuthorship W2525778437A5052500398 @default.
- W2525778437 hasAuthorship W2525778437A5056830118 @default.
- W2525778437 hasAuthorship W2525778437A5060065053 @default.
- W2525778437 hasAuthorship W2525778437A5064357077 @default.
- W2525778437 hasAuthorship W2525778437A5067705729 @default.
- W2525778437 hasAuthorship W2525778437A5068955381 @default.
- W2525778437 hasAuthorship W2525778437A5076150774 @default.
- W2525778437 hasAuthorship W2525778437A5079489298 @default.
- W2525778437 hasAuthorship W2525778437A5081307073 @default.
- W2525778437 hasAuthorship W2525778437A5081928534 @default.
- W2525778437 hasAuthorship W2525778437A5085787384 @default.
- W2525778437 hasAuthorship W2525778437A5086329948 @default.
- W2525778437 hasAuthorship W2525778437A5088551093 @default.
- W2525778437 hasAuthorship W2525778437A5089114137 @default.
- W2525778437 hasConcept C104317684 @default.
- W2525778437 hasConcept C105580179 @default.
- W2525778437 hasConcept C105795698 @default.
- W2525778437 hasConcept C119857082 @default.
- W2525778437 hasConcept C130597682 @default.
- W2525778437 hasConcept C138885662 @default.
- W2525778437 hasConcept C149364088 @default.
- W2525778437 hasConcept C154945302 @default.
- W2525778437 hasConcept C174348530 @default.
- W2525778437 hasConcept C185592680 @default.
- W2525778437 hasConcept C203005215 @default.
- W2525778437 hasConcept C204321447 @default.
- W2525778437 hasConcept C24687705 @default.
- W2525778437 hasConcept C2776214188 @default.
- W2525778437 hasConcept C2776224158 @default.