Matches in SemOpenAlex for { <https://semopenalex.org/work/W3146244013> ?p ?o ?g. }
- W3146244013 abstract "We often use perturbations to regularize neural models. For neural encoder-decoders, previous studies applied the scheduled sampling (Bengio et al., 2015) and adversarial perturbations (Sato et al., 2019) as perturbations but these methods require considerable computational time. Thus, this study addresses the question of whether these approaches are efficient enough for training time. We compare several perturbations in sequence-to-sequence problems with respect to computational time. Experimental results show that the simple techniques such as word dropout (Gal and Ghahramani, 2016) and random replacement of input tokens achieve comparable (or better) scores to the recently proposed perturbations, even though these simple methods are faster. Our code is publicly available at https://github.com/takase/rethink_perturbations." @default.
- W3146244013 created "2021-04-13" @default.
- W3146244013 creator A5066002127 @default.
- W3146244013 creator A5075222372 @default.
- W3146244013 date "2021-04-05" @default.
- W3146244013 modified "2023-09-25" @default.
- W3146244013 title "Rethinking Perturbations in Encoder-Decoders for Fast Training" @default.
- W3146244013 cites W2056609756 @default.
- W3146244013 cites W2098297786 @default.
- W3146244013 cites W2130942839 @default.
- W3146244013 cites W2153013403 @default.
- W3146244013 cites W2293778248 @default.
- W3146244013 cites W2554764206 @default.
- W3146244013 cites W2736472496 @default.
- W3146244013 cites W2741494657 @default.
- W3146244013 cites W2888799392 @default.
- W3146244013 cites W2933138175 @default.
- W3146244013 cites W2941599692 @default.
- W3146244013 cites W2944815030 @default.
- W3146244013 cites W2946232455 @default.
- W3146244013 cites W2948223045 @default.
- W3146244013 cites W2950304420 @default.
- W3146244013 cites W2950651087 @default.
- W3146244013 cites W2950913377 @default.
- W3146244013 cites W2962784628 @default.
- W3146244013 cites W2962832505 @default.
- W3146244013 cites W2962901607 @default.
- W3146244013 cites W2962965405 @default.
- W3146244013 cites W2963207607 @default.
- W3146244013 cites W2963216553 @default.
- W3146244013 cites W2963266340 @default.
- W3146244013 cites W2963403868 @default.
- W3146244013 cites W2963443335 @default.
- W3146244013 cites W2963532001 @default.
- W3146244013 cites W2963537482 @default.
- W3146244013 cites W2963545917 @default.
- W3146244013 cites W2963807318 @default.
- W3146244013 cites W2963823140 @default.
- W3146244013 cites W2964040467 @default.
- W3146244013 cites W2964153729 @default.
- W3146244013 cites W2964345285 @default.
- W3146244013 cites W2970015022 @default.
- W3146244013 cites W2970279348 @default.
- W3146244013 cites W2970868759 @default.
- W3146244013 cites W2971008823 @default.
- W3146244013 cites W2971274815 @default.
- W3146244013 cites W3034340181 @default.
- W3146244013 cites W3034715004 @default.
- W3146244013 cites W3041269366 @default.
- W3146244013 cites W3100439847 @default.
- W3146244013 cites W3105980794 @default.
- W3146244013 doi "https://doi.org/10.48550/arxiv.2104.01853" @default.
- W3146244013 hasPublicationYear "2021" @default.
- W3146244013 type Work @default.
- W3146244013 sameAs 3146244013 @default.
- W3146244013 citedByCount "1" @default.
- W3146244013 countsByYear W31462440132021 @default.
- W3146244013 crossrefType "posted-content" @default.
- W3146244013 hasAuthorship W3146244013A5066002127 @default.
- W3146244013 hasAuthorship W3146244013A5075222372 @default.
- W3146244013 hasBestOaLocation W31462440131 @default.
- W3146244013 hasConcept C111472728 @default.
- W3146244013 hasConcept C111919701 @default.
- W3146244013 hasConcept C11413529 @default.
- W3146244013 hasConcept C118505674 @default.
- W3146244013 hasConcept C138885662 @default.
- W3146244013 hasConcept C177264268 @default.
- W3146244013 hasConcept C199360897 @default.
- W3146244013 hasConcept C2524010 @default.
- W3146244013 hasConcept C2776760102 @default.
- W3146244013 hasConcept C2778112365 @default.
- W3146244013 hasConcept C2780586882 @default.
- W3146244013 hasConcept C33923547 @default.
- W3146244013 hasConcept C41008148 @default.
- W3146244013 hasConcept C54355233 @default.
- W3146244013 hasConcept C57273362 @default.
- W3146244013 hasConcept C80444323 @default.
- W3146244013 hasConcept C86803240 @default.
- W3146244013 hasConcept C90805587 @default.
- W3146244013 hasConceptScore W3146244013C111472728 @default.
- W3146244013 hasConceptScore W3146244013C111919701 @default.
- W3146244013 hasConceptScore W3146244013C11413529 @default.
- W3146244013 hasConceptScore W3146244013C118505674 @default.
- W3146244013 hasConceptScore W3146244013C138885662 @default.
- W3146244013 hasConceptScore W3146244013C177264268 @default.
- W3146244013 hasConceptScore W3146244013C199360897 @default.
- W3146244013 hasConceptScore W3146244013C2524010 @default.
- W3146244013 hasConceptScore W3146244013C2776760102 @default.
- W3146244013 hasConceptScore W3146244013C2778112365 @default.
- W3146244013 hasConceptScore W3146244013C2780586882 @default.
- W3146244013 hasConceptScore W3146244013C33923547 @default.
- W3146244013 hasConceptScore W3146244013C41008148 @default.
- W3146244013 hasConceptScore W3146244013C54355233 @default.
- W3146244013 hasConceptScore W3146244013C57273362 @default.
- W3146244013 hasConceptScore W3146244013C80444323 @default.
- W3146244013 hasConceptScore W3146244013C86803240 @default.
- W3146244013 hasConceptScore W3146244013C90805587 @default.
- W3146244013 hasLocation W31462440131 @default.
- W3146244013 hasOpenAccess W3146244013 @default.
- W3146244013 hasPrimaryLocation W31462440131 @default.