Matches in SemOpenAlex for { <https://semopenalex.org/work/W3212973432> ?p ?o ?g. }
- W3212973432 abstract "Position representation is crucial for building position-aware representations in Transformers. Existing position representations suffer from a lack of generalization to test data with unseen lengths or high computational cost. We investigate shifted absolute position embedding (SHAPE) to address both issues. The basic idea of SHAPE is to achieve shift invariance, which is a key property of recent successful position representations, by randomly shifting absolute positions during training. We demonstrate that SHAPE is empirically comparable to its counterpart while being simpler and faster." @default.
- W3212973432 created "2021-11-22" @default.
- W3212973432 creator A5002182453 @default.
- W3212973432 creator A5053021287 @default.
- W3212973432 creator A5060910700 @default.
- W3212973432 creator A5066002127 @default.
- W3212973432 date "2021-09-12" @default.
- W3212973432 modified "2023-09-25" @default.
- W3212973432 title "SHAPE: Shifted Absolute Position Embedding for Transformers" @default.
- W3212973432 cites W2101105183 @default.
- W3212973432 cites W2183341477 @default.
- W3212973432 cites W2933138175 @default.
- W3212973432 cites W2941599692 @default.
- W3212973432 cites W2962784628 @default.
- W3212973432 cites W2963011474 @default.
- W3212973432 cites W2963212250 @default.
- W3212973432 cites W2963403868 @default.
- W3212973432 cites W2963532001 @default.
- W3212973432 cites W2963807318 @default.
- W3212973432 cites W2963925437 @default.
- W3212973432 cites W2964110616 @default.
- W3212973432 cites W2964265128 @default.
- W3212973432 cites W2970295111 @default.
- W3212973432 cites W2989156240 @default.
- W3212973432 cites W2994673210 @default.
- W3212973432 cites W3035428952 @default.
- W3212973432 cites W3082274269 @default.
- W3212973432 cites W3085139254 @default.
- W3212973432 cites W3104613728 @default.
- W3212973432 cites W3106210592 @default.
- W3212973432 cites W3106531402 @default.
- W3212973432 cites W3114271877 @default.
- W3212973432 cites W3121309507 @default.
- W3212973432 cites W3132607382 @default.
- W3212973432 cites W3133264589 @default.
- W3212973432 cites W3134357720 @default.
- W3212973432 cites W3170261818 @default.
- W3212973432 cites W3185923046 @default.
- W3212973432 cites W3210914950 @default.
- W3212973432 doi "https://doi.org/10.48550/arxiv.2109.05644" @default.
- W3212973432 hasPublicationYear "2021" @default.
- W3212973432 type Work @default.
- W3212973432 sameAs 3212973432 @default.
- W3212973432 citedByCount "0" @default.
- W3212973432 crossrefType "posted-content" @default.
- W3212973432 hasAuthorship W3212973432A5002182453 @default.
- W3212973432 hasAuthorship W3212973432A5053021287 @default.
- W3212973432 hasAuthorship W3212973432A5060910700 @default.
- W3212973432 hasAuthorship W3212973432A5066002127 @default.
- W3212973432 hasBestOaLocation W32129734321 @default.
- W3212973432 hasConcept C10138342 @default.
- W3212973432 hasConcept C111472728 @default.
- W3212973432 hasConcept C11413529 @default.
- W3212973432 hasConcept C119599485 @default.
- W3212973432 hasConcept C127413603 @default.
- W3212973432 hasConcept C134306372 @default.
- W3212973432 hasConcept C138885662 @default.
- W3212973432 hasConcept C154945302 @default.
- W3212973432 hasConcept C162324750 @default.
- W3212973432 hasConcept C165801399 @default.
- W3212973432 hasConcept C177148314 @default.
- W3212973432 hasConcept C17744445 @default.
- W3212973432 hasConcept C198082294 @default.
- W3212973432 hasConcept C199539241 @default.
- W3212973432 hasConcept C2776359362 @default.
- W3212973432 hasConcept C2777487392 @default.
- W3212973432 hasConcept C33923547 @default.
- W3212973432 hasConcept C41008148 @default.
- W3212973432 hasConcept C41608201 @default.
- W3212973432 hasConcept C66322947 @default.
- W3212973432 hasConcept C94625758 @default.
- W3212973432 hasConceptScore W3212973432C10138342 @default.
- W3212973432 hasConceptScore W3212973432C111472728 @default.
- W3212973432 hasConceptScore W3212973432C11413529 @default.
- W3212973432 hasConceptScore W3212973432C119599485 @default.
- W3212973432 hasConceptScore W3212973432C127413603 @default.
- W3212973432 hasConceptScore W3212973432C134306372 @default.
- W3212973432 hasConceptScore W3212973432C138885662 @default.
- W3212973432 hasConceptScore W3212973432C154945302 @default.
- W3212973432 hasConceptScore W3212973432C162324750 @default.
- W3212973432 hasConceptScore W3212973432C165801399 @default.
- W3212973432 hasConceptScore W3212973432C177148314 @default.
- W3212973432 hasConceptScore W3212973432C17744445 @default.
- W3212973432 hasConceptScore W3212973432C198082294 @default.
- W3212973432 hasConceptScore W3212973432C199539241 @default.
- W3212973432 hasConceptScore W3212973432C2776359362 @default.
- W3212973432 hasConceptScore W3212973432C2777487392 @default.
- W3212973432 hasConceptScore W3212973432C33923547 @default.
- W3212973432 hasConceptScore W3212973432C41008148 @default.
- W3212973432 hasConceptScore W3212973432C41608201 @default.
- W3212973432 hasConceptScore W3212973432C66322947 @default.
- W3212973432 hasConceptScore W3212973432C94625758 @default.
- W3212973432 hasLocation W32129734321 @default.
- W3212973432 hasLocation W32129734322 @default.
- W3212973432 hasOpenAccess W3212973432 @default.
- W3212973432 hasPrimaryLocation W32129734321 @default.
- W3212973432 hasRelatedWork W1971753667 @default.
- W3212973432 hasRelatedWork W1997271576 @default.
- W3212973432 hasRelatedWork W2052275678 @default.
- W3212973432 hasRelatedWork W2068208308 @default.