Matches in SemOpenAlex for { <https://semopenalex.org/work/W4294967822> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4294967822 endingPage "810" @default.
- W4294967822 startingPage "807" @default.
- W4294967822 abstract "In pursuit of faster computation, Efficient Transformers demonstrate an impressive variety of approaches -- models attaining sub-quadratic attention complexity can utilize a notion of sparsity or a low-rank approximation of inputs to reduce the number of attended keys; other ways to reduce complexity include locality-sensitive hashing, key pooling, additional memory to store information in compacted or hybridization with other architectures, such as CNN. Often based on a strong mathematical basis, kernelized approaches allow for the approximation of attention with linear complexity while retaining high accuracy. Therefore, in the present paper, we aim to expand the idea of trainable kernel methods to approximate the self-attention mechanism of the Transformer architecture." @default.
- W4294967822 created "2022-09-08" @default.
- W4294967822 creator A5014516814 @default.
- W4294967822 creator A5040070858 @default.
- W4294967822 date "2022-01-01" @default.
- W4294967822 modified "2023-09-23" @default.
- W4294967822 title "Linear Self-attention Approximation via Trainable Feedforward Kernel" @default.
- W4294967822 cites W1988115241 @default.
- W4294967822 cites W2103496339 @default.
- W4294967822 cites W2964110616 @default.
- W4294967822 cites W2981413347 @default.
- W4294967822 cites W3097777922 @default.
- W4294967822 cites W3131922516 @default.
- W4294967822 cites W3173365702 @default.
- W4294967822 doi "https://doi.org/10.1007/978-3-031-15934-3_67" @default.
- W4294967822 hasPublicationYear "2022" @default.
- W4294967822 type Work @default.
- W4294967822 citedByCount "0" @default.
- W4294967822 crossrefType "book-chapter" @default.
- W4294967822 hasAuthorship W4294967822A5014516814 @default.
- W4294967822 hasAuthorship W4294967822A5040070858 @default.
- W4294967822 hasBestOaLocation W42949678222 @default.
- W4294967822 hasConcept C11413529 @default.
- W4294967822 hasConcept C114614502 @default.
- W4294967822 hasConcept C121332964 @default.
- W4294967822 hasConcept C129844170 @default.
- W4294967822 hasConcept C154945302 @default.
- W4294967822 hasConcept C165801399 @default.
- W4294967822 hasConcept C179799912 @default.
- W4294967822 hasConcept C2524010 @default.
- W4294967822 hasConcept C33923547 @default.
- W4294967822 hasConcept C38652104 @default.
- W4294967822 hasConcept C41008148 @default.
- W4294967822 hasConcept C45374587 @default.
- W4294967822 hasConcept C62520636 @default.
- W4294967822 hasConcept C66322947 @default.
- W4294967822 hasConcept C67388219 @default.
- W4294967822 hasConcept C70437156 @default.
- W4294967822 hasConcept C74193536 @default.
- W4294967822 hasConcept C74270461 @default.
- W4294967822 hasConcept C80444323 @default.
- W4294967822 hasConcept C99138194 @default.
- W4294967822 hasConceptScore W4294967822C11413529 @default.
- W4294967822 hasConceptScore W4294967822C114614502 @default.
- W4294967822 hasConceptScore W4294967822C121332964 @default.
- W4294967822 hasConceptScore W4294967822C129844170 @default.
- W4294967822 hasConceptScore W4294967822C154945302 @default.
- W4294967822 hasConceptScore W4294967822C165801399 @default.
- W4294967822 hasConceptScore W4294967822C179799912 @default.
- W4294967822 hasConceptScore W4294967822C2524010 @default.
- W4294967822 hasConceptScore W4294967822C33923547 @default.
- W4294967822 hasConceptScore W4294967822C38652104 @default.
- W4294967822 hasConceptScore W4294967822C41008148 @default.
- W4294967822 hasConceptScore W4294967822C45374587 @default.
- W4294967822 hasConceptScore W4294967822C62520636 @default.
- W4294967822 hasConceptScore W4294967822C66322947 @default.
- W4294967822 hasConceptScore W4294967822C67388219 @default.
- W4294967822 hasConceptScore W4294967822C70437156 @default.
- W4294967822 hasConceptScore W4294967822C74193536 @default.
- W4294967822 hasConceptScore W4294967822C74270461 @default.
- W4294967822 hasConceptScore W4294967822C80444323 @default.
- W4294967822 hasConceptScore W4294967822C99138194 @default.
- W4294967822 hasLocation W42949678221 @default.
- W4294967822 hasLocation W42949678222 @default.
- W4294967822 hasOpenAccess W4294967822 @default.
- W4294967822 hasPrimaryLocation W42949678221 @default.
- W4294967822 hasRelatedWork W2014812507 @default.
- W4294967822 hasRelatedWork W2156435549 @default.
- W4294967822 hasRelatedWork W2284153003 @default.
- W4294967822 hasRelatedWork W2369789896 @default.
- W4294967822 hasRelatedWork W2713815558 @default.
- W4294967822 hasRelatedWork W2734503711 @default.
- W4294967822 hasRelatedWork W2772711833 @default.
- W4294967822 hasRelatedWork W65396202 @default.
- W4294967822 hasRelatedWork W2527990764 @default.
- W4294967822 hasRelatedWork W4298032262 @default.
- W4294967822 isParatext "false" @default.
- W4294967822 isRetracted "false" @default.
- W4294967822 workType "book-chapter" @default.