Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320200143> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4320200143 abstract "Sequential data naturally have different lengths in many domains, with some very long sequences. As an important modeling tool, neural attention should capture long-range interaction in such sequences. However, most existing neural attention models admit only short sequences, or they have to employ chunking or padding to enforce a constant input length. Here we propose a simple neural network building block called ChordMixer which can model the attention for long sequences with variable lengths. Each ChordMixer block consists of a position-wise rotation layer without learnable parameters and an element-wise MLP layer. Repeatedly applying such blocks forms an effective network backbone that mixes the input signals towards the learning targets. We have tested ChordMixer on the synthetic adding problem, long document classification, and DNA sequence-based taxonomy classification. The experiment results show that our method substantially outperforms other neural attention models." @default.
- W4320200143 created "2023-02-13" @default.
- W4320200143 creator A5038522938 @default.
- W4320200143 creator A5042026897 @default.
- W4320200143 creator A5043522375 @default.
- W4320200143 creator A5047757729 @default.
- W4320200143 date "2022-06-12" @default.
- W4320200143 modified "2023-09-25" @default.
- W4320200143 title "ChordMixer: A Scalable Neural Attention Model for Sequences with Different Lengths" @default.
- W4320200143 doi "https://doi.org/10.48550/arxiv.2206.05852" @default.
- W4320200143 hasPublicationYear "2022" @default.
- W4320200143 type Work @default.
- W4320200143 citedByCount "0" @default.
- W4320200143 crossrefType "posted-content" @default.
- W4320200143 hasAuthorship W4320200143A5038522938 @default.
- W4320200143 hasAuthorship W4320200143A5042026897 @default.
- W4320200143 hasAuthorship W4320200143A5043522375 @default.
- W4320200143 hasAuthorship W4320200143A5047757729 @default.
- W4320200143 hasBestOaLocation W43202001431 @default.
- W4320200143 hasConcept C11413529 @default.
- W4320200143 hasConcept C153180895 @default.
- W4320200143 hasConcept C154945302 @default.
- W4320200143 hasConcept C159985019 @default.
- W4320200143 hasConcept C192562407 @default.
- W4320200143 hasConcept C203357204 @default.
- W4320200143 hasConcept C204323151 @default.
- W4320200143 hasConcept C2524010 @default.
- W4320200143 hasConcept C2777210771 @default.
- W4320200143 hasConcept C2778112365 @default.
- W4320200143 hasConcept C33923547 @default.
- W4320200143 hasConcept C41008148 @default.
- W4320200143 hasConcept C48044578 @default.
- W4320200143 hasConcept C50644808 @default.
- W4320200143 hasConcept C54355233 @default.
- W4320200143 hasConcept C77088390 @default.
- W4320200143 hasConcept C86803240 @default.
- W4320200143 hasConceptScore W4320200143C11413529 @default.
- W4320200143 hasConceptScore W4320200143C153180895 @default.
- W4320200143 hasConceptScore W4320200143C154945302 @default.
- W4320200143 hasConceptScore W4320200143C159985019 @default.
- W4320200143 hasConceptScore W4320200143C192562407 @default.
- W4320200143 hasConceptScore W4320200143C203357204 @default.
- W4320200143 hasConceptScore W4320200143C204323151 @default.
- W4320200143 hasConceptScore W4320200143C2524010 @default.
- W4320200143 hasConceptScore W4320200143C2777210771 @default.
- W4320200143 hasConceptScore W4320200143C2778112365 @default.
- W4320200143 hasConceptScore W4320200143C33923547 @default.
- W4320200143 hasConceptScore W4320200143C41008148 @default.
- W4320200143 hasConceptScore W4320200143C48044578 @default.
- W4320200143 hasConceptScore W4320200143C50644808 @default.
- W4320200143 hasConceptScore W4320200143C54355233 @default.
- W4320200143 hasConceptScore W4320200143C77088390 @default.
- W4320200143 hasConceptScore W4320200143C86803240 @default.
- W4320200143 hasLocation W43202001431 @default.
- W4320200143 hasOpenAccess W4320200143 @default.
- W4320200143 hasPrimaryLocation W43202001431 @default.
- W4320200143 hasRelatedWork W1525643724 @default.
- W4320200143 hasRelatedWork W2067938758 @default.
- W4320200143 hasRelatedWork W2112146432 @default.
- W4320200143 hasRelatedWork W2302028273 @default.
- W4320200143 hasRelatedWork W2364921833 @default.
- W4320200143 hasRelatedWork W2382623646 @default.
- W4320200143 hasRelatedWork W2388030554 @default.
- W4320200143 hasRelatedWork W2461970972 @default.
- W4320200143 hasRelatedWork W2463753533 @default.
- W4320200143 hasRelatedWork W3123215270 @default.
- W4320200143 isParatext "false" @default.
- W4320200143 isRetracted "false" @default.
- W4320200143 workType "article" @default.