Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387428265> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4387428265 endingPage "68" @default.
- W4387428265 startingPage "57" @default.
- W4387428265 abstract "Pre-trained models have been proved effective in natural language understanding. For long document understanding, the key challenges are long-range dependence and inference efficiency. Existing approaches, however, (i) usually cannot fully model the context structure and global semantics within a long document, (ii) and lack consistency assessment on common downstream tasks. To address these issues, we propose a novel Recurrent Transformers (RTrans) for long document understanding which can not only learn long contextual structure and relationships, but also be extended to diverse downstream tasks. Specifically, our model introduces recurrent transformer block to convey the token-level contextual information across segments and capture long-range dependence. The ranking strategy is utilized to aggregate the local and global information for final prediction. Experiments on diverse tasks that require understanding long document demonstrate superior and robust performance of RTrans and our approach achieves a better balance between effectiveness and efficiency." @default.
- W4387428265 created "2023-10-08" @default.
- W4387428265 creator A5029360035 @default.
- W4387428265 creator A5045580078 @default.
- W4387428265 creator A5053126417 @default.
- W4387428265 creator A5066240545 @default.
- W4387428265 date "2023-01-01" @default.
- W4387428265 modified "2023-10-11" @default.
- W4387428265 title "Recurrent Transformers for Long Document Understanding" @default.
- W4387428265 cites W1493526108 @default.
- W4387428265 cites W2142972908 @default.
- W4387428265 cites W2157331557 @default.
- W4387428265 cites W2955041501 @default.
- W4387428265 cites W2962910668 @default.
- W4387428265 cites W2964110616 @default.
- W4387428265 cites W3008736151 @default.
- W4387428265 cites W3035391452 @default.
- W4387428265 cites W3131922516 @default.
- W4387428265 cites W3174794493 @default.
- W4387428265 cites W3186833834 @default.
- W4387428265 cites W4285261371 @default.
- W4387428265 cites W4285275989 @default.
- W4387428265 doi "https://doi.org/10.1007/978-3-031-44693-1_5" @default.
- W4387428265 hasPublicationYear "2023" @default.
- W4387428265 type Work @default.
- W4387428265 citedByCount "0" @default.
- W4387428265 crossrefType "book-chapter" @default.
- W4387428265 hasAuthorship W4387428265A5029360035 @default.
- W4387428265 hasAuthorship W4387428265A5045580078 @default.
- W4387428265 hasAuthorship W4387428265A5053126417 @default.
- W4387428265 hasAuthorship W4387428265A5066240545 @default.
- W4387428265 hasConcept C119857082 @default.
- W4387428265 hasConcept C121332964 @default.
- W4387428265 hasConcept C154945302 @default.
- W4387428265 hasConcept C162324750 @default.
- W4387428265 hasConcept C165801399 @default.
- W4387428265 hasConcept C204321447 @default.
- W4387428265 hasConcept C21547014 @default.
- W4387428265 hasConcept C2776207758 @default.
- W4387428265 hasConcept C2776214188 @default.
- W4387428265 hasConcept C2776436953 @default.
- W4387428265 hasConcept C41008148 @default.
- W4387428265 hasConcept C62520636 @default.
- W4387428265 hasConcept C66322947 @default.
- W4387428265 hasConceptScore W4387428265C119857082 @default.
- W4387428265 hasConceptScore W4387428265C121332964 @default.
- W4387428265 hasConceptScore W4387428265C154945302 @default.
- W4387428265 hasConceptScore W4387428265C162324750 @default.
- W4387428265 hasConceptScore W4387428265C165801399 @default.
- W4387428265 hasConceptScore W4387428265C204321447 @default.
- W4387428265 hasConceptScore W4387428265C21547014 @default.
- W4387428265 hasConceptScore W4387428265C2776207758 @default.
- W4387428265 hasConceptScore W4387428265C2776214188 @default.
- W4387428265 hasConceptScore W4387428265C2776436953 @default.
- W4387428265 hasConceptScore W4387428265C41008148 @default.
- W4387428265 hasConceptScore W4387428265C62520636 @default.
- W4387428265 hasConceptScore W4387428265C66322947 @default.
- W4387428265 hasLocation W43874282651 @default.
- W4387428265 hasOpenAccess W4387428265 @default.
- W4387428265 hasPrimaryLocation W43874282651 @default.
- W4387428265 hasRelatedWork W2349021146 @default.
- W4387428265 hasRelatedWork W2436192316 @default.
- W4387428265 hasRelatedWork W3040203686 @default.
- W4387428265 hasRelatedWork W3094491777 @default.
- W4387428265 hasRelatedWork W3214715529 @default.
- W4387428265 hasRelatedWork W35583307 @default.
- W4387428265 hasRelatedWork W4206178588 @default.
- W4387428265 hasRelatedWork W4214653257 @default.
- W4387428265 hasRelatedWork W4249524554 @default.
- W4387428265 hasRelatedWork W4287635093 @default.
- W4387428265 isParatext "false" @default.
- W4387428265 isRetracted "false" @default.
- W4387428265 workType "book-chapter" @default.