Matches in SemOpenAlex for { <https://semopenalex.org/work/W4382334332> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4382334332 abstract "In this paper, we introduce a new task for code completion that focuses on handling long code input and propose a sparse Transformer model, called LongCoder, to address this task. LongCoder employs a sliding window mechanism for self-attention and introduces two types of globally accessible tokens - bridge tokens and memory tokens - to improve performance and efficiency. Bridge tokens are inserted throughout the input sequence to aggregate local information and facilitate global interaction, while memory tokens are included to highlight important statements that may be invoked later and need to be memorized, such as package imports and definitions of classes, functions, or structures. We conduct experiments on a newly constructed dataset that contains longer code context and the publicly available CodeXGLUE benchmark. Experimental results demonstrate that LongCoder achieves superior performance on code completion tasks compared to previous models while maintaining comparable efficiency in terms of computational resources during inference. All the codes and data are available at https://github.com/microsoft/CodeBERT." @default.
- W4382334332 created "2023-06-28" @default.
- W4382334332 creator A5017205177 @default.
- W4382334332 creator A5021827617 @default.
- W4382334332 creator A5037479075 @default.
- W4382334332 creator A5042018181 @default.
- W4382334332 creator A5060364305 @default.
- W4382334332 date "2023-06-26" @default.
- W4382334332 modified "2023-09-25" @default.
- W4382334332 title "LongCoder: A Long-Range Pre-trained Language Model for Code Completion" @default.
- W4382334332 doi "https://doi.org/10.48550/arxiv.2306.14893" @default.
- W4382334332 hasPublicationYear "2023" @default.
- W4382334332 type Work @default.
- W4382334332 citedByCount "0" @default.
- W4382334332 crossrefType "posted-content" @default.
- W4382334332 hasAuthorship W4382334332A5017205177 @default.
- W4382334332 hasAuthorship W4382334332A5021827617 @default.
- W4382334332 hasAuthorship W4382334332A5037479075 @default.
- W4382334332 hasAuthorship W4382334332A5042018181 @default.
- W4382334332 hasAuthorship W4382334332A5060364305 @default.
- W4382334332 hasBestOaLocation W43823343321 @default.
- W4382334332 hasConcept C100776233 @default.
- W4382334332 hasConcept C102392041 @default.
- W4382334332 hasConcept C111919701 @default.
- W4382334332 hasConcept C121332964 @default.
- W4382334332 hasConcept C126322002 @default.
- W4382334332 hasConcept C13280743 @default.
- W4382334332 hasConcept C137293760 @default.
- W4382334332 hasConcept C151730666 @default.
- W4382334332 hasConcept C154945302 @default.
- W4382334332 hasConcept C162324750 @default.
- W4382334332 hasConcept C165801399 @default.
- W4382334332 hasConcept C177264268 @default.
- W4382334332 hasConcept C185798385 @default.
- W4382334332 hasConcept C187736073 @default.
- W4382334332 hasConcept C199360897 @default.
- W4382334332 hasConcept C204321447 @default.
- W4382334332 hasConcept C205649164 @default.
- W4382334332 hasConcept C2776214188 @default.
- W4382334332 hasConcept C2776760102 @default.
- W4382334332 hasConcept C2778751112 @default.
- W4382334332 hasConcept C2779343474 @default.
- W4382334332 hasConcept C2780451532 @default.
- W4382334332 hasConcept C41008148 @default.
- W4382334332 hasConcept C62520636 @default.
- W4382334332 hasConcept C66322947 @default.
- W4382334332 hasConcept C71924100 @default.
- W4382334332 hasConcept C86803240 @default.
- W4382334332 hasConceptScore W4382334332C100776233 @default.
- W4382334332 hasConceptScore W4382334332C102392041 @default.
- W4382334332 hasConceptScore W4382334332C111919701 @default.
- W4382334332 hasConceptScore W4382334332C121332964 @default.
- W4382334332 hasConceptScore W4382334332C126322002 @default.
- W4382334332 hasConceptScore W4382334332C13280743 @default.
- W4382334332 hasConceptScore W4382334332C137293760 @default.
- W4382334332 hasConceptScore W4382334332C151730666 @default.
- W4382334332 hasConceptScore W4382334332C154945302 @default.
- W4382334332 hasConceptScore W4382334332C162324750 @default.
- W4382334332 hasConceptScore W4382334332C165801399 @default.
- W4382334332 hasConceptScore W4382334332C177264268 @default.
- W4382334332 hasConceptScore W4382334332C185798385 @default.
- W4382334332 hasConceptScore W4382334332C187736073 @default.
- W4382334332 hasConceptScore W4382334332C199360897 @default.
- W4382334332 hasConceptScore W4382334332C204321447 @default.
- W4382334332 hasConceptScore W4382334332C205649164 @default.
- W4382334332 hasConceptScore W4382334332C2776214188 @default.
- W4382334332 hasConceptScore W4382334332C2776760102 @default.
- W4382334332 hasConceptScore W4382334332C2778751112 @default.
- W4382334332 hasConceptScore W4382334332C2779343474 @default.
- W4382334332 hasConceptScore W4382334332C2780451532 @default.
- W4382334332 hasConceptScore W4382334332C41008148 @default.
- W4382334332 hasConceptScore W4382334332C62520636 @default.
- W4382334332 hasConceptScore W4382334332C66322947 @default.
- W4382334332 hasConceptScore W4382334332C71924100 @default.
- W4382334332 hasConceptScore W4382334332C86803240 @default.
- W4382334332 hasLocation W43823343321 @default.
- W4382334332 hasOpenAccess W4382334332 @default.
- W4382334332 hasPrimaryLocation W43823343321 @default.
- W4382334332 hasRelatedWork W2081647779 @default.
- W4382334332 hasRelatedWork W2883550961 @default.
- W4382334332 hasRelatedWork W2896786335 @default.
- W4382334332 hasRelatedWork W3107474891 @default.
- W4382334332 hasRelatedWork W3115399078 @default.
- W4382334332 hasRelatedWork W3185852197 @default.
- W4382334332 hasRelatedWork W32283444 @default.
- W4382334332 hasRelatedWork W4205820553 @default.
- W4382334332 hasRelatedWork W4304777330 @default.
- W4382334332 hasRelatedWork W4320486724 @default.
- W4382334332 isParatext "false" @default.
- W4382334332 isRetracted "false" @default.
- W4382334332 workType "article" @default.