Matches in SemOpenAlex for { <https://semopenalex.org/work/W4221166942> ?p ?o ?g. }
- W4221166942 abstract "Pre-trained models for programming languages have recently demonstrated great success on code intelligence. To support both code-related understanding and generation tasks, recent works attempt to pre-train unified encoder-decoder models. However, such encoder-decoder framework is sub-optimal for auto-regressive tasks, especially code completion that requires a decoder-only manner for efficient inference. In this paper, we present UniXcoder, a unified cross-modal pre-trained model for programming language. The model utilizes mask attention matrices with prefix adapters to control the behavior of the model and leverages cross-modal contents like AST and code comment to enhance code representation. To encode AST that is represented as a tree in parallel, we propose a one-to-one mapping method to transform AST in a sequence structure that retains all structural information from the tree. Furthermore, we propose to utilize multi-modal contents to learn representation of code fragment with contrastive learning, and then align representations among programming languages using a cross-modal generation task. We evaluate UniXcoder on five code-related tasks over nine datasets. To further evaluate the performance of code fragment representation, we also construct a dataset for a new task, called zero-shot code-to-code search. Results show that our model achieves state-of-the-art performance on most tasks and analysis reveals that comment and AST can both enhance UniXcoder." @default.
- W4221166942 created "2022-04-03" @default.
- W4221166942 creator A5013186280 @default.
- W4221166942 creator A5021075276 @default.
- W4221166942 creator A5042018181 @default.
- W4221166942 creator A5052381023 @default.
- W4221166942 creator A5060364305 @default.
- W4221166942 creator A5064373607 @default.
- W4221166942 date "2022-01-01" @default.
- W4221166942 modified "2023-10-05" @default.
- W4221166942 title "UniXcoder: Unified Cross-Modal Pre-training for Code Representation" @default.
- W4221166942 doi "https://doi.org/10.18653/v1/2022.acl-long.499" @default.
- W4221166942 hasPublicationYear "2022" @default.
- W4221166942 type Work @default.
- W4221166942 citedByCount "30" @default.
- W4221166942 countsByYear W42211669422022 @default.
- W4221166942 countsByYear W42211669422023 @default.
- W4221166942 crossrefType "proceedings-article" @default.
- W4221166942 hasAuthorship W4221166942A5013186280 @default.
- W4221166942 hasAuthorship W4221166942A5021075276 @default.
- W4221166942 hasAuthorship W4221166942A5042018181 @default.
- W4221166942 hasAuthorship W4221166942A5052381023 @default.
- W4221166942 hasAuthorship W4221166942A5060364305 @default.
- W4221166942 hasAuthorship W4221166942A5064373607 @default.
- W4221166942 hasBestOaLocation W42211669421 @default.
- W4221166942 hasConcept C104317684 @default.
- W4221166942 hasConcept C111919701 @default.
- W4221166942 hasConcept C11413529 @default.
- W4221166942 hasConcept C118505674 @default.
- W4221166942 hasConcept C125411270 @default.
- W4221166942 hasConcept C133162039 @default.
- W4221166942 hasConcept C154945302 @default.
- W4221166942 hasConcept C162324750 @default.
- W4221166942 hasConcept C177264268 @default.
- W4221166942 hasConcept C17744445 @default.
- W4221166942 hasConcept C185592680 @default.
- W4221166942 hasConcept C187736073 @default.
- W4221166942 hasConcept C188027245 @default.
- W4221166942 hasConcept C199360897 @default.
- W4221166942 hasConcept C199539241 @default.
- W4221166942 hasConcept C26517878 @default.
- W4221166942 hasConcept C2776235265 @default.
- W4221166942 hasConcept C2776359362 @default.
- W4221166942 hasConcept C2776760102 @default.
- W4221166942 hasConcept C2780451532 @default.
- W4221166942 hasConcept C38652104 @default.
- W4221166942 hasConcept C41008148 @default.
- W4221166942 hasConcept C55493867 @default.
- W4221166942 hasConcept C57273362 @default.
- W4221166942 hasConcept C66746571 @default.
- W4221166942 hasConcept C67692717 @default.
- W4221166942 hasConcept C70992990 @default.
- W4221166942 hasConcept C71139939 @default.
- W4221166942 hasConcept C80444323 @default.
- W4221166942 hasConcept C94625758 @default.
- W4221166942 hasConceptScore W4221166942C104317684 @default.
- W4221166942 hasConceptScore W4221166942C111919701 @default.
- W4221166942 hasConceptScore W4221166942C11413529 @default.
- W4221166942 hasConceptScore W4221166942C118505674 @default.
- W4221166942 hasConceptScore W4221166942C125411270 @default.
- W4221166942 hasConceptScore W4221166942C133162039 @default.
- W4221166942 hasConceptScore W4221166942C154945302 @default.
- W4221166942 hasConceptScore W4221166942C162324750 @default.
- W4221166942 hasConceptScore W4221166942C177264268 @default.
- W4221166942 hasConceptScore W4221166942C17744445 @default.
- W4221166942 hasConceptScore W4221166942C185592680 @default.
- W4221166942 hasConceptScore W4221166942C187736073 @default.
- W4221166942 hasConceptScore W4221166942C188027245 @default.
- W4221166942 hasConceptScore W4221166942C199360897 @default.
- W4221166942 hasConceptScore W4221166942C199539241 @default.
- W4221166942 hasConceptScore W4221166942C26517878 @default.
- W4221166942 hasConceptScore W4221166942C2776235265 @default.
- W4221166942 hasConceptScore W4221166942C2776359362 @default.
- W4221166942 hasConceptScore W4221166942C2776760102 @default.
- W4221166942 hasConceptScore W4221166942C2780451532 @default.
- W4221166942 hasConceptScore W4221166942C38652104 @default.
- W4221166942 hasConceptScore W4221166942C41008148 @default.
- W4221166942 hasConceptScore W4221166942C55493867 @default.
- W4221166942 hasConceptScore W4221166942C57273362 @default.
- W4221166942 hasConceptScore W4221166942C66746571 @default.
- W4221166942 hasConceptScore W4221166942C67692717 @default.
- W4221166942 hasConceptScore W4221166942C70992990 @default.
- W4221166942 hasConceptScore W4221166942C71139939 @default.
- W4221166942 hasConceptScore W4221166942C80444323 @default.
- W4221166942 hasConceptScore W4221166942C94625758 @default.
- W4221166942 hasLocation W42211669421 @default.
- W4221166942 hasLocation W42211669422 @default.
- W4221166942 hasOpenAccess W4221166942 @default.
- W4221166942 hasPrimaryLocation W42211669421 @default.
- W4221166942 hasRelatedWork W140709781 @default.
- W4221166942 hasRelatedWork W1750758696 @default.
- W4221166942 hasRelatedWork W176174999 @default.
- W4221166942 hasRelatedWork W2076903247 @default.
- W4221166942 hasRelatedWork W2160620982 @default.
- W4221166942 hasRelatedWork W2275988210 @default.
- W4221166942 hasRelatedWork W2359640100 @default.
- W4221166942 hasRelatedWork W2389073067 @default.
- W4221166942 hasRelatedWork W283806354 @default.
- W4221166942 hasRelatedWork W4320166805 @default.
- W4221166942 isParatext "false" @default.