FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3198188208> ?p ?o ?g. }

• W3198188208 abstract "Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep-learning-based models for code intelligence. Recently, many pre-trained language models for source code (e.g., CuBERT and CodeBERT) have been proposed to model the context of code and serve as a basis for downstream code intelligence tasks such as code search, code clone detection, and program translation. Current approaches typically consider the source code as a plain sequence of tokens, or inject the structure information (e.g., AST and data-flow) into the sequential model pre-training. To further explore the properties of programming languages, this paper proposes SynCoBERT, a syntax-guided multi-modal contrastive pre-training approach for better code representations. Specially, we design two novel pre-training objectives originating from the symbolic and syntactic properties of source code, i.e., Identifier Prediction (IP) and AST Edge Prediction (TEP), which are designed to predict identifiers, and edges between two nodes of AST, respectively. Meanwhile, to exploit the complementary information in semantically equivalent modalities (i.e., code, comment, AST) of the code, we propose a multi-modal contrastive learning strategy to maximize the mutual information among different modalities. Extensive experiments on four downstream tasks related to code intelligence show that SynCoBERT advances the state-of-the-art with the same pre-training corpus and model size." @default.
• W3198188208 created "2021-09-13" @default.
• W3198188208 creator A5006250732 @default.
• W3198188208 creator A5006822602 @default.
• W3198188208 creator A5012014905 @default.
• W3198188208 creator A5018684189 @default.
• W3198188208 creator A5023164791 @default.
• W3198188208 creator A5027475930 @default.
• W3198188208 creator A5034219446 @default.
• W3198188208 creator A5039376528 @default.
• W3198188208 creator A5086603207 @default.
• W3198188208 creator A5002355321 @default.
• W3198188208 date "2021-08-10" @default.
• W3198188208 modified "2023-09-26" @default.
• W3198188208 title "SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation" @default.
• W3198188208 cites W1832693441 @default.
• W3198188208 cites W1902237438 @default.
• W3198188208 cites W2065053490 @default.
• W3198188208 cites W2511803001 @default.
• W3198188208 cites W2743316948 @default.
• W3198188208 cites W2794601162 @default.
• W3198188208 cites W2890194927 @default.
• W3198188208 cites W2962784628 @default.
• W3198188208 cites W2963341956 @default.
• W3198188208 cites W2963355447 @default.
• W3198188208 cites W2963371736 @default.
• W3198188208 cites W2963403868 @default.
• W3198188208 cites W2964150020 @default.
• W3198188208 cites W2964199361 @default.
• W3198188208 cites W2965373594 @default.
• W3198188208 cites W2970641574 @default.
• W3198188208 cites W2970862273 @default.
• W3198188208 cites W2971351900 @default.
• W3198188208 cites W2973529529 @default.
• W3198188208 cites W2995480165 @default.
• W3198188208 cites W2996035354 @default.
• W3198188208 cites W2996428491 @default.
• W3198188208 cites W3026732421 @default.
• W3198188208 cites W3033406728 @default.
• W3198188208 cites W3034549508 @default.
• W3198188208 cites W3034781633 @default.
• W3198188208 cites W3034978746 @default.
• W3198188208 cites W3034999214 @default.
• W3198188208 cites W3040955294 @default.
• W3198188208 cites W3081963674 @default.
• W3198188208 cites W3082274269 @default.
• W3198188208 cites W3098605233 @default.
• W3198188208 cites W3105816068 @default.
• W3198188208 cites W3108032709 @default.
• W3198188208 cites W3115295967 @default.
• W3198188208 cites W3119507053 @default.
• W3198188208 cites W3121707215 @default.
• W3198188208 cites W3125488228 @default.
• W3198188208 cites W3163521353 @default.
• W3198188208 cites W3164054899 @default.
• W3198188208 cites W3170092793 @default.
• W3198188208 cites W3173063387 @default.
• W3198188208 cites W3175926148 @default.
• W3198188208 cites W3176463841 @default.
• W3198188208 cites W3186581526 @default.
• W3198188208 hasPublicationYear "2021" @default.
• W3198188208 type Work @default.
• W3198188208 sameAs 3198188208 @default.
• W3198188208 citedByCount "1" @default.
• W3198188208 countsByYear W31981882082021 @default.
• W3198188208 crossrefType "posted-content" @default.
• W3198188208 hasAuthorship W3198188208A5002355321 @default.
• W3198188208 hasAuthorship W3198188208A5006250732 @default.
• W3198188208 hasAuthorship W3198188208A5006822602 @default.
• W3198188208 hasAuthorship W3198188208A5012014905 @default.
• W3198188208 hasAuthorship W3198188208A5018684189 @default.
• W3198188208 hasAuthorship W3198188208A5023164791 @default.
• W3198188208 hasAuthorship W3198188208A5027475930 @default.
• W3198188208 hasAuthorship W3198188208A5034219446 @default.
• W3198188208 hasAuthorship W3198188208A5039376528 @default.
• W3198188208 hasAuthorship W3198188208A5086603207 @default.
• W3198188208 hasConcept C149091818 @default.
• W3198188208 hasConcept C154504017 @default.
• W3198188208 hasConcept C154945302 @default.
• W3198188208 hasConcept C177264268 @default.
• W3198188208 hasConcept C199360897 @default.
• W3198188208 hasConcept C204321447 @default.
• W3198188208 hasConcept C2776760102 @default.
• W3198188208 hasConcept C2777561058 @default.
• W3198188208 hasConcept C2777904410 @default.
• W3198188208 hasConcept C41008148 @default.
• W3198188208 hasConcept C43126263 @default.
• W3198188208 hasConcept C58646249 @default.
• W3198188208 hasConcept C60048249 @default.
• W3198188208 hasConceptScore W3198188208C149091818 @default.
• W3198188208 hasConceptScore W3198188208C154504017 @default.
• W3198188208 hasConceptScore W3198188208C154945302 @default.
• W3198188208 hasConceptScore W3198188208C177264268 @default.
• W3198188208 hasConceptScore W3198188208C199360897 @default.
• W3198188208 hasConceptScore W3198188208C204321447 @default.
• W3198188208 hasConceptScore W3198188208C2776760102 @default.
• W3198188208 hasConceptScore W3198188208C2777561058 @default.
• W3198188208 hasConceptScore W3198188208C2777904410 @default.
• W3198188208 hasConceptScore W3198188208C41008148 @default.
• W3198188208 hasConceptScore W3198188208C43126263 @default.

• next