Matches in SemOpenAlex for { <https://semopenalex.org/work/W3123350988> ?p ?o ?g. }
- W3123350988 abstract "Code retrieval and summarization are useful tasks for developers, but it is also challenging to build indices or summaries of code that capture both syntactic and semantic essential information of the code. To build a decent model on source code, one needs to collect a large amount of data from code hosting platforms, such as Github, Bitbucket, etc., label them and train it from a scratch for each task individually. Such an approach has two limitations: (1) training a new model for every new task is time-consuming; and (2) tremendous human effort is required to label the data for individual downstream tasks. To address these limitations, we are proposing Corder, a self-supervised contrastive learning framework that trains code representation models on unlabeled data. The pre-trained model from Corder can be used in two ways: (1) it can produce vector representation of code and can be applied to code retrieval tasks that does not have labelled data; (2) it can be used in a fine-tuning process for tasks that might still require label data such as code summarization. The key innovation is that we train the source code model by asking it to recognize similar and dissimilar code snippets through a textit{contrastive learning paradigm}. We use a set of semantic-preserving transformation operators to generate code snippets that are syntactically diverse but semantically equivalent. The contrastive learning objective, at the same time, maximizes the agreement between different views of the same snippets and minimizes the agreement between transformed views of different snippets. Through extensive experiments, we have shown that our Corder pretext task substantially outperform the other baselines for code-to-code retrieval, text-to-code retrieval and code-to-text summarization tasks." @default.
- W3123350988 created "2021-02-01" @default.
- W3123350988 creator A5002289161 @default.
- W3123350988 creator A5033649567 @default.
- W3123350988 creator A5083048049 @default.
- W3123350988 date "2020-09-06" @default.
- W3123350988 modified "2023-09-27" @default.
- W3123350988 title "Self-Supervised Learning for Code Retrieval and Summarization through Semantic-Preserving Program Transformations" @default.
- W3123350988 cites W1655956671 @default.
- W3123350988 cites W1966948031 @default.
- W3123350988 cites W2079887492 @default.
- W3123350988 cites W2114012357 @default.
- W3123350988 cites W2124807415 @default.
- W3123350988 cites W2130942839 @default.
- W3123350988 cites W2136922672 @default.
- W3123350988 cites W2153579005 @default.
- W3123350988 cites W2158439356 @default.
- W3123350988 cites W2171590421 @default.
- W3123350988 cites W2187089797 @default.
- W3123350988 cites W2516621648 @default.
- W3123350988 cites W2550462002 @default.
- W3123350988 cites W2608179060 @default.
- W3123350988 cites W2728773317 @default.
- W3123350988 cites W2735043505 @default.
- W3123350988 cites W2743316948 @default.
- W3123350988 cites W2794601162 @default.
- W3123350988 cites W2795013376 @default.
- W3123350988 cites W2804660315 @default.
- W3123350988 cites W2805788202 @default.
- W3123350988 cites W2884276923 @default.
- W3123350988 cites W2887364112 @default.
- W3123350988 cites W2888557792 @default.
- W3123350988 cites W2890194927 @default.
- W3123350988 cites W2949547296 @default.
- W3123350988 cites W2950726992 @default.
- W3123350988 cites W2950898568 @default.
- W3123350988 cites W2955426500 @default.
- W3123350988 cites W2962700525 @default.
- W3123350988 cites W2962742544 @default.
- W3123350988 cites W2963015915 @default.
- W3123350988 cites W2963212250 @default.
- W3123350988 cites W2963341956 @default.
- W3123350988 cites W2963371736 @default.
- W3123350988 cites W2963403868 @default.
- W3123350988 cites W2963499994 @default.
- W3123350988 cites W2963814513 @default.
- W3123350988 cites W2964048159 @default.
- W3123350988 cites W2964150020 @default.
- W3123350988 cites W2970186524 @default.
- W3123350988 cites W2970862273 @default.
- W3123350988 cites W2994865335 @default.
- W3123350988 cites W2997451752 @default.
- W3123350988 cites W2999760805 @default.
- W3123350988 cites W3005680577 @default.
- W3123350988 cites W3008088841 @default.
- W3123350988 cites W3094459920 @default.
- W3123350988 cites W3102782538 @default.
- W3123350988 hasPublicationYear "2020" @default.
- W3123350988 type Work @default.
- W3123350988 sameAs 3123350988 @default.
- W3123350988 citedByCount "0" @default.
- W3123350988 crossrefType "posted-content" @default.
- W3123350988 hasAuthorship W3123350988A5002289161 @default.
- W3123350988 hasAuthorship W3123350988A5033649567 @default.
- W3123350988 hasAuthorship W3123350988A5083048049 @default.
- W3123350988 hasConcept C154945302 @default.
- W3123350988 hasConcept C162324750 @default.
- W3123350988 hasConcept C170858558 @default.
- W3123350988 hasConcept C177264268 @default.
- W3123350988 hasConcept C17744445 @default.
- W3123350988 hasConcept C187736073 @default.
- W3123350988 hasConcept C199360897 @default.
- W3123350988 hasConcept C199539241 @default.
- W3123350988 hasConcept C204321447 @default.
- W3123350988 hasConcept C23123220 @default.
- W3123350988 hasConcept C2776359362 @default.
- W3123350988 hasConcept C2776760102 @default.
- W3123350988 hasConcept C2780451532 @default.
- W3123350988 hasConcept C41008148 @default.
- W3123350988 hasConcept C43126263 @default.
- W3123350988 hasConcept C94625758 @default.
- W3123350988 hasConceptScore W3123350988C154945302 @default.
- W3123350988 hasConceptScore W3123350988C162324750 @default.
- W3123350988 hasConceptScore W3123350988C170858558 @default.
- W3123350988 hasConceptScore W3123350988C177264268 @default.
- W3123350988 hasConceptScore W3123350988C17744445 @default.
- W3123350988 hasConceptScore W3123350988C187736073 @default.
- W3123350988 hasConceptScore W3123350988C199360897 @default.
- W3123350988 hasConceptScore W3123350988C199539241 @default.
- W3123350988 hasConceptScore W3123350988C204321447 @default.
- W3123350988 hasConceptScore W3123350988C23123220 @default.
- W3123350988 hasConceptScore W3123350988C2776359362 @default.
- W3123350988 hasConceptScore W3123350988C2776760102 @default.
- W3123350988 hasConceptScore W3123350988C2780451532 @default.
- W3123350988 hasConceptScore W3123350988C41008148 @default.
- W3123350988 hasConceptScore W3123350988C43126263 @default.
- W3123350988 hasConceptScore W3123350988C94625758 @default.
- W3123350988 hasLocation W31233509881 @default.
- W3123350988 hasOpenAccess W3123350988 @default.
- W3123350988 hasPrimaryLocation W31233509881 @default.