Matches in SemOpenAlex for { <https://semopenalex.org/work/W3217001695> ?p ?o ?g. }
- W3217001695 abstract "Pre-trained models like BERT have achieved strong improvements on many natural language processing (NLP) tasks, showing their great generalizability. The success of pre-trained models in NLP inspires pre-trained models for programming language. Recently, CodeBERT, a model for both natural language (NL) and programming language (PL), pre-trained on code search dataset, is proposed. Although promising, CodeBERT has not been evaluated beyond its pre-trained dataset for NL-PL tasks. Also, it has only been shown effective on two tasks that are close in nature to its pre-trained data. This raises two questions: Can CodeBERT generalize beyond its pre-trained data? Can it generalize to various software engineering tasks involving NL and PL? Our work answers these questions by performing an empirical investigation into the generalizability of CodeBERT. First, we assess the generalizability of CodeBERT to datasets other than its pre-training data. Specifically, considering the code search task, we conduct experiments on another dataset containing Python code snippets and their corresponding documentation. We also consider yet another dataset of questions and answers collected from Stack Overflow about Python programming. Second, to assess the generalizability of CodeBERT to various software engineering tasks, we apply CodeBERT to the just-in-time defect prediction task. Our empirical results support the generalizability of CodeBERT on the additional data and task. CodeBERT-based solutions can achieve higher or comparable performance than specialized solutions designed for the code search and just-in-time defect prediction tasks. However, the superior performance of the CodeBERT requires a tradeoff; for example, it requires much more computation resources as compared to specialized code search approaches." @default.
- W3217001695 created "2021-12-06" @default.
- W3217001695 creator A5054031217 @default.
- W3217001695 creator A5054365831 @default.
- W3217001695 creator A5081036622 @default.
- W3217001695 date "2021-09-01" @default.
- W3217001695 modified "2023-10-03" @default.
- W3217001695 title "Assessing Generalizability of CodeBERT" @default.
- W3217001695 cites W1655956671 @default.
- W3217001695 cites W1832693441 @default.
- W3217001695 cites W2007705030 @default.
- W3217001695 cites W2125279207 @default.
- W3217001695 cites W2146338950 @default.
- W3217001695 cites W2147386665 @default.
- W3217001695 cites W2150874999 @default.
- W3217001695 cites W2169669347 @default.
- W3217001695 cites W2394841101 @default.
- W3217001695 cites W2470673105 @default.
- W3217001695 cites W2493916176 @default.
- W3217001695 cites W2594760301 @default.
- W3217001695 cites W2606150376 @default.
- W3217001695 cites W2736762043 @default.
- W3217001695 cites W2739996966 @default.
- W3217001695 cites W2794601162 @default.
- W3217001695 cites W2884001105 @default.
- W3217001695 cites W2888651608 @default.
- W3217001695 cites W2917037155 @default.
- W3217001695 cites W2919115771 @default.
- W3217001695 cites W2922006620 @default.
- W3217001695 cites W2923014074 @default.
- W3217001695 cites W2955991060 @default.
- W3217001695 cites W2963026768 @default.
- W3217001695 cites W2963159690 @default.
- W3217001695 cites W2963548617 @default.
- W3217001695 cites W2963748441 @default.
- W3217001695 cites W2964150020 @default.
- W3217001695 cites W2968179027 @default.
- W3217001695 cites W2981851019 @default.
- W3217001695 cites W2994865335 @default.
- W3217001695 cites W2997049449 @default.
- W3217001695 cites W3008086364 @default.
- W3217001695 cites W3098605233 @default.
- W3217001695 cites W3103981637 @default.
- W3217001695 cites W3105867435 @default.
- W3217001695 cites W3108032709 @default.
- W3217001695 cites W3122473522 @default.
- W3217001695 cites W3161997752 @default.
- W3217001695 doi "https://doi.org/10.1109/icsme52107.2021.00044" @default.
- W3217001695 hasPublicationYear "2021" @default.
- W3217001695 type Work @default.
- W3217001695 sameAs 3217001695 @default.
- W3217001695 citedByCount "15" @default.
- W3217001695 countsByYear W32170016952022 @default.
- W3217001695 countsByYear W32170016952023 @default.
- W3217001695 crossrefType "proceedings-article" @default.
- W3217001695 hasAuthorship W3217001695A5054031217 @default.
- W3217001695 hasAuthorship W3217001695A5054365831 @default.
- W3217001695 hasAuthorship W3217001695A5081036622 @default.
- W3217001695 hasBestOaLocation W32170016952 @default.
- W3217001695 hasConcept C105795698 @default.
- W3217001695 hasConcept C111472728 @default.
- W3217001695 hasConcept C119857082 @default.
- W3217001695 hasConcept C120936955 @default.
- W3217001695 hasConcept C138885662 @default.
- W3217001695 hasConcept C154945302 @default.
- W3217001695 hasConcept C162324750 @default.
- W3217001695 hasConcept C187736073 @default.
- W3217001695 hasConcept C199360897 @default.
- W3217001695 hasConcept C204321447 @default.
- W3217001695 hasConcept C27158222 @default.
- W3217001695 hasConcept C2777904410 @default.
- W3217001695 hasConcept C2780451532 @default.
- W3217001695 hasConcept C33923547 @default.
- W3217001695 hasConcept C41008148 @default.
- W3217001695 hasConcept C519991488 @default.
- W3217001695 hasConcept C56666940 @default.
- W3217001695 hasConceptScore W3217001695C105795698 @default.
- W3217001695 hasConceptScore W3217001695C111472728 @default.
- W3217001695 hasConceptScore W3217001695C119857082 @default.
- W3217001695 hasConceptScore W3217001695C120936955 @default.
- W3217001695 hasConceptScore W3217001695C138885662 @default.
- W3217001695 hasConceptScore W3217001695C154945302 @default.
- W3217001695 hasConceptScore W3217001695C162324750 @default.
- W3217001695 hasConceptScore W3217001695C187736073 @default.
- W3217001695 hasConceptScore W3217001695C199360897 @default.
- W3217001695 hasConceptScore W3217001695C204321447 @default.
- W3217001695 hasConceptScore W3217001695C27158222 @default.
- W3217001695 hasConceptScore W3217001695C2777904410 @default.
- W3217001695 hasConceptScore W3217001695C2780451532 @default.
- W3217001695 hasConceptScore W3217001695C33923547 @default.
- W3217001695 hasConceptScore W3217001695C41008148 @default.
- W3217001695 hasConceptScore W3217001695C519991488 @default.
- W3217001695 hasConceptScore W3217001695C56666940 @default.
- W3217001695 hasLocation W32170016951 @default.
- W3217001695 hasLocation W32170016952 @default.
- W3217001695 hasOpenAccess W3217001695 @default.
- W3217001695 hasPrimaryLocation W32170016951 @default.
- W3217001695 hasRelatedWork W179869519 @default.
- W3217001695 hasRelatedWork W1906486629 @default.
- W3217001695 hasRelatedWork W2084164722 @default.