Matches in SemOpenAlex for { <https://semopenalex.org/work/W4286235887> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4286235887 abstract "Representational Similarity Analysis is a method from cognitive neuroscience, which helps in comparing representations from two different sources of data. In this paper, we propose using Representational Similarity Analysis to probe the semantic grounding in language models of code. We probe representations from the CodeBERT model for semantic grounding by using the data from the IBM CodeNet dataset. Through our experiments, we show that current pre-training methods do not induce semantic grounding in language models of code, and instead focus on optimizing form-based patterns. We also show that even a little amount of fine-tuning on semantically relevant tasks increases the semantic grounding in CodeBERT significantly. Our ablations with the input modality to the CodeBERT model show that using bimodal inputs (code and natural language) over unimodal inputs (only code) gives better semantic grounding and sample efficiency during semantic fine-tuning. Finally, our experiments with semantic perturbations in code reveal that CodeBERT is able to robustly distinguish between semantically correct and incorrect code." @default.
- W4286235887 created "2022-07-21" @default.
- W4286235887 creator A5033036471 @default.
- W4286235887 creator A5035303257 @default.
- W4286235887 creator A5036746217 @default.
- W4286235887 creator A5050661587 @default.
- W4286235887 date "2022-07-15" @default.
- W4286235887 modified "2023-09-25" @default.
- W4286235887 title "Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis" @default.
- W4286235887 doi "https://doi.org/10.48550/arxiv.2207.07706" @default.
- W4286235887 hasPublicationYear "2022" @default.
- W4286235887 type Work @default.
- W4286235887 citedByCount "0" @default.
- W4286235887 crossrefType "posted-content" @default.
- W4286235887 hasAuthorship W4286235887A5033036471 @default.
- W4286235887 hasAuthorship W4286235887A5035303257 @default.
- W4286235887 hasAuthorship W4286235887A5036746217 @default.
- W4286235887 hasAuthorship W4286235887A5050661587 @default.
- W4286235887 hasBestOaLocation W42862358871 @default.
- W4286235887 hasConcept C103278499 @default.
- W4286235887 hasConcept C115961682 @default.
- W4286235887 hasConcept C120665830 @default.
- W4286235887 hasConcept C121332964 @default.
- W4286235887 hasConcept C130318100 @default.
- W4286235887 hasConcept C154945302 @default.
- W4286235887 hasConcept C168993435 @default.
- W4286235887 hasConcept C177264268 @default.
- W4286235887 hasConcept C192209626 @default.
- W4286235887 hasConcept C199360897 @default.
- W4286235887 hasConcept C204321447 @default.
- W4286235887 hasConcept C2129575 @default.
- W4286235887 hasConcept C2776760102 @default.
- W4286235887 hasConcept C41008148 @default.
- W4286235887 hasConcept C511149849 @default.
- W4286235887 hasConcept C62520636 @default.
- W4286235887 hasConceptScore W4286235887C103278499 @default.
- W4286235887 hasConceptScore W4286235887C115961682 @default.
- W4286235887 hasConceptScore W4286235887C120665830 @default.
- W4286235887 hasConceptScore W4286235887C121332964 @default.
- W4286235887 hasConceptScore W4286235887C130318100 @default.
- W4286235887 hasConceptScore W4286235887C154945302 @default.
- W4286235887 hasConceptScore W4286235887C168993435 @default.
- W4286235887 hasConceptScore W4286235887C177264268 @default.
- W4286235887 hasConceptScore W4286235887C192209626 @default.
- W4286235887 hasConceptScore W4286235887C199360897 @default.
- W4286235887 hasConceptScore W4286235887C204321447 @default.
- W4286235887 hasConceptScore W4286235887C2129575 @default.
- W4286235887 hasConceptScore W4286235887C2776760102 @default.
- W4286235887 hasConceptScore W4286235887C41008148 @default.
- W4286235887 hasConceptScore W4286235887C511149849 @default.
- W4286235887 hasConceptScore W4286235887C62520636 @default.
- W4286235887 hasLocation W42862358871 @default.
- W4286235887 hasOpenAccess W4286235887 @default.
- W4286235887 hasPrimaryLocation W42862358871 @default.
- W4286235887 hasRelatedWork W2038246283 @default.
- W4286235887 hasRelatedWork W2110503409 @default.
- W4286235887 hasRelatedWork W2176444225 @default.
- W4286235887 hasRelatedWork W2251797829 @default.
- W4286235887 hasRelatedWork W2252005665 @default.
- W4286235887 hasRelatedWork W2351485412 @default.
- W4286235887 hasRelatedWork W2963539636 @default.
- W4286235887 hasRelatedWork W3201962287 @default.
- W4286235887 hasRelatedWork W4281690070 @default.
- W4286235887 hasRelatedWork W3120375180 @default.
- W4286235887 isParatext "false" @default.
- W4286235887 isRetracted "false" @default.
- W4286235887 workType "article" @default.