FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3089307846> ?p ?o ?g. }

• W3089307846 abstract "Evaluation metrics play a vital role in the growth of an area as it defines the standard of distinguishing between good and bad models. In the area of code synthesis, the commonly used evaluation metric is BLEU or perfect accuracy, but they are not suitable enough to evaluate codes, because BLEU is originally designed to evaluate the natural language, neglecting important syntactic and semantic features of codes, and perfect accuracy is too strict thus it underestimates different outputs with the same semantic logic. To remedy this, we introduce a new automatic evaluation metric, dubbed CodeBLEU. It absorbs the strength of BLEU in the n-gram match and further injects code syntax via abstract syntax trees (AST) and code semantics via data-flow. We conduct experiments by evaluating the correlation coefficient between CodeBLEU and quality scores assigned by the programmers on three code synthesis tasks, i.e., text-to-code, code translation, and code refinement. Experimental results show that our proposed CodeBLEU can achieve a better correlation with programmer assigned scores compared with BLEU and accuracy." @default.
• W3089307846 created "2020-10-01" @default.
• W3089307846 creator A5006980420 @default.
• W3089307846 creator A5010323000 @default.
• W3089307846 creator A5028710085 @default.
• W3089307846 creator A5034608236 @default.
• W3089307846 creator A5034770439 @default.
• W3089307846 creator A5049732922 @default.
• W3089307846 creator A5052381023 @default.
• W3089307846 creator A5052842216 @default.
• W3089307846 creator A5060364305 @default.
• W3089307846 creator A5085284883 @default.
• W3089307846 date "2020-09-22" @default.
• W3089307846 modified "2023-09-27" @default.
• W3089307846 title "CodeBLEU: a Method for Automatic Evaluation of Code Synthesis" @default.
• W3089307846 cites W1860267373 @default.
• W3089307846 cites W2101105183 @default.
• W3089307846 cites W2130942839 @default.
• W3089307846 cites W2133564696 @default.
• W3089307846 cites W2154652894 @default.
• W3089307846 cites W2247864914 @default.
• W3089307846 cites W2728773317 @default.
• W3089307846 cites W2890194927 @default.
• W3089307846 cites W2953071394 @default.
• W3089307846 cites W2962728167 @default.
• W3089307846 cites W2962936887 @default.
• W3089307846 cites W2963403868 @default.
• W3089307846 cites W2963617989 @default.
• W3089307846 cites W2963935794 @default.
• W3089307846 cites W2964150020 @default.
• W3089307846 cites W2965785213 @default.
• W3089307846 cites W2972082064 @default.
• W3089307846 cites W2973529529 @default.
• W3089307846 cites W2995333547 @default.
• W3089307846 cites W2996248296 @default.
• W3089307846 cites W3008088841 @default.
• W3089307846 cites W3023431096 @default.
• W3089307846 cites W3025993830 @default.
• W3089307846 cites W3033638351 @default.
• W3089307846 cites W3034549508 @default.
• W3089307846 cites W3086007799 @default.
• W3089307846 cites W3122945969 @default.
• W3089307846 hasPublicationYear "2020" @default.
• W3089307846 type Work @default.
• W3089307846 sameAs 3089307846 @default.
• W3089307846 citedByCount "19" @default.
• W3089307846 countsByYear W30893078462021 @default.
• W3089307846 crossrefType "posted-content" @default.
• W3089307846 hasAuthorship W3089307846A5006980420 @default.
• W3089307846 hasAuthorship W3089307846A5010323000 @default.
• W3089307846 hasAuthorship W3089307846A5028710085 @default.
• W3089307846 hasAuthorship W3089307846A5034608236 @default.
• W3089307846 hasAuthorship W3089307846A5034770439 @default.
• W3089307846 hasAuthorship W3089307846A5049732922 @default.
• W3089307846 hasAuthorship W3089307846A5052381023 @default.
• W3089307846 hasAuthorship W3089307846A5052842216 @default.
• W3089307846 hasAuthorship W3089307846A5060364305 @default.
• W3089307846 hasAuthorship W3089307846A5085284883 @default.
• W3089307846 hasConcept C104317684 @default.
• W3089307846 hasConcept C105580179 @default.
• W3089307846 hasConcept C114408938 @default.
• W3089307846 hasConcept C149364088 @default.
• W3089307846 hasConcept C154945302 @default.
• W3089307846 hasConcept C162324750 @default.
• W3089307846 hasConcept C176217482 @default.
• W3089307846 hasConcept C177264268 @default.
• W3089307846 hasConcept C184337299 @default.
• W3089307846 hasConcept C185592680 @default.
• W3089307846 hasConcept C199360897 @default.
• W3089307846 hasConcept C203005215 @default.
• W3089307846 hasConcept C204321447 @default.
• W3089307846 hasConcept C21547014 @default.
• W3089307846 hasConcept C2776760102 @default.
• W3089307846 hasConcept C2778514511 @default.
• W3089307846 hasConcept C41008148 @default.
• W3089307846 hasConcept C55493867 @default.
• W3089307846 hasConcept C58646249 @default.
• W3089307846 hasConcept C60048249 @default.
• W3089307846 hasConcept C622187 @default.
• W3089307846 hasConceptScore W3089307846C104317684 @default.
• W3089307846 hasConceptScore W3089307846C105580179 @default.
• W3089307846 hasConceptScore W3089307846C114408938 @default.
• W3089307846 hasConceptScore W3089307846C149364088 @default.
• W3089307846 hasConceptScore W3089307846C154945302 @default.
• W3089307846 hasConceptScore W3089307846C162324750 @default.
• W3089307846 hasConceptScore W3089307846C176217482 @default.
• W3089307846 hasConceptScore W3089307846C177264268 @default.
• W3089307846 hasConceptScore W3089307846C184337299 @default.
• W3089307846 hasConceptScore W3089307846C185592680 @default.
• W3089307846 hasConceptScore W3089307846C199360897 @default.
• W3089307846 hasConceptScore W3089307846C203005215 @default.
• W3089307846 hasConceptScore W3089307846C204321447 @default.
• W3089307846 hasConceptScore W3089307846C21547014 @default.
• W3089307846 hasConceptScore W3089307846C2776760102 @default.
• W3089307846 hasConceptScore W3089307846C2778514511 @default.
• W3089307846 hasConceptScore W3089307846C41008148 @default.
• W3089307846 hasConceptScore W3089307846C55493867 @default.
• W3089307846 hasConceptScore W3089307846C58646249 @default.
• W3089307846 hasConceptScore W3089307846C60048249 @default.
• W3089307846 hasConceptScore W3089307846C622187 @default.

• next