Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385573046> ?p ?o ?g. }
Showing items 1 to 55 of
55
with 100 items per page.
- W4385573046 abstract "Transformers are now widely used in code representation, and several recent works further develop tree Transformers to capture the syntactic structure in source code. Specifically, novel tree positional encodings have been proposed to incorporate inductive bias into Transformer.In this work, we propose a novel tree Transformer encoding node positions based on our new description method for tree structures.Technically, local and global soft bias shown in previous works is both introduced as positional encodings of our Transformer model.Our model finally outperforms strong baselines on code summarization and completion tasks across two languages, demonstrating our model’s effectiveness.Besides, extensive experiments and ablation study shows that combining both local and global paradigms is still helpful in improving model performance. We release our code at https://github.com/AwdHanPeng/TreeTransformer." @default.
- W4385573046 created "2023-08-05" @default.
- W4385573046 creator A5027296110 @default.
- W4385573046 creator A5049100391 @default.
- W4385573046 creator A5053565454 @default.
- W4385573046 creator A5076676389 @default.
- W4385573046 date "2022-01-01" @default.
- W4385573046 modified "2023-09-23" @default.
- W4385573046 title "Rethinking Positional Encoding in Tree Transformer for Code Representation" @default.
- W4385573046 doi "https://doi.org/10.18653/v1/2022.emnlp-main.210" @default.
- W4385573046 hasPublicationYear "2022" @default.
- W4385573046 type Work @default.
- W4385573046 citedByCount "0" @default.
- W4385573046 crossrefType "proceedings-article" @default.
- W4385573046 hasAuthorship W4385573046A5027296110 @default.
- W4385573046 hasAuthorship W4385573046A5049100391 @default.
- W4385573046 hasAuthorship W4385573046A5053565454 @default.
- W4385573046 hasAuthorship W4385573046A5076676389 @default.
- W4385573046 hasBestOaLocation W43855730461 @default.
- W4385573046 hasConcept C119599485 @default.
- W4385573046 hasConcept C127413603 @default.
- W4385573046 hasConcept C154945302 @default.
- W4385573046 hasConcept C162319229 @default.
- W4385573046 hasConcept C163797641 @default.
- W4385573046 hasConcept C165801399 @default.
- W4385573046 hasConcept C170858558 @default.
- W4385573046 hasConcept C199360897 @default.
- W4385573046 hasConcept C41008148 @default.
- W4385573046 hasConcept C66322947 @default.
- W4385573046 hasConceptScore W4385573046C119599485 @default.
- W4385573046 hasConceptScore W4385573046C127413603 @default.
- W4385573046 hasConceptScore W4385573046C154945302 @default.
- W4385573046 hasConceptScore W4385573046C162319229 @default.
- W4385573046 hasConceptScore W4385573046C163797641 @default.
- W4385573046 hasConceptScore W4385573046C165801399 @default.
- W4385573046 hasConceptScore W4385573046C170858558 @default.
- W4385573046 hasConceptScore W4385573046C199360897 @default.
- W4385573046 hasConceptScore W4385573046C41008148 @default.
- W4385573046 hasConceptScore W4385573046C66322947 @default.
- W4385573046 hasLocation W43855730461 @default.
- W4385573046 hasOpenAccess W4385573046 @default.
- W4385573046 hasPrimaryLocation W43855730461 @default.
- W4385573046 hasRelatedWork W2136308941 @default.
- W4385573046 hasRelatedWork W2285613413 @default.
- W4385573046 hasRelatedWork W2308250245 @default.
- W4385573046 hasRelatedWork W2351187795 @default.
- W4385573046 hasRelatedWork W2380641910 @default.
- W4385573046 hasRelatedWork W2389846579 @default.
- W4385573046 hasRelatedWork W2443684444 @default.
- W4385573046 hasRelatedWork W2561691764 @default.
- W4385573046 hasRelatedWork W2589098947 @default.
- W4385573046 hasRelatedWork W2887112617 @default.
- W4385573046 isParatext "false" @default.
- W4385573046 isRetracted "false" @default.
- W4385573046 workType "article" @default.