Matches in SemOpenAlex for { <https://semopenalex.org/work/W4281567417> ?p ?o ?g. }
Showing items 1 to 68 of
68
with 100 items per page.
- W4281567417 abstract "Transformers have achieved remarkable performance in widespread fields, including natural language processing, computer vision and graph mining. However, in the knowledge graph representation, where translational distance paradigm dominates this area, vanilla Transformer architectures have not yielded promising improvements. Note that vanilla Transformer architectures struggle to capture the intrinsically semantic and structural information of knowledge graphs and can hardly scale to long-distance neighbors due to quadratic dependency. To this end, we propose a new variant of Transformer for knowledge graph representation dubbed Relphormer. Specifically, we introduce Triple2Seq which can dynamically sample contextualized sub-graph sequences as the input of the Transformer to alleviate the scalability issue. We then propose a novel structure-enhanced self-attention mechanism to encode the relational information and keep the globally semantic information among sub-graphs. Moreover, we propose masked knowledge modeling as a new paradigm for knowledge graph representation learning to unify different link prediction tasks. Experimental results show that our approach can obtain better performance on benchmark datasets compared with baselines." @default.
- W4281567417 created "2022-05-27" @default.
- W4281567417 creator A5055716038 @default.
- W4281567417 creator A5067989499 @default.
- W4281567417 creator A5087796565 @default.
- W4281567417 creator A5089259739 @default.
- W4281567417 creator A5090294171 @default.
- W4281567417 creator A5090437166 @default.
- W4281567417 date "2022-05-22" @default.
- W4281567417 modified "2023-10-16" @default.
- W4281567417 title "Relphormer: Relational Graph Transformer for Knowledge Graph Representation" @default.
- W4281567417 hasPublicationYear "2022" @default.
- W4281567417 type Work @default.
- W4281567417 citedByCount "0" @default.
- W4281567417 crossrefType "posted-content" @default.
- W4281567417 hasAuthorship W4281567417A5055716038 @default.
- W4281567417 hasAuthorship W4281567417A5067989499 @default.
- W4281567417 hasAuthorship W4281567417A5087796565 @default.
- W4281567417 hasAuthorship W4281567417A5089259739 @default.
- W4281567417 hasAuthorship W4281567417A5090294171 @default.
- W4281567417 hasAuthorship W4281567417A5090437166 @default.
- W4281567417 hasBestOaLocation W42815674171 @default.
- W4281567417 hasConcept C104317684 @default.
- W4281567417 hasConcept C121332964 @default.
- W4281567417 hasConcept C132525143 @default.
- W4281567417 hasConcept C154945302 @default.
- W4281567417 hasConcept C165801399 @default.
- W4281567417 hasConcept C185592680 @default.
- W4281567417 hasConcept C2987255567 @default.
- W4281567417 hasConcept C41008148 @default.
- W4281567417 hasConcept C48044578 @default.
- W4281567417 hasConcept C55493867 @default.
- W4281567417 hasConcept C62520636 @default.
- W4281567417 hasConcept C66322947 @default.
- W4281567417 hasConcept C66746571 @default.
- W4281567417 hasConcept C77088390 @default.
- W4281567417 hasConcept C80444323 @default.
- W4281567417 hasConceptScore W4281567417C104317684 @default.
- W4281567417 hasConceptScore W4281567417C121332964 @default.
- W4281567417 hasConceptScore W4281567417C132525143 @default.
- W4281567417 hasConceptScore W4281567417C154945302 @default.
- W4281567417 hasConceptScore W4281567417C165801399 @default.
- W4281567417 hasConceptScore W4281567417C185592680 @default.
- W4281567417 hasConceptScore W4281567417C2987255567 @default.
- W4281567417 hasConceptScore W4281567417C41008148 @default.
- W4281567417 hasConceptScore W4281567417C48044578 @default.
- W4281567417 hasConceptScore W4281567417C55493867 @default.
- W4281567417 hasConceptScore W4281567417C62520636 @default.
- W4281567417 hasConceptScore W4281567417C66322947 @default.
- W4281567417 hasConceptScore W4281567417C66746571 @default.
- W4281567417 hasConceptScore W4281567417C77088390 @default.
- W4281567417 hasConceptScore W4281567417C80444323 @default.
- W4281567417 hasLocation W42815674171 @default.
- W4281567417 hasOpenAccess W4281567417 @default.
- W4281567417 hasPrimaryLocation W42815674171 @default.
- W4281567417 hasRelatedWork W1079135 @default.
- W4281567417 hasRelatedWork W11244355 @default.
- W4281567417 hasRelatedWork W11644230 @default.
- W4281567417 hasRelatedWork W11851375 @default.
- W4281567417 hasRelatedWork W12248495 @default.
- W4281567417 hasRelatedWork W12433487 @default.
- W4281567417 hasRelatedWork W13082435 @default.
- W4281567417 hasRelatedWork W2956227 @default.
- W4281567417 hasRelatedWork W7857344 @default.
- W4281567417 hasRelatedWork W9035903 @default.
- W4281567417 isParatext "false" @default.
- W4281567417 isRetracted "false" @default.
- W4281567417 workType "article" @default.