FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3157746834> ?p ?o ?g. }

• W3157746834 abstract "Linked text representation is critical for many intelligent web applications, such as online advertisement and recommender systems. Recent breakthroughs on pretrained language models and graph neural networks facilitate the development of corresponding techniques. However, the existing works mainly rely on cascaded model structures: the texts are independently encoded by language models at first, and the textual embeddings are further aggregated by graph neural networks. We argue that the neighbourhood information is insufficiently utilized within the above process, which restricts the representation quality. In this work, we propose GraphFormers, where graph neural networks are nested alongside each transformer layer of the language models. On top of the above architecture, the linked texts will iteratively extract neighbourhood information for the enhancement of their own semantics. Such an iterative workflow gives rise to more effective utilization of neighbourhood information, which contributes to the representation quality. We further introduce an adaptation called unidirectional GraphFormers, which is much more efficient and comparably effective; and we leverage a pretraining strategy called the neighbourhood-aware masked language modeling to enhance the training effect. We perform extensive experiment studies with three large-scale linked text datasets, whose results verify the effectiveness of our proposed methods." @default.
• W3157746834 created "2021-05-10" @default.
• W3157746834 creator A5036954210 @default.
• W3157746834 creator A5037831162 @default.
• W3157746834 creator A5044147794 @default.
• W3157746834 creator A5044651577 @default.
• W3157746834 creator A5054790743 @default.
• W3157746834 creator A5065771969 @default.
• W3157746834 date "2021-05-06" @default.
• W3157746834 modified "2023-09-23" @default.
• W3157746834 title "GraphFormers: GNN-nested Language Models for Linked Text Representation." @default.
• W3157746834 cites W2131876387 @default.
• W3157746834 cites W2242161203 @default.
• W3157746834 cites W2250539671 @default.
• W3157746834 cites W2296073425 @default.
• W3157746834 cites W2519887557 @default.
• W3157746834 cites W2525778437 @default.
• W3157746834 cites W2597655663 @default.
• W3157746834 cites W2624431344 @default.
• W3157746834 cites W2626778328 @default.
• W3157746834 cites W2662348822 @default.
• W3157746834 cites W2787560479 @default.
• W3157746834 cites W2894175828 @default.
• W3157746834 cites W2949547296 @default.
• W3157746834 cites W2950133940 @default.
• W3157746834 cites W2950336186 @default.
• W3157746834 cites W2963341956 @default.
• W3157746834 cites W2963460103 @default.
• W3157746834 cites W2963858333 @default.
• W3157746834 cites W2965373594 @default.
• W3157746834 cites W2970096436 @default.
• W3157746834 cites W2970597249 @default.
• W3157746834 cites W2971193649 @default.
• W3157746834 cites W2976561662 @default.
• W3157746834 cites W2981852735 @default.
• W3157746834 cites W2983102021 @default.
• W3157746834 cites W3015883388 @default.
• W3157746834 cites W3016482365 @default.
• W3157746834 cites W3021282678 @default.
• W3157746834 cites W3030163527 @default.
• W3157746834 cites W3039695075 @default.
• W3157746834 cites W3080997787 @default.
• W3157746834 cites W3098400973 @default.
• W3157746834 cites W3100848837 @default.
• W3157746834 cites W3129831491 @default.
• W3157746834 cites W3152893301 @default.
• W3157746834 cites W3154229486 @default.
• W3157746834 cites W3156636935 @default.
• W3157746834 cites W3157563153 @default.
• W3157746834 cites W2971455676 @default.
• W3157746834 hasPublicationYear "2021" @default.
• W3157746834 type Work @default.
• W3157746834 sameAs 3157746834 @default.
• W3157746834 citedByCount "1" @default.
• W3157746834 countsByYear W31577468342021 @default.
• W3157746834 crossrefType "posted-content" @default.
• W3157746834 hasAuthorship W3157746834A5036954210 @default.
• W3157746834 hasAuthorship W3157746834A5037831162 @default.
• W3157746834 hasAuthorship W3157746834A5044147794 @default.
• W3157746834 hasAuthorship W3157746834A5044651577 @default.
• W3157746834 hasAuthorship W3157746834A5054790743 @default.
• W3157746834 hasAuthorship W3157746834A5065771969 @default.
• W3157746834 hasConcept C119857082 @default.
• W3157746834 hasConcept C132525143 @default.
• W3157746834 hasConcept C134306372 @default.
• W3157746834 hasConcept C137293760 @default.
• W3157746834 hasConcept C138268822 @default.
• W3157746834 hasConcept C153083717 @default.
• W3157746834 hasConcept C154945302 @default.
• W3157746834 hasConcept C161677786 @default.
• W3157746834 hasConcept C177212765 @default.
• W3157746834 hasConcept C204321447 @default.
• W3157746834 hasConcept C28076734 @default.
• W3157746834 hasConcept C33923547 @default.
• W3157746834 hasConcept C41008148 @default.
• W3157746834 hasConcept C50644808 @default.
• W3157746834 hasConcept C77088390 @default.
• W3157746834 hasConcept C80444323 @default.
• W3157746834 hasConceptScore W3157746834C119857082 @default.
• W3157746834 hasConceptScore W3157746834C132525143 @default.
• W3157746834 hasConceptScore W3157746834C134306372 @default.
• W3157746834 hasConceptScore W3157746834C137293760 @default.
• W3157746834 hasConceptScore W3157746834C138268822 @default.
• W3157746834 hasConceptScore W3157746834C153083717 @default.
• W3157746834 hasConceptScore W3157746834C154945302 @default.
• W3157746834 hasConceptScore W3157746834C161677786 @default.
• W3157746834 hasConceptScore W3157746834C177212765 @default.
• W3157746834 hasConceptScore W3157746834C204321447 @default.
• W3157746834 hasConceptScore W3157746834C28076734 @default.
• W3157746834 hasConceptScore W3157746834C33923547 @default.
• W3157746834 hasConceptScore W3157746834C41008148 @default.
• W3157746834 hasConceptScore W3157746834C50644808 @default.
• W3157746834 hasConceptScore W3157746834C77088390 @default.
• W3157746834 hasConceptScore W3157746834C80444323 @default.
• W3157746834 hasLocation W31577468341 @default.
• W3157746834 hasOpenAccess W3157746834 @default.
• W3157746834 hasPrimaryLocation W31577468341 @default.
• W3157746834 hasRelatedWork W2558476738 @default.
• W3157746834 hasRelatedWork W2799174516 @default.
• W3157746834 hasRelatedWork W2900962979 @default.

• next