FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2997175890> ?p ?o ?g. }

• W2997175890 abstract "Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that position embeddings capture the position of individual words, but not the ordered relationship (e.g., adjacency or precedence) between individual word positions. We present a novel and principled solution for modeling both the global absolute positions of words and their order relationships. Our solution generalizes word embeddings, previously defined as independent vectors, to continuous word functions over a variable (position). The benefit of continuous functions over variable positions is that word representations shift smoothly with increasing positions. Hence, word representations in different positions can correlate with each other in a continuous function. The general solution of these functions is extended to complex-valued domain due to richer representations. We extend CNN, RNN and Transformer NNs to complex-valued versions to incorporate our complex embedding (we make all code available). Experiments on text classification, machine translation and language modeling show gains over both classical word embeddings and position-enriched word embeddings. To our knowledge, this is the first work in NLP to link imaginary numbers in complex-valued representations to concrete meanings (i.e., word order)." @default.
• W2997175890 created "2020-01-10" @default.
• W2997175890 creator A5024664299 @default.
• W2997175890 creator A5026465666 @default.
• W2997175890 creator A5029360035 @default.
• W2997175890 creator A5045425016 @default.
• W2997175890 creator A5057282504 @default.
• W2997175890 creator A5073963054 @default.
• W2997175890 date "2019-12-27" @default.
• W2997175890 modified "2023-09-27" @default.
• W2997175890 title "Encoding word order in complex embeddings" @default.
• W2997175890 cites W1423339008 @default.
• W2997175890 cites W1485275430 @default.
• W2997175890 cites W1526708997 @default.
• W2997175890 cites W1563364586 @default.
• W2997175890 cites W2014902591 @default.
• W2997175890 cites W2070246124 @default.
• W2997175890 cites W2119000949 @default.
• W2997175890 cites W2135858797 @default.
• W2997175890 cites W2160660844 @default.
• W2997175890 cites W2163455955 @default.
• W2997175890 cites W2164177859 @default.
• W2997175890 cites W2250539671 @default.
• W2997175890 cites W2251939518 @default.
• W2997175890 cites W2326533993 @default.
• W2997175890 cites W2410082850 @default.
• W2997175890 cites W2418388682 @default.
• W2997175890 cites W2468328197 @default.
• W2997175890 cites W2510842514 @default.
• W2997175890 cites W2525246036 @default.
• W2997175890 cites W2612953412 @default.
• W2997175890 cites W2618946976 @default.
• W2997175890 cites W2786464815 @default.
• W2997175890 cites W2789541106 @default.
• W2997175890 cites W2792764867 @default.
• W2997175890 cites W2798749466 @default.
• W2997175890 cites W2808922889 @default.
• W2997175890 cites W2898606889 @default.
• W2997175890 cites W2911109671 @default.
• W2997175890 cites W2913009085 @default.
• W2997175890 cites W2949541494 @default.
• W2997175890 cites W2950577311 @default.
• W2997175890 cites W2951864354 @default.
• W2997175890 cites W2952902402 @default.
• W2997175890 cites W2954058703 @default.
• W2997175890 cites W2963042606 @default.
• W2997175890 cites W2963341956 @default.
• W2997175890 cites W2963403868 @default.
• W2997175890 cites W2963432357 @default.
• W2997175890 cites W2963983719 @default.
• W2997175890 cites W2964265128 @default.
• W2997175890 cites W2964299903 @default.
• W2997175890 cites W2964308564 @default.
• W2997175890 cites W2970213198 @default.
• W2997175890 cites W93167102 @default.
• W2997175890 hasPublicationYear "2019" @default.
• W2997175890 type Work @default.
• W2997175890 sameAs 2997175890 @default.
• W2997175890 citedByCount "7" @default.
• W2997175890 countsByYear W29971758902020 @default.
• W2997175890 countsByYear W29971758902021 @default.
• W2997175890 crossrefType "posted-content" @default.
• W2997175890 hasAuthorship W2997175890A5024664299 @default.
• W2997175890 hasAuthorship W2997175890A5026465666 @default.
• W2997175890 hasAuthorship W2997175890A5029360035 @default.
• W2997175890 hasAuthorship W2997175890A5045425016 @default.
• W2997175890 hasAuthorship W2997175890A5057282504 @default.
• W2997175890 hasAuthorship W2997175890A5073963054 @default.
• W2997175890 hasConcept C10138342 @default.
• W2997175890 hasConcept C110484373 @default.
• W2997175890 hasConcept C11413529 @default.
• W2997175890 hasConcept C154945302 @default.
• W2997175890 hasConcept C162324750 @default.
• W2997175890 hasConcept C198082294 @default.
• W2997175890 hasConcept C203005215 @default.
• W2997175890 hasConcept C204321447 @default.
• W2997175890 hasConcept C2524010 @default.
• W2997175890 hasConcept C2777462759 @default.
• W2997175890 hasConcept C33923547 @default.
• W2997175890 hasConcept C41008148 @default.
• W2997175890 hasConcept C41608201 @default.
• W2997175890 hasConcept C70777604 @default.
• W2997175890 hasConcept C80444323 @default.
• W2997175890 hasConcept C90805587 @default.
• W2997175890 hasConceptScore W2997175890C10138342 @default.
• W2997175890 hasConceptScore W2997175890C110484373 @default.
• W2997175890 hasConceptScore W2997175890C11413529 @default.
• W2997175890 hasConceptScore W2997175890C154945302 @default.
• W2997175890 hasConceptScore W2997175890C162324750 @default.
• W2997175890 hasConceptScore W2997175890C198082294 @default.
• W2997175890 hasConceptScore W2997175890C203005215 @default.
• W2997175890 hasConceptScore W2997175890C204321447 @default.
• W2997175890 hasConceptScore W2997175890C2524010 @default.
• W2997175890 hasConceptScore W2997175890C2777462759 @default.
• W2997175890 hasConceptScore W2997175890C33923547 @default.
• W2997175890 hasConceptScore W2997175890C41008148 @default.
• W2997175890 hasConceptScore W2997175890C41608201 @default.
• W2997175890 hasConceptScore W2997175890C70777604 @default.
• W2997175890 hasConceptScore W2997175890C80444323 @default.
• W2997175890 hasConceptScore W2997175890C90805587 @default.

• next