Matches in SemOpenAlex for { <https://semopenalex.org/work/W2911558106> ?p ?o ?g. }
Showing items 1 to 94 of
94
with 100 items per page.
- W2911558106 abstract "Continuous Bag of Words (CBOW) is a powerful text embedding method. Due to its strong capabilities to encode word content, CBOW embeddings perform well on a wide range of downstream tasks while being efficient to compute. However, CBOW is not capable of capturing the word order. The reason is that the computation of CBOW's word embeddings is commutative, i.e., embeddings of XYZ and ZYX are the same. In order to address this shortcoming, we propose a learning algorithm for the Continuous Matrix Space Model, which we call Continual Multiplication of Words (CMOW). Our algorithm is an adaptation of word2vec, so that it can be trained on large quantities of unlabeled text. We empirically show that CMOW better captures linguistic properties, but it is inferior to CBOW in memorizing word content. Motivated by these findings, we propose a hybrid model that combines the strengths of CBOW and CMOW. Our results show that the hybrid CBOW-CMOW-model retains CBOW's strong ability to memorize word content while at the same time substantially improving its ability to encode other linguistic information by 8%. As a result, the hybrid also performs better on 8 out of 11 supervised downstream tasks with an average improvement of 1.2%." @default.
- W2911558106 created "2019-02-21" @default.
- W2911558106 creator A5019702549 @default.
- W2911558106 creator A5033589871 @default.
- W2911558106 creator A5077989893 @default.
- W2911558106 date "2019-02-18" @default.
- W2911558106 modified "2023-09-27" @default.
- W2911558106 title "CBOW Is Not All You Need: Combining CBOW with the Compositional Matrix Space Model" @default.
- W2911558106 cites W1484288670 @default.
- W2911558106 cites W1486649854 @default.
- W2911558106 cites W1533861849 @default.
- W2911558106 cites W1614298861 @default.
- W2911558106 cites W1889268436 @default.
- W2911558106 cites W2124824117 @default.
- W2911558106 cites W2153579005 @default.
- W2911558106 cites W2295260089 @default.
- W2911558106 cites W2605035112 @default.
- W2911558106 cites W2606089314 @default.
- W2911558106 cites W2741348340 @default.
- W2911558106 cites W2752172973 @default.
- W2911558106 cites W2761988601 @default.
- W2911558106 cites W2787560479 @default.
- W2911558106 cites W2793381978 @default.
- W2911558106 cites W2794557536 @default.
- W2911558106 cites W2808681756 @default.
- W2911558106 cites W2907849599 @default.
- W2911558106 cites W2962772361 @default.
- W2911558106 cites W2963090765 @default.
- W2911558106 cites W2963499246 @default.
- W2911558106 cites W2963644595 @default.
- W2911558106 cites W2963756346 @default.
- W2911558106 cites W2963804993 @default.
- W2911558106 cites W2963918774 @default.
- W2911558106 cites W2964025273 @default.
- W2911558106 cites W2964121744 @default.
- W2911558106 cites W2964165804 @default.
- W2911558106 cites W2964263514 @default.
- W2911558106 cites W2964331819 @default.
- W2911558106 cites W42251416 @default.
- W2911558106 hasPublicationYear "2019" @default.
- W2911558106 type Work @default.
- W2911558106 sameAs 2911558106 @default.
- W2911558106 citedByCount "0" @default.
- W2911558106 crossrefType "posted-content" @default.
- W2911558106 hasAuthorship W2911558106A5019702549 @default.
- W2911558106 hasAuthorship W2911558106A5033589871 @default.
- W2911558106 hasAuthorship W2911558106A5077989893 @default.
- W2911558106 hasConcept C13672336 @default.
- W2911558106 hasConcept C154945302 @default.
- W2911558106 hasConcept C204321447 @default.
- W2911558106 hasConcept C2524010 @default.
- W2911558106 hasConcept C2776461190 @default.
- W2911558106 hasConcept C33923547 @default.
- W2911558106 hasConcept C41008148 @default.
- W2911558106 hasConcept C41608201 @default.
- W2911558106 hasConcept C80444323 @default.
- W2911558106 hasConcept C90805587 @default.
- W2911558106 hasConceptScore W2911558106C13672336 @default.
- W2911558106 hasConceptScore W2911558106C154945302 @default.
- W2911558106 hasConceptScore W2911558106C204321447 @default.
- W2911558106 hasConceptScore W2911558106C2524010 @default.
- W2911558106 hasConceptScore W2911558106C2776461190 @default.
- W2911558106 hasConceptScore W2911558106C33923547 @default.
- W2911558106 hasConceptScore W2911558106C41008148 @default.
- W2911558106 hasConceptScore W2911558106C41608201 @default.
- W2911558106 hasConceptScore W2911558106C80444323 @default.
- W2911558106 hasConceptScore W2911558106C90805587 @default.
- W2911558106 hasLocation W29115581061 @default.
- W2911558106 hasOpenAccess W2911558106 @default.
- W2911558106 hasPrimaryLocation W29115581061 @default.
- W2911558106 hasRelatedWork W1499253590 @default.
- W2911558106 hasRelatedWork W1614298861 @default.
- W2911558106 hasRelatedWork W2250717533 @default.
- W2911558106 hasRelatedWork W2441977585 @default.
- W2911558106 hasRelatedWork W2552147134 @default.
- W2911558106 hasRelatedWork W2620816324 @default.
- W2911558106 hasRelatedWork W2768669181 @default.
- W2911558106 hasRelatedWork W2769063188 @default.
- W2911558106 hasRelatedWork W2785524755 @default.
- W2911558106 hasRelatedWork W2895153640 @default.
- W2911558106 hasRelatedWork W2899189400 @default.
- W2911558106 hasRelatedWork W2953316075 @default.
- W2911558106 hasRelatedWork W2954456502 @default.
- W2911558106 hasRelatedWork W2963025768 @default.
- W2911558106 hasRelatedWork W2965477556 @default.
- W2911558106 hasRelatedWork W2978806756 @default.
- W2911558106 hasRelatedWork W3056409443 @default.
- W2911558106 hasRelatedWork W3091387667 @default.
- W2911558106 hasRelatedWork W3114096814 @default.
- W2911558106 hasRelatedWork W3178053363 @default.
- W2911558106 isParatext "false" @default.
- W2911558106 isRetracted "false" @default.
- W2911558106 magId "2911558106" @default.
- W2911558106 workType "article" @default.