Matches in SemOpenAlex for { <https://semopenalex.org/work/W3118906073> ?p ?o ?g. }
- W3118906073 endingPage "177" @default.
- W3118906073 startingPage "164" @default.
- W3118906073 abstract "Language, like other natural sequences, exhibits statistical dependencies at a wide range of scales (Lin & Tegmark, 2016). However, many statistical learning models applied to language impose a sampling scale while extracting statistical structure. For instance, Word2Vec creates vector embeddings by sampling context in a window around each word, the size of which defines a strong scale; relationships over much larger temporal scales would be invisible to the algorithm. This paper examines the family of Word2Vec embeddings generated while systematically manipulating the size of the context window. The primary result is that different linguistic relationships are preferentially encoded at different scales. Different scales emphasize different syntactic and semantic relations between words, as assessed both by analogical reasoning tasks in the Google Analogies test set and human similarity rating datasets WordSim-353 and SimLex-999. Moreover, the neighborhoods of a given word in the embeddings change considerably depending on the scale. These results suggest that sampling at any individual scale can only identify a subset of the meaningful relationships a word might have, and point toward the importance of developing scale-free models of semantic meaning." @default.
- W3118906073 created "2021-01-18" @default.
- W3118906073 creator A5040388827 @default.
- W3118906073 creator A5085169868 @default.
- W3118906073 date "2021-01-04" @default.
- W3118906073 modified "2023-10-16" @default.
- W3118906073 title "Scale-Dependent Relationships in Natural Language" @default.
- W3118906073 cites W1498437823 @default.
- W3118906073 cites W1689711448 @default.
- W3118906073 cites W1854884267 @default.
- W3118906073 cites W1878893887 @default.
- W3118906073 cites W1972753913 @default.
- W3118906073 cites W1981617416 @default.
- W3118906073 cites W1983578042 @default.
- W3118906073 cites W1984251878 @default.
- W3118906073 cites W1984314602 @default.
- W3118906073 cites W1985258458 @default.
- W3118906073 cites W1986707196 @default.
- W3118906073 cites W1988864819 @default.
- W3118906073 cites W2005013412 @default.
- W3118906073 cites W2019588402 @default.
- W3118906073 cites W2032776989 @default.
- W3118906073 cites W2040940389 @default.
- W3118906073 cites W2044247492 @default.
- W3118906073 cites W2056720759 @default.
- W3118906073 cites W2057953526 @default.
- W3118906073 cites W2060694206 @default.
- W3118906073 cites W2064675550 @default.
- W3118906073 cites W2067438047 @default.
- W3118906073 cites W2085729670 @default.
- W3118906073 cites W2087148916 @default.
- W3118906073 cites W2087514146 @default.
- W3118906073 cites W2091827628 @default.
- W3118906073 cites W2107878631 @default.
- W3118906073 cites W2110485445 @default.
- W3118906073 cites W2116261113 @default.
- W3118906073 cites W2120339295 @default.
- W3118906073 cites W2133656308 @default.
- W3118906073 cites W2135368284 @default.
- W3118906073 cites W2136848157 @default.
- W3118906073 cites W2139630667 @default.
- W3118906073 cites W2139852582 @default.
- W3118906073 cites W2150301186 @default.
- W3118906073 cites W2163322331 @default.
- W3118906073 cites W2166033812 @default.
- W3118906073 cites W2171766645 @default.
- W3118906073 cites W2171928131 @default.
- W3118906073 cites W2172122397 @default.
- W3118906073 cites W2220289289 @default.
- W3118906073 cites W2250539671 @default.
- W3118906073 cites W2255466643 @default.
- W3118906073 cites W2400801499 @default.
- W3118906073 cites W2402268235 @default.
- W3118906073 cites W2404947714 @default.
- W3118906073 cites W2473196525 @default.
- W3118906073 cites W2513835729 @default.
- W3118906073 cites W2579555219 @default.
- W3118906073 cites W2797826682 @default.
- W3118906073 cites W2799577095 @default.
- W3118906073 cites W2800261909 @default.
- W3118906073 cites W2944617758 @default.
- W3118906073 cites W2954107635 @default.
- W3118906073 cites W2962739339 @default.
- W3118906073 cites W2962785940 @default.
- W3118906073 cites W2963026768 @default.
- W3118906073 cites W2963542836 @default.
- W3118906073 cites W2963951265 @default.
- W3118906073 cites W2964110616 @default.
- W3118906073 cites W3102543255 @default.
- W3118906073 doi "https://doi.org/10.1007/s42113-020-00094-8" @default.
- W3118906073 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/8317965" @default.
- W3118906073 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/34337323" @default.
- W3118906073 hasPublicationYear "2021" @default.
- W3118906073 type Work @default.
- W3118906073 sameAs 3118906073 @default.
- W3118906073 citedByCount "0" @default.
- W3118906073 crossrefType "journal-article" @default.
- W3118906073 hasAuthorship W3118906073A5040388827 @default.
- W3118906073 hasAuthorship W3118906073A5085169868 @default.
- W3118906073 hasBestOaLocation W31189060732 @default.
- W3118906073 hasConcept C103278499 @default.
- W3118906073 hasConcept C106131492 @default.
- W3118906073 hasConcept C111919701 @default.
- W3118906073 hasConcept C115961682 @default.
- W3118906073 hasConcept C130318100 @default.
- W3118906073 hasConcept C140779682 @default.
- W3118906073 hasConcept C154945302 @default.
- W3118906073 hasConcept C15744967 @default.
- W3118906073 hasConcept C166957645 @default.
- W3118906073 hasConcept C177264268 @default.
- W3118906073 hasConcept C195324797 @default.
- W3118906073 hasConcept C199360897 @default.
- W3118906073 hasConcept C204321447 @default.
- W3118906073 hasConcept C205649164 @default.
- W3118906073 hasConcept C2524010 @default.
- W3118906073 hasConcept C2776461190 @default.
- W3118906073 hasConcept C2778751112 @default.
- W3118906073 hasConcept C2778755073 @default.