Matches in SemOpenAlex for { <https://semopenalex.org/work/W2970619710> ?p ?o ?g. }
- W2970619710 abstract "Shallow syntax provides an approximation of phrase-syntactic structure of sentences; it can be produced with high accuracy, and is computationally cheap to obtain. We investigate the role of shallow syntax-aware representations for NLP tasks using two techniques. First, we enhance the ELMo architecture to allow pretraining on predicted shallow syntactic parses, instead of just raw text, so that contextual embeddings make use of shallow syntactic context. Our second method involves shallow syntactic features obtained automatically on downstream task data. Neither approach leads to a significant gain on any of the four downstream tasks we considered relative to ELMo-only baselines. Further analysis using black-box probes confirms that our shallow-syntax-aware contextual embeddings do not transfer to linguistic tasks any more easily than ELMo's embeddings. We take these findings as evidence that ELMo-style pretraining discovers representations which make additional awareness of shallow syntax redundant." @default.
- W2970619710 created "2019-09-05" @default.
- W2970619710 creator A5009034593 @default.
- W2970619710 creator A5016370551 @default.
- W2970619710 creator A5061131385 @default.
- W2970619710 creator A5076880940 @default.
- W2970619710 creator A5088517824 @default.
- W2970619710 date "2019-08-29" @default.
- W2970619710 modified "2023-09-27" @default.
- W2970619710 title "Shallow Syntax in Deep Water" @default.
- W2970619710 cites W1579838312 @default.
- W2970619710 cites W1632114991 @default.
- W2970619710 cites W1938755728 @default.
- W2970619710 cites W2097125878 @default.
- W2970619710 cites W2098921539 @default.
- W2970619710 cites W2124725212 @default.
- W2970619710 cites W2132339004 @default.
- W2970619710 cites W2144578941 @default.
- W2970619710 cites W2159636675 @default.
- W2970619710 cites W2250263931 @default.
- W2970619710 cites W2251939518 @default.
- W2970619710 cites W2296283641 @default.
- W2970619710 cites W2525907473 @default.
- W2970619710 cites W2793978524 @default.
- W2970619710 cites W2798727047 @default.
- W2970619710 cites W2798826886 @default.
- W2970619710 cites W2888329843 @default.
- W2970619710 cites W2896457183 @default.
- W2970619710 cites W2951714314 @default.
- W2970619710 cites W2953369973 @default.
- W2970619710 cites W2962739339 @default.
- W2970619710 cites W2962788148 @default.
- W2970619710 cites W2963026768 @default.
- W2970619710 cites W2963073938 @default.
- W2970619710 cites W2963154734 @default.
- W2970619710 cites W2963403868 @default.
- W2970619710 cites W2963563735 @default.
- W2970619710 cites W2963651521 @default.
- W2970619710 cites W2963756346 @default.
- W2970619710 cites W2964030814 @default.
- W2970619710 cites W2964303116 @default.
- W2970619710 hasPublicationYear "2019" @default.
- W2970619710 type Work @default.
- W2970619710 sameAs 2970619710 @default.
- W2970619710 citedByCount "8" @default.
- W2970619710 countsByYear W29706197102020 @default.
- W2970619710 countsByYear W29706197102021 @default.
- W2970619710 crossrefType "posted-content" @default.
- W2970619710 hasAuthorship W2970619710A5009034593 @default.
- W2970619710 hasAuthorship W2970619710A5016370551 @default.
- W2970619710 hasAuthorship W2970619710A5061131385 @default.
- W2970619710 hasAuthorship W2970619710A5076880940 @default.
- W2970619710 hasAuthorship W2970619710A5088517824 @default.
- W2970619710 hasConcept C114408938 @default.
- W2970619710 hasConcept C138885662 @default.
- W2970619710 hasConcept C151730666 @default.
- W2970619710 hasConcept C154945302 @default.
- W2970619710 hasConcept C162324750 @default.
- W2970619710 hasConcept C187736073 @default.
- W2970619710 hasConcept C204321447 @default.
- W2970619710 hasConcept C21547014 @default.
- W2970619710 hasConcept C2776207758 @default.
- W2970619710 hasConcept C2776224158 @default.
- W2970619710 hasConcept C2779343474 @default.
- W2970619710 hasConcept C2780451532 @default.
- W2970619710 hasConcept C41008148 @default.
- W2970619710 hasConcept C41895202 @default.
- W2970619710 hasConcept C60048249 @default.
- W2970619710 hasConcept C86803240 @default.
- W2970619710 hasConceptScore W2970619710C114408938 @default.
- W2970619710 hasConceptScore W2970619710C138885662 @default.
- W2970619710 hasConceptScore W2970619710C151730666 @default.
- W2970619710 hasConceptScore W2970619710C154945302 @default.
- W2970619710 hasConceptScore W2970619710C162324750 @default.
- W2970619710 hasConceptScore W2970619710C187736073 @default.
- W2970619710 hasConceptScore W2970619710C204321447 @default.
- W2970619710 hasConceptScore W2970619710C21547014 @default.
- W2970619710 hasConceptScore W2970619710C2776207758 @default.
- W2970619710 hasConceptScore W2970619710C2776224158 @default.
- W2970619710 hasConceptScore W2970619710C2779343474 @default.
- W2970619710 hasConceptScore W2970619710C2780451532 @default.
- W2970619710 hasConceptScore W2970619710C41008148 @default.
- W2970619710 hasConceptScore W2970619710C41895202 @default.
- W2970619710 hasConceptScore W2970619710C60048249 @default.
- W2970619710 hasConceptScore W2970619710C86803240 @default.
- W2970619710 hasLocation W29706197101 @default.
- W2970619710 hasOpenAccess W2970619710 @default.
- W2970619710 hasPrimaryLocation W29706197101 @default.
- W2970619710 hasRelatedWork W1747312753 @default.
- W2970619710 hasRelatedWork W1991566372 @default.
- W2970619710 hasRelatedWork W2069263150 @default.
- W2970619710 hasRelatedWork W2154558375 @default.
- W2970619710 hasRelatedWork W2250473257 @default.
- W2970619710 hasRelatedWork W2251939518 @default.
- W2970619710 hasRelatedWork W2564413943 @default.
- W2970619710 hasRelatedWork W2596659254 @default.
- W2970619710 hasRelatedWork W2741954161 @default.
- W2970619710 hasRelatedWork W2773021151 @default.
- W2970619710 hasRelatedWork W2899336413 @default.
- W2970619710 hasRelatedWork W2962739339 @default.