FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3103188966> ?p ?o ?g. }

• W3103188966 abstract "We introduce Sentence-level Language Modeling, a new pre-training objective for learning a discourse language representation in a fully self-supervised manner. Recent pre-training methods in NLP focus on learning either bottom or top-level language representations: contextualized word representations derived from language model objectives at one extreme and a whole sequence representation learned by order classification of two given textual segments at the other. However, these models are not directly encouraged to capture representations of intermediate-size structures that exist in natural languages such as sentences and the relationships among them. To that end, we propose a new approach to encourage learning of a contextualized sentence-level representation by shuffling the sequence of input sentences and training a hierarchical transformer model to reconstruct the original ordering. Through experiments on downstream tasks such as GLUE, SQuAD, and DiscoEval, we show that this feature of our model improves the performance of the original BERT by large margins." @default.
• W3103188966 created "2020-11-23" @default.
• W3103188966 creator A5027693232 @default.
• W3103188966 creator A5046006076 @default.
• W3103188966 creator A5052875434 @default.
• W3103188966 creator A5073193050 @default.
• W3103188966 date "2020-01-01" @default.
• W3103188966 modified "2023-10-13" @default.
• W3103188966 title "SLM: Learning a Discourse Language Representation with Sentence Unshuffling" @default.
• W3103188966 cites W1486649854 @default.
• W3103188966 cites W2143017621 @default.
• W3103188966 cites W2510415884 @default.
• W3103188966 cites W2551029266 @default.
• W3103188966 cites W2610858497 @default.
• W3103188966 cites W2787998955 @default.
• W3103188966 cites W2944815030 @default.
• W3103188966 cites W2962739339 @default.
• W3103188966 cites W2962785754 @default.
• W3103188966 cites W2963310665 @default.
• W3103188966 cites W2963323070 @default.
• W3103188966 cites W2963341956 @default.
• W3103188966 cites W2963356835 @default.
• W3103188966 cites W2963403868 @default.
• W3103188966 cites W2963804993 @default.
• W3103188966 cites W2964025273 @default.
• W3103188966 cites W2964223283 @default.
• W3103188966 cites W2964331441 @default.
• W3103188966 cites W2965373594 @default.
• W3103188966 cites W2970597249 @default.
• W3103188966 cites W2971141916 @default.
• W3103188966 cites W2995923603 @default.
• W3103188966 cites W2996035354 @default.
• W3103188966 cites W2996428491 @default.
• W3103188966 cites W2997200074 @default.
• W3103188966 cites W3011411500 @default.
• W3103188966 cites W3035027743 @default.
• W3103188966 cites W3082274269 @default.
• W3103188966 doi "https://doi.org/10.18653/v1/2020.emnlp-main.120" @default.
• W3103188966 hasPublicationYear "2020" @default.
• W3103188966 type Work @default.
• W3103188966 sameAs 3103188966 @default.
• W3103188966 citedByCount "29" @default.
• W3103188966 countsByYear W31031889662020 @default.
• W3103188966 countsByYear W31031889662021 @default.
• W3103188966 countsByYear W31031889662022 @default.
• W3103188966 countsByYear W31031889662023 @default.
• W3103188966 crossrefType "proceedings-article" @default.
• W3103188966 hasAuthorship W3103188966A5027693232 @default.
• W3103188966 hasAuthorship W3103188966A5046006076 @default.
• W3103188966 hasAuthorship W3103188966A5052875434 @default.
• W3103188966 hasAuthorship W3103188966A5073193050 @default.
• W3103188966 hasBestOaLocation W31031889661 @default.
• W3103188966 hasConcept C120665830 @default.
• W3103188966 hasConcept C121332964 @default.
• W3103188966 hasConcept C137293760 @default.
• W3103188966 hasConcept C138885662 @default.
• W3103188966 hasConcept C154945302 @default.
• W3103188966 hasConcept C162324750 @default.
• W3103188966 hasConcept C165801399 @default.
• W3103188966 hasConcept C17744445 @default.
• W3103188966 hasConcept C187736073 @default.
• W3103188966 hasConcept C192209626 @default.
• W3103188966 hasConcept C195324797 @default.
• W3103188966 hasConcept C199539241 @default.
• W3103188966 hasConcept C204321447 @default.
• W3103188966 hasConcept C2776359362 @default.
• W3103188966 hasConcept C2776401178 @default.
• W3103188966 hasConcept C2777530160 @default.
• W3103188966 hasConcept C2780451532 @default.
• W3103188966 hasConcept C35639132 @default.
• W3103188966 hasConcept C41008148 @default.
• W3103188966 hasConcept C41895202 @default.
• W3103188966 hasConcept C59404180 @default.
• W3103188966 hasConcept C62520636 @default.
• W3103188966 hasConcept C66322947 @default.
• W3103188966 hasConcept C94625758 @default.
• W3103188966 hasConceptScore W3103188966C120665830 @default.
• W3103188966 hasConceptScore W3103188966C121332964 @default.
• W3103188966 hasConceptScore W3103188966C137293760 @default.
• W3103188966 hasConceptScore W3103188966C138885662 @default.
• W3103188966 hasConceptScore W3103188966C154945302 @default.
• W3103188966 hasConceptScore W3103188966C162324750 @default.
• W3103188966 hasConceptScore W3103188966C165801399 @default.
• W3103188966 hasConceptScore W3103188966C17744445 @default.
• W3103188966 hasConceptScore W3103188966C187736073 @default.
• W3103188966 hasConceptScore W3103188966C192209626 @default.
• W3103188966 hasConceptScore W3103188966C195324797 @default.
• W3103188966 hasConceptScore W3103188966C199539241 @default.
• W3103188966 hasConceptScore W3103188966C204321447 @default.
• W3103188966 hasConceptScore W3103188966C2776359362 @default.
• W3103188966 hasConceptScore W3103188966C2776401178 @default.
• W3103188966 hasConceptScore W3103188966C2777530160 @default.
• W3103188966 hasConceptScore W3103188966C2780451532 @default.
• W3103188966 hasConceptScore W3103188966C35639132 @default.
• W3103188966 hasConceptScore W3103188966C41008148 @default.
• W3103188966 hasConceptScore W3103188966C41895202 @default.
• W3103188966 hasConceptScore W3103188966C59404180 @default.
• W3103188966 hasConceptScore W3103188966C62520636 @default.
• W3103188966 hasConceptScore W3103188966C66322947 @default.
• W3103188966 hasConceptScore W3103188966C94625758 @default.

• next