Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385718206> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4385718206 abstract "Idioms such as “call it a day” and “piece of cake,” are prevalent in natural language. How do Transformer language models process idioms? This study examines this question by analysing three models - BERT, Multilingual BERT, and DistilBERT. We compare the embeddings of idiomatic and literal expressions across all layers of the networks at both the sentence and word levels. Additionally, we investigate the attention directed from other sentence tokens towards a word within an idiom as opposed to in a literal context. Results indicate that while the three models exhibit slightly different internal mechanisms, they all represent idioms distinctively compared to literal language, with attention playing a critical role. These findings suggest that idioms are semantically and syntactically idiosyncratic, not only for humans but also for language models." @default.
- W4385718206 created "2023-08-11" @default.
- W4385718206 creator A5020513328 @default.
- W4385718206 creator A5044396095 @default.
- W4385718206 creator A5087231578 @default.
- W4385718206 date "2023-01-01" @default.
- W4385718206 modified "2023-09-27" @default.
- W4385718206 title "How Are Idioms Processed Inside Transformer Language Models?" @default.
- W4385718206 doi "https://doi.org/10.18653/v1/2023.starsem-1.16" @default.
- W4385718206 hasPublicationYear "2023" @default.
- W4385718206 type Work @default.
- W4385718206 citedByCount "0" @default.
- W4385718206 crossrefType "proceedings-article" @default.
- W4385718206 hasAuthorship W4385718206A5020513328 @default.
- W4385718206 hasAuthorship W4385718206A5044396095 @default.
- W4385718206 hasAuthorship W4385718206A5087231578 @default.
- W4385718206 hasBestOaLocation W43857182061 @default.
- W4385718206 hasConcept C119599485 @default.
- W4385718206 hasConcept C127413603 @default.
- W4385718206 hasConcept C137293760 @default.
- W4385718206 hasConcept C138885662 @default.
- W4385718206 hasConcept C154945302 @default.
- W4385718206 hasConcept C165801399 @default.
- W4385718206 hasConcept C166957645 @default.
- W4385718206 hasConcept C195324797 @default.
- W4385718206 hasConcept C199360897 @default.
- W4385718206 hasConcept C204321447 @default.
- W4385718206 hasConcept C2777530160 @default.
- W4385718206 hasConcept C2779343474 @default.
- W4385718206 hasConcept C2780882242 @default.
- W4385718206 hasConcept C41008148 @default.
- W4385718206 hasConcept C41895202 @default.
- W4385718206 hasConcept C66322947 @default.
- W4385718206 hasConcept C95457728 @default.
- W4385718206 hasConceptScore W4385718206C119599485 @default.
- W4385718206 hasConceptScore W4385718206C127413603 @default.
- W4385718206 hasConceptScore W4385718206C137293760 @default.
- W4385718206 hasConceptScore W4385718206C138885662 @default.
- W4385718206 hasConceptScore W4385718206C154945302 @default.
- W4385718206 hasConceptScore W4385718206C165801399 @default.
- W4385718206 hasConceptScore W4385718206C166957645 @default.
- W4385718206 hasConceptScore W4385718206C195324797 @default.
- W4385718206 hasConceptScore W4385718206C199360897 @default.
- W4385718206 hasConceptScore W4385718206C204321447 @default.
- W4385718206 hasConceptScore W4385718206C2777530160 @default.
- W4385718206 hasConceptScore W4385718206C2779343474 @default.
- W4385718206 hasConceptScore W4385718206C2780882242 @default.
- W4385718206 hasConceptScore W4385718206C41008148 @default.
- W4385718206 hasConceptScore W4385718206C41895202 @default.
- W4385718206 hasConceptScore W4385718206C66322947 @default.
- W4385718206 hasConceptScore W4385718206C95457728 @default.
- W4385718206 hasLocation W43857182061 @default.
- W4385718206 hasOpenAccess W4385718206 @default.
- W4385718206 hasPrimaryLocation W43857182061 @default.
- W4385718206 hasRelatedWork W159132833 @default.
- W4385718206 hasRelatedWork W1989705153 @default.
- W4385718206 hasRelatedWork W2049428229 @default.
- W4385718206 hasRelatedWork W20999564 @default.
- W4385718206 hasRelatedWork W4226190794 @default.
- W4385718206 hasRelatedWork W4302773876 @default.
- W4385718206 hasRelatedWork W4365788213 @default.
- W4385718206 hasRelatedWork W4385873483 @default.
- W4385718206 hasRelatedWork W4385877744 @default.
- W4385718206 hasRelatedWork W1872130062 @default.
- W4385718206 isParatext "false" @default.
- W4385718206 isRetracted "false" @default.
- W4385718206 workType "article" @default.