Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385571145> ?p ?o ?g. }
Showing items 1 to 73 of
73
with 100 items per page.
- W4385571145 abstract "In this work, we conduct a detailed analysis on the performance of legal-oriented pre-trained language models (PLMs). We examine the interplay between their original objective, acquired knowledge, and legal language understanding capacities which we define as the upstream, probing, and downstream performance, respectively. We consider not only the models’ size but also the pre-training corpora used as important dimensions in our study. To this end, we release a multinational English legal corpus (LeXFiles) and a legal knowledge probing benchmark (LegalLAMA) to facilitate training and detailed analysis of legal-oriented PLMs. We release two new legal PLMs trained on LeXFiles and evaluate them alongside others on LegalLAMA and LexGLUE. We find that probing performance strongly correlates with upstream performance in related legal topics. On the other hand, downstream performance is mainly driven by the model’s size and prior legal knowledge which can be estimated by upstream and probing performance. Based on these findings, we can conclude that both dimensions are important for those seeking the development of domain-specific PLMs." @default.
- W4385571145 created "2023-08-05" @default.
- W4385571145 creator A5018138946 @default.
- W4385571145 creator A5038615036 @default.
- W4385571145 creator A5079179621 @default.
- W4385571145 creator A5084695889 @default.
- W4385571145 creator A5090834942 @default.
- W4385571145 date "2023-01-01" @default.
- W4385571145 modified "2023-09-24" @default.
- W4385571145 title "LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development" @default.
- W4385571145 doi "https://doi.org/10.18653/v1/2023.acl-long.865" @default.
- W4385571145 hasPublicationYear "2023" @default.
- W4385571145 type Work @default.
- W4385571145 citedByCount "0" @default.
- W4385571145 crossrefType "proceedings-article" @default.
- W4385571145 hasAuthorship W4385571145A5018138946 @default.
- W4385571145 hasAuthorship W4385571145A5038615036 @default.
- W4385571145 hasAuthorship W4385571145A5079179621 @default.
- W4385571145 hasAuthorship W4385571145A5084695889 @default.
- W4385571145 hasAuthorship W4385571145A5090834942 @default.
- W4385571145 hasBestOaLocation W43855711451 @default.
- W4385571145 hasConcept C127413603 @default.
- W4385571145 hasConcept C13280743 @default.
- W4385571145 hasConcept C154945302 @default.
- W4385571145 hasConcept C158016649 @default.
- W4385571145 hasConcept C17744445 @default.
- W4385571145 hasConcept C184356942 @default.
- W4385571145 hasConcept C185798385 @default.
- W4385571145 hasConcept C18762648 @default.
- W4385571145 hasConcept C191172861 @default.
- W4385571145 hasConcept C199539241 @default.
- W4385571145 hasConcept C204321447 @default.
- W4385571145 hasConcept C205649164 @default.
- W4385571145 hasConcept C21547014 @default.
- W4385571145 hasConcept C2776207758 @default.
- W4385571145 hasConcept C31258907 @default.
- W4385571145 hasConcept C41008148 @default.
- W4385571145 hasConcept C56739046 @default.
- W4385571145 hasConcept C78519656 @default.
- W4385571145 hasConceptScore W4385571145C127413603 @default.
- W4385571145 hasConceptScore W4385571145C13280743 @default.
- W4385571145 hasConceptScore W4385571145C154945302 @default.
- W4385571145 hasConceptScore W4385571145C158016649 @default.
- W4385571145 hasConceptScore W4385571145C17744445 @default.
- W4385571145 hasConceptScore W4385571145C184356942 @default.
- W4385571145 hasConceptScore W4385571145C185798385 @default.
- W4385571145 hasConceptScore W4385571145C18762648 @default.
- W4385571145 hasConceptScore W4385571145C191172861 @default.
- W4385571145 hasConceptScore W4385571145C199539241 @default.
- W4385571145 hasConceptScore W4385571145C204321447 @default.
- W4385571145 hasConceptScore W4385571145C205649164 @default.
- W4385571145 hasConceptScore W4385571145C21547014 @default.
- W4385571145 hasConceptScore W4385571145C2776207758 @default.
- W4385571145 hasConceptScore W4385571145C31258907 @default.
- W4385571145 hasConceptScore W4385571145C41008148 @default.
- W4385571145 hasConceptScore W4385571145C56739046 @default.
- W4385571145 hasConceptScore W4385571145C78519656 @default.
- W4385571145 hasLocation W43855711451 @default.
- W4385571145 hasOpenAccess W4385571145 @default.
- W4385571145 hasPrimaryLocation W43855711451 @default.
- W4385571145 hasRelatedWork W1481705354 @default.
- W4385571145 hasRelatedWork W1556728092 @default.
- W4385571145 hasRelatedWork W2209220924 @default.
- W4385571145 hasRelatedWork W2241146542 @default.
- W4385571145 hasRelatedWork W2962876085 @default.
- W4385571145 hasRelatedWork W2969166377 @default.
- W4385571145 hasRelatedWork W3015662558 @default.
- W4385571145 hasRelatedWork W3124477000 @default.
- W4385571145 hasRelatedWork W3124613626 @default.
- W4385571145 hasRelatedWork W3179846532 @default.
- W4385571145 isParatext "false" @default.
- W4385571145 isRetracted "false" @default.
- W4385571145 workType "article" @default.