Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385574349> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4385574349 abstract "Neural language models have been analyzed for their linguistic and extra-linguistic knowledge via probing. Of particular interest has been the following question: how much can a language model trained only on form learn about meaning? Recent work has demonstrated via probing classifiers that in the setting of simple procedural text, where by “meaning” we mean the underlying world state, language models have a non-trivial performance on world state tracking. However, our proposed evaluation based on model predictions shows differing results, suggesting that these models are either not capturing the world state or not using it. How do these results change if the model has access to the world state? We explore this alternate setting with access to the underlying world state only during training and investigate ways of “baking in” the state knowledge along with the primary task of language modeling. Our proposed approaches allow for state probing during inference simply via text prompts, avoiding any probing classifier machinery. In terms of performance, we show that baking in the state knowledge during training leads to significant improvements in state tracking performance and text generation quality," @default.
- W4385574349 created "2023-08-05" @default.
- W4385574349 creator A5015602781 @default.
- W4385574349 creator A5073227709 @default.
- W4385574349 creator A5073890145 @default.
- W4385574349 creator A5081022650 @default.
- W4385574349 date "2022-01-01" @default.
- W4385574349 modified "2023-09-24" @default.
- W4385574349 title "Baked-in State Probing" @default.
- W4385574349 doi "https://doi.org/10.18653/v1/2022.findings-emnlp.397" @default.
- W4385574349 hasPublicationYear "2022" @default.
- W4385574349 type Work @default.
- W4385574349 citedByCount "0" @default.
- W4385574349 crossrefType "proceedings-article" @default.
- W4385574349 hasAuthorship W4385574349A5015602781 @default.
- W4385574349 hasAuthorship W4385574349A5073227709 @default.
- W4385574349 hasAuthorship W4385574349A5073890145 @default.
- W4385574349 hasAuthorship W4385574349A5081022650 @default.
- W4385574349 hasBestOaLocation W43855743491 @default.
- W4385574349 hasConcept C127413603 @default.
- W4385574349 hasConcept C137293760 @default.
- W4385574349 hasConcept C154945302 @default.
- W4385574349 hasConcept C15744967 @default.
- W4385574349 hasConcept C199360897 @default.
- W4385574349 hasConcept C201995342 @default.
- W4385574349 hasConcept C204321447 @default.
- W4385574349 hasConcept C2776214188 @default.
- W4385574349 hasConcept C2780451532 @default.
- W4385574349 hasConcept C2780876879 @default.
- W4385574349 hasConcept C2983448237 @default.
- W4385574349 hasConcept C41008148 @default.
- W4385574349 hasConcept C48103436 @default.
- W4385574349 hasConcept C542102704 @default.
- W4385574349 hasConcept C95623464 @default.
- W4385574349 hasConceptScore W4385574349C127413603 @default.
- W4385574349 hasConceptScore W4385574349C137293760 @default.
- W4385574349 hasConceptScore W4385574349C154945302 @default.
- W4385574349 hasConceptScore W4385574349C15744967 @default.
- W4385574349 hasConceptScore W4385574349C199360897 @default.
- W4385574349 hasConceptScore W4385574349C201995342 @default.
- W4385574349 hasConceptScore W4385574349C204321447 @default.
- W4385574349 hasConceptScore W4385574349C2776214188 @default.
- W4385574349 hasConceptScore W4385574349C2780451532 @default.
- W4385574349 hasConceptScore W4385574349C2780876879 @default.
- W4385574349 hasConceptScore W4385574349C2983448237 @default.
- W4385574349 hasConceptScore W4385574349C41008148 @default.
- W4385574349 hasConceptScore W4385574349C48103436 @default.
- W4385574349 hasConceptScore W4385574349C542102704 @default.
- W4385574349 hasConceptScore W4385574349C95623464 @default.
- W4385574349 hasLocation W43855743491 @default.
- W4385574349 hasOpenAccess W4385574349 @default.
- W4385574349 hasPrimaryLocation W43855743491 @default.
- W4385574349 hasRelatedWork W2359001871 @default.
- W4385574349 hasRelatedWork W2949992439 @default.
- W4385574349 hasRelatedWork W2953356739 @default.
- W4385574349 hasRelatedWork W2960591372 @default.
- W4385574349 hasRelatedWork W4205820553 @default.
- W4385574349 hasRelatedWork W4221160826 @default.
- W4385574349 hasRelatedWork W4288284621 @default.
- W4385574349 hasRelatedWork W4312091568 @default.
- W4385574349 hasRelatedWork W4320486724 @default.
- W4385574349 hasRelatedWork W4385567149 @default.
- W4385574349 isParatext "false" @default.
- W4385574349 isRetracted "false" @default.
- W4385574349 workType "article" @default.