Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386374572> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4386374572 endingPage "129" @default.
- W4386374572 startingPage "120" @default.
- W4386374572 abstract "Task generalization has been a long-standing challenge in Natural Language Processing (NLP). Recent research attempts to improve the task generalization ability of pre-trained language models by mapping NLP tasks into human-readable prompted forms. However, these approaches require laborious and inflexible manual collection of prompts, and different prompts on the same downstream task may receive unstable performance. We propose Unified Schema Prompt, a flexible and extensible prompting method, which automatically customizes the learnable prompts for each task according to the task input schema. It models the shared knowledge between tasks, while keeping the characteristics of different task schema, and thus enhances task generalization ability. The schema prompt takes the explicit data structure of each task to formulate prompts so that little human effort is involved. To test the task generalization ability of schema prompt at scale, we conduct schema prompt-based multitask pre-training on a wide variety of general NLP tasks. The framework achieves strong zero-shot and few-shot generalization performance on 16 unseen downstream tasks from 8 task types (e.g., QA, NLI, etc.). Furthermore, comprehensive analyses demonstrate the effectiveness of each component in the schema prompt, its flexibility in task compositionality, and its ability to improve performance under a full-data fine-tuning setting." @default.
- W4386374572 created "2023-09-02" @default.
- W4386374572 creator A5002250184 @default.
- W4386374572 creator A5013186280 @default.
- W4386374572 creator A5019101763 @default.
- W4386374572 creator A5031792794 @default.
- W4386374572 creator A5042018181 @default.
- W4386374572 creator A5044010230 @default.
- W4386374572 creator A5063062905 @default.
- W4386374572 creator A5064373607 @default.
- W4386374572 date "2023-01-01" @default.
- W4386374572 modified "2023-09-26" @default.
- W4386374572 title "Improving task generalization via unified schema prompt" @default.
- W4386374572 cites W2912904516 @default.
- W4386374572 cites W3102009955 @default.
- W4386374572 cites W3167602185 @default.
- W4386374572 doi "https://doi.org/10.1016/j.aiopen.2023.08.011" @default.
- W4386374572 hasPublicationYear "2023" @default.
- W4386374572 type Work @default.
- W4386374572 citedByCount "0" @default.
- W4386374572 crossrefType "journal-article" @default.
- W4386374572 hasAuthorship W4386374572A5002250184 @default.
- W4386374572 hasAuthorship W4386374572A5013186280 @default.
- W4386374572 hasAuthorship W4386374572A5019101763 @default.
- W4386374572 hasAuthorship W4386374572A5031792794 @default.
- W4386374572 hasAuthorship W4386374572A5042018181 @default.
- W4386374572 hasAuthorship W4386374572A5044010230 @default.
- W4386374572 hasAuthorship W4386374572A5063062905 @default.
- W4386374572 hasAuthorship W4386374572A5064373607 @default.
- W4386374572 hasBestOaLocation W43863745721 @default.
- W4386374572 hasConcept C119857082 @default.
- W4386374572 hasConcept C134306372 @default.
- W4386374572 hasConcept C154945302 @default.
- W4386374572 hasConcept C162324750 @default.
- W4386374572 hasConcept C177148314 @default.
- W4386374572 hasConcept C187736073 @default.
- W4386374572 hasConcept C204321447 @default.
- W4386374572 hasConcept C2780451532 @default.
- W4386374572 hasConcept C33923547 @default.
- W4386374572 hasConcept C41008148 @default.
- W4386374572 hasConcept C52146309 @default.
- W4386374572 hasConceptScore W4386374572C119857082 @default.
- W4386374572 hasConceptScore W4386374572C134306372 @default.
- W4386374572 hasConceptScore W4386374572C154945302 @default.
- W4386374572 hasConceptScore W4386374572C162324750 @default.
- W4386374572 hasConceptScore W4386374572C177148314 @default.
- W4386374572 hasConceptScore W4386374572C187736073 @default.
- W4386374572 hasConceptScore W4386374572C204321447 @default.
- W4386374572 hasConceptScore W4386374572C2780451532 @default.
- W4386374572 hasConceptScore W4386374572C33923547 @default.
- W4386374572 hasConceptScore W4386374572C41008148 @default.
- W4386374572 hasConceptScore W4386374572C52146309 @default.
- W4386374572 hasLocation W43863745721 @default.
- W4386374572 hasOpenAccess W4386374572 @default.
- W4386374572 hasPrimaryLocation W43863745721 @default.
- W4386374572 hasRelatedWork W2081647779 @default.
- W4386374572 hasRelatedWork W2885094885 @default.
- W4386374572 hasRelatedWork W2961085424 @default.
- W4386374572 hasRelatedWork W3046775127 @default.
- W4386374572 hasRelatedWork W3170094116 @default.
- W4386374572 hasRelatedWork W4285260836 @default.
- W4386374572 hasRelatedWork W4286629047 @default.
- W4386374572 hasRelatedWork W4306321456 @default.
- W4386374572 hasRelatedWork W4306674287 @default.
- W4386374572 hasRelatedWork W4224009465 @default.
- W4386374572 hasVolume "4" @default.
- W4386374572 isParatext "false" @default.
- W4386374572 isRetracted "false" @default.
- W4386374572 workType "article" @default.