Matches in SemOpenAlex for { <https://semopenalex.org/work/W3133919902> ?p ?o ?g. }
- W3133919902 abstract "Since we can leverage a large amount of unlabeled data without any human supervision to train a model and transfer the knowledge to target tasks, self-supervised learning is a de-facto component for the recent success of deep learning in various fields. However, in many cases, there is a discrepancy between a self-supervised learning objective and a task-specific objective. In order to tackle such discrepancy in Text-to-SQL task, we propose a novel self-supervised learning framework. We utilize the task-specific properties of Text-to-SQL task and the underlying structures of table contents to train the models to learn useful knowledge of the textit{header-column} alignment task from unlabeled table data. We are able to transfer the knowledge to the supervised Text-to-SQL training with annotated samples, so that the model can leverage the knowledge to better perform the textit{header-span} alignment task to predict SQL statements. Experimental results show that our self-supervised learning framework significantly improves the performance of the existing strong BERT based models without using large external corpora. In particular, our method is effective for training the model with scarce labeled data. The source code of this work is available in GitHub." @default.
- W3133919902 created "2021-03-15" @default.
- W3133919902 creator A5066744863 @default.
- W3133919902 creator A5070831085 @default.
- W3133919902 date "2021-03-11" @default.
- W3133919902 modified "2023-09-27" @default.
- W3133919902 title "Self-supervised Text-to-SQL Learning with Header Alignment Training." @default.
- W3133919902 cites W1496189301 @default.
- W3133919902 cites W2091671846 @default.
- W3133919902 cites W2611818442 @default.
- W3133919902 cites W2751448157 @default.
- W3133919902 cites W2863697128 @default.
- W3133919902 cites W2890431379 @default.
- W3133919902 cites W2890561662 @default.
- W3133919902 cites W2891991579 @default.
- W3133919902 cites W2912624765 @default.
- W3133919902 cites W2917052767 @default.
- W3133919902 cites W2947354947 @default.
- W3133919902 cites W2950706223 @default.
- W3133919902 cites W2952466824 @default.
- W3133919902 cites W2962739339 @default.
- W3133919902 cites W2963207291 @default.
- W3133919902 cites W2963310665 @default.
- W3133919902 cites W2963341956 @default.
- W3133919902 cites W2964121744 @default.
- W3133919902 cites W2965373594 @default.
- W3133919902 cites W2970168256 @default.
- W3133919902 cites W2970172141 @default.
- W3133919902 cites W2971869958 @default.
- W3133919902 cites W2981852735 @default.
- W3133919902 cites W2982399380 @default.
- W3133919902 cites W3001197829 @default.
- W3133919902 cites W3005680577 @default.
- W3133919902 cites W3015937477 @default.
- W3133919902 cites W3034238904 @default.
- W3133919902 cites W3034408878 @default.
- W3133919902 cites W3035140194 @default.
- W3133919902 cites W3035231859 @default.
- W3133919902 hasPublicationYear "2021" @default.
- W3133919902 type Work @default.
- W3133919902 sameAs 3133919902 @default.
- W3133919902 citedByCount "0" @default.
- W3133919902 crossrefType "posted-content" @default.
- W3133919902 hasAuthorship W3133919902A5066744863 @default.
- W3133919902 hasAuthorship W3133919902A5070831085 @default.
- W3133919902 hasConcept C119857082 @default.
- W3133919902 hasConcept C124101348 @default.
- W3133919902 hasConcept C136389625 @default.
- W3133919902 hasConcept C150899416 @default.
- W3133919902 hasConcept C153083717 @default.
- W3133919902 hasConcept C154945302 @default.
- W3133919902 hasConcept C162324750 @default.
- W3133919902 hasConcept C187736073 @default.
- W3133919902 hasConcept C204321447 @default.
- W3133919902 hasConcept C2780451532 @default.
- W3133919902 hasConcept C31258907 @default.
- W3133919902 hasConcept C41008148 @default.
- W3133919902 hasConcept C45235069 @default.
- W3133919902 hasConcept C48105269 @default.
- W3133919902 hasConcept C50644808 @default.
- W3133919902 hasConcept C510870499 @default.
- W3133919902 hasConcept C58973888 @default.
- W3133919902 hasConcept C77088390 @default.
- W3133919902 hasConceptScore W3133919902C119857082 @default.
- W3133919902 hasConceptScore W3133919902C124101348 @default.
- W3133919902 hasConceptScore W3133919902C136389625 @default.
- W3133919902 hasConceptScore W3133919902C150899416 @default.
- W3133919902 hasConceptScore W3133919902C153083717 @default.
- W3133919902 hasConceptScore W3133919902C154945302 @default.
- W3133919902 hasConceptScore W3133919902C162324750 @default.
- W3133919902 hasConceptScore W3133919902C187736073 @default.
- W3133919902 hasConceptScore W3133919902C204321447 @default.
- W3133919902 hasConceptScore W3133919902C2780451532 @default.
- W3133919902 hasConceptScore W3133919902C31258907 @default.
- W3133919902 hasConceptScore W3133919902C41008148 @default.
- W3133919902 hasConceptScore W3133919902C45235069 @default.
- W3133919902 hasConceptScore W3133919902C48105269 @default.
- W3133919902 hasConceptScore W3133919902C50644808 @default.
- W3133919902 hasConceptScore W3133919902C510870499 @default.
- W3133919902 hasConceptScore W3133919902C58973888 @default.
- W3133919902 hasConceptScore W3133919902C77088390 @default.
- W3133919902 hasLocation W31339199021 @default.
- W3133919902 hasOpenAccess W3133919902 @default.
- W3133919902 hasPrimaryLocation W31339199021 @default.
- W3133919902 hasRelatedWork W1971125461 @default.
- W3133919902 hasRelatedWork W2117729721 @default.
- W3133919902 hasRelatedWork W2238429470 @default.
- W3133919902 hasRelatedWork W2742267824 @default.
- W3133919902 hasRelatedWork W2892375082 @default.
- W3133919902 hasRelatedWork W2913964174 @default.
- W3133919902 hasRelatedWork W2949135528 @default.
- W3133919902 hasRelatedWork W3015672537 @default.
- W3133919902 hasRelatedWork W3086441688 @default.
- W3133919902 hasRelatedWork W3106255016 @default.
- W3133919902 hasRelatedWork W3122996481 @default.
- W3133919902 hasRelatedWork W3153597994 @default.
- W3133919902 hasRelatedWork W3154050891 @default.
- W3133919902 hasRelatedWork W3168110185 @default.
- W3133919902 hasRelatedWork W3168921237 @default.
- W3133919902 hasRelatedWork W3170779537 @default.