Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313135053> ?p ?o ?g. }
Showing items 1 to 76 of
76
with 100 items per page.
- W4313135053 endingPage "105" @default.
- W4313135053 startingPage "93" @default.
- W4313135053 abstract "The existing multi-language generative model is considered as an important part of the multilingual field, which has received extensive attention in recent years. However, due to the scarcity of Chinese Minority corpus, developing a well-designed translation system is still a great challenge. To leverage the current corpus better, we design a pre-training method for the low resource domain, which can help the model better understand low resource text. The motivation is that the Chinese Minority languages have the characteristics of similarity and the adjacency of cultural transmission, and different multilingual translation pairs can provide the pre-trained model with sufficient semantic information. Therefore, we propose the Chinese Minority Pre-Trained (CMPT) language model with multi-tasking and multi-stage strategies to further leverage these low-resource corpora. Specifically, four pre-training tasks and two-stage strategies are adopted during pre-training for better results. Experiments show that our model outperforms the baseline method in Chinese Minority language translation. At the same time, we released the first generative pre-trained language model for the Chinese Minority to support the development of relevant research (All the experimental codes and the pre-trained language model are open-sourced on the website https://github.com/WENGSYX/CMPT )." @default.
- W4313135053 created "2023-01-06" @default.
- W4313135053 creator A5020872023 @default.
- W4313135053 creator A5029695887 @default.
- W4313135053 creator A5052553582 @default.
- W4313135053 creator A5067097659 @default.
- W4313135053 date "2022-01-01" @default.
- W4313135053 modified "2023-10-15" @default.
- W4313135053 title "A Multi-tasking and Multi-stage Chinese Minority Pre-trained Language Model" @default.
- W4313135053 cites W1956340063 @default.
- W4313135053 cites W2036273844 @default.
- W4313135053 cites W2062269633 @default.
- W4313135053 cites W2072566913 @default.
- W4313135053 cites W2101105183 @default.
- W4313135053 cites W2133459682 @default.
- W4313135053 cites W2194775991 @default.
- W4313135053 cites W2763150156 @default.
- W4313135053 cites W2912924812 @default.
- W4313135053 cites W2962996600 @default.
- W4313135053 cites W3001434439 @default.
- W4313135053 cites W3011411500 @default.
- W4313135053 cites W3023371261 @default.
- W4313135053 cites W3034999214 @default.
- W4313135053 cites W3035390927 @default.
- W4313135053 cites W3090350559 @default.
- W4313135053 cites W3121114447 @default.
- W4313135053 cites W3129831491 @default.
- W4313135053 cites W3176209443 @default.
- W4313135053 cites W3198659451 @default.
- W4313135053 doi "https://doi.org/10.1007/978-981-19-7960-6_10" @default.
- W4313135053 hasPublicationYear "2022" @default.
- W4313135053 type Work @default.
- W4313135053 citedByCount "0" @default.
- W4313135053 crossrefType "book-chapter" @default.
- W4313135053 hasAuthorship W4313135053A5020872023 @default.
- W4313135053 hasAuthorship W4313135053A5029695887 @default.
- W4313135053 hasAuthorship W4313135053A5052553582 @default.
- W4313135053 hasAuthorship W4313135053A5067097659 @default.
- W4313135053 hasConcept C109747225 @default.
- W4313135053 hasConcept C137293760 @default.
- W4313135053 hasConcept C153083717 @default.
- W4313135053 hasConcept C154945302 @default.
- W4313135053 hasConcept C162324750 @default.
- W4313135053 hasConcept C175444787 @default.
- W4313135053 hasConcept C203005215 @default.
- W4313135053 hasConcept C204321447 @default.
- W4313135053 hasConcept C39890363 @default.
- W4313135053 hasConcept C41008148 @default.
- W4313135053 hasConceptScore W4313135053C109747225 @default.
- W4313135053 hasConceptScore W4313135053C137293760 @default.
- W4313135053 hasConceptScore W4313135053C153083717 @default.
- W4313135053 hasConceptScore W4313135053C154945302 @default.
- W4313135053 hasConceptScore W4313135053C162324750 @default.
- W4313135053 hasConceptScore W4313135053C175444787 @default.
- W4313135053 hasConceptScore W4313135053C203005215 @default.
- W4313135053 hasConceptScore W4313135053C204321447 @default.
- W4313135053 hasConceptScore W4313135053C39890363 @default.
- W4313135053 hasConceptScore W4313135053C41008148 @default.
- W4313135053 hasLocation W43131350531 @default.
- W4313135053 hasOpenAccess W4313135053 @default.
- W4313135053 hasPrimaryLocation W43131350531 @default.
- W4313135053 hasRelatedWork W1569841287 @default.
- W4313135053 hasRelatedWork W1985007624 @default.
- W4313135053 hasRelatedWork W2176369193 @default.
- W4313135053 hasRelatedWork W2351428524 @default.
- W4313135053 hasRelatedWork W2747680751 @default.
- W4313135053 hasRelatedWork W2753086417 @default.
- W4313135053 hasRelatedWork W2884815824 @default.
- W4313135053 hasRelatedWork W3088348751 @default.
- W4313135053 hasRelatedWork W3107474891 @default.
- W4313135053 hasRelatedWork W970670907 @default.
- W4313135053 isParatext "false" @default.
- W4313135053 isRetracted "false" @default.
- W4313135053 workType "book-chapter" @default.