FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3197832011> ?p ?o ?g. }

• W3197832011 abstract "Transfer learning through large pre-trained models has changed the landscape of current applications in natural language processing (NLP). Recently Optimus, a variational autoencoder (VAE) which combines two pre-trained models, BERT and GPT-2, has been released, and its combination with generative adversial networks (GANs) has been shown to produce novel, yet very human-looking text. The Optimus and GANs combination avoids the troublesome application of GANs to the discrete domain of text, and prevents the exposure bias of standard maximum likelihood methods. We combine the training of GANs in the latent space, with the finetuning of the decoder of Optimus for single word generation. This approach lets us model both the high-level features of the sentences, and the low-level word-by-word generation. We finetune using reinforcement learning (RL) by exploiting the structure of GPT-2 and by adding entropy-based intrinsically motivated rewards to balance between quality and diversity. We benchmark the results of the VAE-GAN model, and show the improvements brought by our RL finetuning on three widely used datasets for text generation, with results that greatly surpass the current state-of-the-art for the quality of the generated texts." @default.
• W3197832011 created "2021-09-13" @default.
• W3197832011 creator A5079219362 @default.
• W3197832011 creator A5083738483 @default.
• W3197832011 date "2021-09-01" @default.
• W3197832011 modified "2023-09-27" @default.
• W3197832011 title "OptAGAN: Entropy-based finetuning on text VAE-GAN" @default.
• W3197832011 cites W1840435438 @default.
• W3197832011 cites W1889081078 @default.
• W3197832011 cites W2396427021 @default.
• W3197832011 cites W2525778437 @default.
• W3197832011 cites W2565378226 @default.
• W3197832011 cites W2616969219 @default.
• W3197832011 cites W2624872001 @default.
• W3197832011 cites W2757836268 @default.
• W3197832011 cites W2807747378 @default.
• W3197832011 cites W2895824518 @default.
• W3197832011 cites W2908747729 @default.
• W3197832011 cites W2946687438 @default.
• W3197832011 cites W2963167310 @default.
• W3197832011 cites W2963223306 @default.
• W3197832011 cites W2963341956 @default.
• W3197832011 cites W2963403868 @default.
• W3197832011 cites W2963456134 @default.
• W3197832011 cites W2964061924 @default.
• W3197832011 cites W2964268978 @default.
• W3197832011 cites W2973379954 @default.
• W3197832011 cites W2996068536 @default.
• W3197832011 cites W3016108643 @default.
• W3197832011 cites W3023581195 @default.
• W3197832011 cites W3033166111 @default.
• W3197832011 cites W3092871541 @default.
• W3197832011 cites W3097834984 @default.
• W3197832011 cites W648786980 @default.
• W3197832011 hasPublicationYear "2021" @default.
• W3197832011 type Work @default.
• W3197832011 sameAs 3197832011 @default.
• W3197832011 citedByCount "0" @default.
• W3197832011 crossrefType "posted-content" @default.
• W3197832011 hasAuthorship W3197832011A5079219362 @default.
• W3197832011 hasAuthorship W3197832011A5083738483 @default.
• W3197832011 hasConcept C101738243 @default.
• W3197832011 hasConcept C106301342 @default.
• W3197832011 hasConcept C119857082 @default.
• W3197832011 hasConcept C121332964 @default.
• W3197832011 hasConcept C13280743 @default.
• W3197832011 hasConcept C154945302 @default.
• W3197832011 hasConcept C185798385 @default.
• W3197832011 hasConcept C204321447 @default.
• W3197832011 hasConcept C205649164 @default.
• W3197832011 hasConcept C2524010 @default.
• W3197832011 hasConcept C33923547 @default.
• W3197832011 hasConcept C39890363 @default.
• W3197832011 hasConcept C41008148 @default.
• W3197832011 hasConcept C50644808 @default.
• W3197832011 hasConcept C62520636 @default.
• W3197832011 hasConcept C90805587 @default.
• W3197832011 hasConcept C9679016 @default.
• W3197832011 hasConcept C97541855 @default.
• W3197832011 hasConceptScore W3197832011C101738243 @default.
• W3197832011 hasConceptScore W3197832011C106301342 @default.
• W3197832011 hasConceptScore W3197832011C119857082 @default.
• W3197832011 hasConceptScore W3197832011C121332964 @default.
• W3197832011 hasConceptScore W3197832011C13280743 @default.
• W3197832011 hasConceptScore W3197832011C154945302 @default.
• W3197832011 hasConceptScore W3197832011C185798385 @default.
• W3197832011 hasConceptScore W3197832011C204321447 @default.
• W3197832011 hasConceptScore W3197832011C205649164 @default.
• W3197832011 hasConceptScore W3197832011C2524010 @default.
• W3197832011 hasConceptScore W3197832011C33923547 @default.
• W3197832011 hasConceptScore W3197832011C39890363 @default.
• W3197832011 hasConceptScore W3197832011C41008148 @default.
• W3197832011 hasConceptScore W3197832011C50644808 @default.
• W3197832011 hasConceptScore W3197832011C62520636 @default.
• W3197832011 hasConceptScore W3197832011C90805587 @default.
• W3197832011 hasConceptScore W3197832011C9679016 @default.
• W3197832011 hasConceptScore W3197832011C97541855 @default.
• W3197832011 hasLocation W31978320111 @default.
• W3197832011 hasOpenAccess W3197832011 @default.
• W3197832011 hasPrimaryLocation W31978320111 @default.
• W3197832011 hasRelatedWork W2183405210 @default.
• W3197832011 hasRelatedWork W2797083259 @default.
• W3197832011 hasRelatedWork W2798273902 @default.
• W3197832011 hasRelatedWork W2886622678 @default.
• W3197832011 hasRelatedWork W2891641674 @default.
• W3197832011 hasRelatedWork W2897193746 @default.
• W3197832011 hasRelatedWork W2929742901 @default.
• W3197832011 hasRelatedWork W2955841847 @default.
• W3197832011 hasRelatedWork W2975288815 @default.
• W3197832011 hasRelatedWork W3016065350 @default.
• W3197832011 hasRelatedWork W3028694114 @default.
• W3197832011 hasRelatedWork W3087037461 @default.
• W3197832011 hasRelatedWork W3091334737 @default.
• W3197832011 hasRelatedWork W3095353058 @default.
• W3197832011 hasRelatedWork W3101597781 @default.
• W3197832011 hasRelatedWork W3111969164 @default.
• W3197832011 hasRelatedWork W3134248572 @default.
• W3197832011 hasRelatedWork W3155013188 @default.
• W3197832011 hasRelatedWork W3174098303 @default.
• W3197832011 hasRelatedWork W3174317920 @default.

• next