Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387184429> ?p ?o ?g. }
Showing items 1 to 98 of
98
with 100 items per page.
- W4387184429 abstract "Abstract In this study, we primarily aim to address the exposure bias issue in long text generation intrinsic to statistical language models. We propose a sentence-level heuristic tree search algorithm, specially tailored for long text generation, to mitigate the problem by managing generated texts in a tree structure and curbing the compounding of biases. Our algorithm utilizes two pre-trained language models, an auto-regressive model for generating new sentences and an auto-encoder model for evaluating sentence quality. These models work in tandem to perform four critical operations: expanding the text tree with new sentences, evaluating the quality of the additions, sampling potential unfinished text fragments for further generation, and pruning leaf nodes deemed unpromising. This iterative process continues until a pre-defined number of [EOS] tokens are produced, at which point we select the highest-scoring completed text as our final output. Moreover, we pioneer two novel token-level decoding techniques—nucleus sampling with temperature and diverse beam search with sampling. These methods, integrated with our sentence-level search algorithm, aim to improve the consistency and diversity of text generation. Experimental results, both automated measures (including Jaccard similarity, Word2vec similarity, and unique word ratio) and human evaluations (assessing consistency, fluency, and rhetorical skills), conclusively demonstrate that our approach considerably enhances the quality of machine-generated long-form text. Through this research, we aim to inspire further innovations in sentence-level search-based text generation algorithms." @default.
- W4387184429 created "2023-09-30" @default.
- W4387184429 creator A5000785785 @default.
- W4387184429 creator A5088372348 @default.
- W4387184429 date "2023-09-29" @default.
- W4387184429 modified "2023-09-30" @default.
- W4387184429 title "Sentence-level heuristic tree search for long text generation" @default.
- W4387184429 cites W2101105183 @default.
- W4387184429 cites W2113228754 @default.
- W4387184429 cites W2757222607 @default.
- W4387184429 cites W2807925339 @default.
- W4387184429 cites W2952889708 @default.
- W4387184429 cites W2963096510 @default.
- W4387184429 cites W2963270153 @default.
- W4387184429 cites W2963283805 @default.
- W4387184429 cites W2963993699 @default.
- W4387184429 cites W2964110616 @default.
- W4387184429 cites W2970574558 @default.
- W4387184429 cites W3000154564 @default.
- W4387184429 cites W3015696182 @default.
- W4387184429 cites W3034287667 @default.
- W4387184429 cites W3034999214 @default.
- W4387184429 cites W3085190015 @default.
- W4387184429 cites W3089472875 @default.
- W4387184429 cites W3098172379 @default.
- W4387184429 cites W3100262863 @default.
- W4387184429 cites W3101652466 @default.
- W4387184429 cites W3103995860 @default.
- W4387184429 cites W3114326827 @default.
- W4387184429 cites W3162324357 @default.
- W4387184429 cites W3169017236 @default.
- W4387184429 cites W3174196343 @default.
- W4387184429 cites W3176618728 @default.
- W4387184429 cites W3210872109 @default.
- W4387184429 cites W4205384019 @default.
- W4387184429 cites W4224948081 @default.
- W4387184429 cites W4287854566 @default.
- W4387184429 cites W4385573460 @default.
- W4387184429 doi "https://doi.org/10.1007/s40747-023-01244-8" @default.
- W4387184429 hasPublicationYear "2023" @default.
- W4387184429 type Work @default.
- W4387184429 citedByCount "0" @default.
- W4387184429 crossrefType "journal-article" @default.
- W4387184429 hasAuthorship W4387184429A5000785785 @default.
- W4387184429 hasAuthorship W4387184429A5088372348 @default.
- W4387184429 hasBestOaLocation W43871844291 @default.
- W4387184429 hasConcept C106131492 @default.
- W4387184429 hasConcept C113174947 @default.
- W4387184429 hasConcept C11413529 @default.
- W4387184429 hasConcept C119857082 @default.
- W4387184429 hasConcept C125583679 @default.
- W4387184429 hasConcept C134306372 @default.
- W4387184429 hasConcept C137293760 @default.
- W4387184429 hasConcept C140779682 @default.
- W4387184429 hasConcept C154945302 @default.
- W4387184429 hasConcept C173801870 @default.
- W4387184429 hasConcept C195324797 @default.
- W4387184429 hasConcept C19889080 @default.
- W4387184429 hasConcept C204321447 @default.
- W4387184429 hasConcept C2776187449 @default.
- W4387184429 hasConcept C31972630 @default.
- W4387184429 hasConcept C33923547 @default.
- W4387184429 hasConcept C41008148 @default.
- W4387184429 hasConceptScore W4387184429C106131492 @default.
- W4387184429 hasConceptScore W4387184429C113174947 @default.
- W4387184429 hasConceptScore W4387184429C11413529 @default.
- W4387184429 hasConceptScore W4387184429C119857082 @default.
- W4387184429 hasConceptScore W4387184429C125583679 @default.
- W4387184429 hasConceptScore W4387184429C134306372 @default.
- W4387184429 hasConceptScore W4387184429C137293760 @default.
- W4387184429 hasConceptScore W4387184429C140779682 @default.
- W4387184429 hasConceptScore W4387184429C154945302 @default.
- W4387184429 hasConceptScore W4387184429C173801870 @default.
- W4387184429 hasConceptScore W4387184429C195324797 @default.
- W4387184429 hasConceptScore W4387184429C19889080 @default.
- W4387184429 hasConceptScore W4387184429C204321447 @default.
- W4387184429 hasConceptScore W4387184429C2776187449 @default.
- W4387184429 hasConceptScore W4387184429C31972630 @default.
- W4387184429 hasConceptScore W4387184429C33923547 @default.
- W4387184429 hasConceptScore W4387184429C41008148 @default.
- W4387184429 hasFunder F4320329861 @default.
- W4387184429 hasFunder F4320333335 @default.
- W4387184429 hasLocation W43871844291 @default.
- W4387184429 hasOpenAccess W4387184429 @default.
- W4387184429 hasPrimaryLocation W43871844291 @default.
- W4387184429 hasRelatedWork W138710363 @default.
- W4387184429 hasRelatedWork W1563618553 @default.
- W4387184429 hasRelatedWork W2169546346 @default.
- W4387184429 hasRelatedWork W2359001871 @default.
- W4387184429 hasRelatedWork W2783089240 @default.
- W4387184429 hasRelatedWork W2961085424 @default.
- W4387184429 hasRelatedWork W3130493457 @default.
- W4387184429 hasRelatedWork W4306674287 @default.
- W4387184429 hasRelatedWork W3045475294 @default.
- W4387184429 hasRelatedWork W4224009465 @default.
- W4387184429 isParatext "false" @default.
- W4387184429 isRetracted "false" @default.
- W4387184429 workType "article" @default.