Matches in SemOpenAlex for { <https://semopenalex.org/work/W4297644311> ?p ?o ?g. }
- W4297644311 abstract "AI creation, such as poem or lyrics generation, has attracted increasing attention from both industry and academic communities, with many promising models proposed in the past few years. Existing methods usually estimate the outputs based on single and independent visual or textual information. However, in reality, humans usually make creations according to their experiences, which may involve different modalities and be sequentially correlated. To model such human capabilities, in this paper, we define and solve a novel AI creation problem based on human experiences. More specifically, we study how to generate texts based on sequential multi-modal information. Compared with the previous works, this task is much more difficult because the designed model has to well understand and adapt the semantics among different modalities and effectively convert them into the output in a sequential manner. To alleviate these difficulties, we firstly design a multi-channel sequence-to-sequence architecture equipped with a multi-modal attention network. For more effective optimization, we then propose a curriculum negative sampling strategy tailored for the sequential inputs. To benchmark this problem and demonstrate the effectiveness of our model, we manually labeled a new multi-modal experience dataset. With this dataset, we conduct extensive experiments by comparing our model with a series of representative baselines, where we can demonstrate significant improvements in our model based on both automatic and human-centered metrics. The code and data are available at: url{https://github.com/Aman-4-Real/MMTG}." @default.
- W4297644311 created "2022-09-30" @default.
- W4297644311 creator A5000839824 @default.
- W4297644311 creator A5002846606 @default.
- W4297644311 creator A5011969885 @default.
- W4297644311 creator A5015800533 @default.
- W4297644311 creator A5042785211 @default.
- W4297644311 creator A5082151648 @default.
- W4297644311 date "2022-10-10" @default.
- W4297644311 modified "2023-10-01" @default.
- W4297644311 title "Multi-Modal Experience Inspired AI Creation" @default.
- W4297644311 cites W170842245 @default.
- W4297644311 cites W2250842199 @default.
- W4297644311 cites W2461084364 @default.
- W4297644311 cites W2804809828 @default.
- W4297644311 cites W2883891001 @default.
- W4297644311 cites W2890721473 @default.
- W4297644311 cites W2905544595 @default.
- W4297644311 cites W2952771545 @default.
- W4297644311 cites W2953486038 @default.
- W4297644311 cites W2963109634 @default.
- W4297644311 cites W2963829244 @default.
- W4297644311 cites W2969348315 @default.
- W4297644311 cites W2982260486 @default.
- W4297644311 cites W2998356391 @default.
- W4297644311 cites W3087871082 @default.
- W4297644311 cites W3090449556 @default.
- W4297644311 cites W3091499453 @default.
- W4297644311 cites W3109320561 @default.
- W4297644311 cites W4285751616 @default.
- W4297644311 cites W4289387529 @default.
- W4297644311 cites W4297889967 @default.
- W4297644311 cites W2896124351 @default.
- W4297644311 cites W3106477714 @default.
- W4297644311 doi "https://doi.org/10.1145/3503161.3548189" @default.
- W4297644311 hasPublicationYear "2022" @default.
- W4297644311 type Work @default.
- W4297644311 citedByCount "0" @default.
- W4297644311 crossrefType "proceedings-article" @default.
- W4297644311 hasAuthorship W4297644311A5000839824 @default.
- W4297644311 hasAuthorship W4297644311A5002846606 @default.
- W4297644311 hasAuthorship W4297644311A5011969885 @default.
- W4297644311 hasAuthorship W4297644311A5015800533 @default.
- W4297644311 hasAuthorship W4297644311A5042785211 @default.
- W4297644311 hasAuthorship W4297644311A5082151648 @default.
- W4297644311 hasBestOaLocation W42976443112 @default.
- W4297644311 hasConcept C119857082 @default.
- W4297644311 hasConcept C13280743 @default.
- W4297644311 hasConcept C144024400 @default.
- W4297644311 hasConcept C154945302 @default.
- W4297644311 hasConcept C162324750 @default.
- W4297644311 hasConcept C177264268 @default.
- W4297644311 hasConcept C185592680 @default.
- W4297644311 hasConcept C185798385 @default.
- W4297644311 hasConcept C187736073 @default.
- W4297644311 hasConcept C188027245 @default.
- W4297644311 hasConcept C199360897 @default.
- W4297644311 hasConcept C204321447 @default.
- W4297644311 hasConcept C205649164 @default.
- W4297644311 hasConcept C2776760102 @default.
- W4297644311 hasConcept C2778112365 @default.
- W4297644311 hasConcept C2779903281 @default.
- W4297644311 hasConcept C2780451532 @default.
- W4297644311 hasConcept C36289849 @default.
- W4297644311 hasConcept C41008148 @default.
- W4297644311 hasConcept C54355233 @default.
- W4297644311 hasConcept C71139939 @default.
- W4297644311 hasConcept C86803240 @default.
- W4297644311 hasConceptScore W4297644311C119857082 @default.
- W4297644311 hasConceptScore W4297644311C13280743 @default.
- W4297644311 hasConceptScore W4297644311C144024400 @default.
- W4297644311 hasConceptScore W4297644311C154945302 @default.
- W4297644311 hasConceptScore W4297644311C162324750 @default.
- W4297644311 hasConceptScore W4297644311C177264268 @default.
- W4297644311 hasConceptScore W4297644311C185592680 @default.
- W4297644311 hasConceptScore W4297644311C185798385 @default.
- W4297644311 hasConceptScore W4297644311C187736073 @default.
- W4297644311 hasConceptScore W4297644311C188027245 @default.
- W4297644311 hasConceptScore W4297644311C199360897 @default.
- W4297644311 hasConceptScore W4297644311C204321447 @default.
- W4297644311 hasConceptScore W4297644311C205649164 @default.
- W4297644311 hasConceptScore W4297644311C2776760102 @default.
- W4297644311 hasConceptScore W4297644311C2778112365 @default.
- W4297644311 hasConceptScore W4297644311C2779903281 @default.
- W4297644311 hasConceptScore W4297644311C2780451532 @default.
- W4297644311 hasConceptScore W4297644311C36289849 @default.
- W4297644311 hasConceptScore W4297644311C41008148 @default.
- W4297644311 hasConceptScore W4297644311C54355233 @default.
- W4297644311 hasConceptScore W4297644311C71139939 @default.
- W4297644311 hasConceptScore W4297644311C86803240 @default.
- W4297644311 hasLocation W42976443111 @default.
- W4297644311 hasLocation W42976443112 @default.
- W4297644311 hasOpenAccess W4297644311 @default.
- W4297644311 hasPrimaryLocation W42976443111 @default.
- W4297644311 hasRelatedWork W2081647779 @default.
- W4297644311 hasRelatedWork W2954843021 @default.
- W4297644311 hasRelatedWork W3091128321 @default.
- W4297644311 hasRelatedWork W3107474891 @default.
- W4297644311 hasRelatedWork W3185852197 @default.
- W4297644311 hasRelatedWork W3198803088 @default.