Matches in SemOpenAlex for { <https://semopenalex.org/work/W3121043774> ?p ?o ?g. }
- W3121043774 abstract "To apply neural sequence models such as the Transformers to music generation tasks, one has to represent a piece of music by a sequence of tokens drawn from a finite set of pre-defined vocabulary. Such a vocabulary usually involves tokens of various types. For example, to describe a musical note, one needs separate tokens to indicate the note's pitch, duration, velocity (dynamics), and placement (onset time) along the time grid. While different types of tokens may possess different properties, existing models usually treat them equally, in the same way as modeling words in natural languages. In this paper, we present a conceptually different approach that explicitly takes into account the type of the tokens, such as note types and metric types. And, we propose a new Transformer decoder architecture that uses different feed-forward heads to model tokens of different types. With an expansion-compression trick, we convert a piece of music to a sequence of compound words by grouping neighboring tokens, greatly reducing the length of the token sequences. We show that the resulting model can be viewed as a learner over dynamic directed hypergraphs. And, we employ it to learn to compose expressive Pop piano music of full-song length (involving up to 10K individual tokens per song), both conditionally and unconditionally. Our experiment shows that, compared to state-of-the-art models, the proposed model converges 5--10 times faster at training (i.e., within a day on a single GPU with 11 GB memory), and with comparable quality in the generated music." @default.
- W3121043774 created "2021-01-18" @default.
- W3121043774 creator A5017146803 @default.
- W3121043774 creator A5047096485 @default.
- W3121043774 creator A5061291906 @default.
- W3121043774 creator A5086833741 @default.
- W3121043774 date "2021-01-07" @default.
- W3121043774 modified "2023-09-27" @default.
- W3121043774 title "Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs" @default.
- W3121043774 cites W2042492924 @default.
- W3121043774 cites W2056263517 @default.
- W3121043774 cites W2078009352 @default.
- W3121043774 cites W2111007352 @default.
- W3121043774 cites W2405656250 @default.
- W3121043774 cites W2892880750 @default.
- W3121043774 cites W2894175714 @default.
- W3121043774 cites W2898827701 @default.
- W3121043774 cites W2919624000 @default.
- W3121043774 cites W2940744433 @default.
- W3121043774 cites W2963403868 @default.
- W3121043774 cites W2963408210 @default.
- W3121043774 cites W2963551352 @default.
- W3121043774 cites W2964110616 @default.
- W3121043774 cites W2966720510 @default.
- W3121043774 cites W2973049837 @default.
- W3121043774 cites W2989636112 @default.
- W3121043774 cites W2991108091 @default.
- W3121043774 cites W2996287690 @default.
- W3121043774 cites W3015625764 @default.
- W3121043774 cites W3026076535 @default.
- W3121043774 cites W3034573343 @default.
- W3121043774 cites W3034758887 @default.
- W3121043774 cites W3036685317 @default.
- W3121043774 cites W3037983807 @default.
- W3121043774 cites W3049272330 @default.
- W3121043774 cites W3082274269 @default.
- W3121043774 cites W3092879656 @default.
- W3121043774 cites W3173531154 @default.
- W3121043774 cites W3185497054 @default.
- W3121043774 cites W3187060660 @default.
- W3121043774 doi "https://doi.org/10.48550/arxiv.2101.02402" @default.
- W3121043774 hasPublicationYear "2021" @default.
- W3121043774 type Work @default.
- W3121043774 sameAs 3121043774 @default.
- W3121043774 citedByCount "4" @default.
- W3121043774 countsByYear W31210437742021 @default.
- W3121043774 crossrefType "posted-content" @default.
- W3121043774 hasAuthorship W3121043774A5017146803 @default.
- W3121043774 hasAuthorship W3121043774A5047096485 @default.
- W3121043774 hasAuthorship W3121043774A5061291906 @default.
- W3121043774 hasAuthorship W3121043774A5086833741 @default.
- W3121043774 hasBestOaLocation W31210437741 @default.
- W3121043774 hasConcept C121332964 @default.
- W3121043774 hasConcept C138885662 @default.
- W3121043774 hasConcept C154945302 @default.
- W3121043774 hasConcept C165801399 @default.
- W3121043774 hasConcept C2524010 @default.
- W3121043774 hasConcept C2777601683 @default.
- W3121043774 hasConcept C2778112365 @default.
- W3121043774 hasConcept C28490314 @default.
- W3121043774 hasConcept C33923547 @default.
- W3121043774 hasConcept C38652104 @default.
- W3121043774 hasConcept C41008148 @default.
- W3121043774 hasConcept C41895202 @default.
- W3121043774 hasConcept C48145219 @default.
- W3121043774 hasConcept C54355233 @default.
- W3121043774 hasConcept C62520636 @default.
- W3121043774 hasConcept C66322947 @default.
- W3121043774 hasConcept C86803240 @default.
- W3121043774 hasConcept C90805587 @default.
- W3121043774 hasConceptScore W3121043774C121332964 @default.
- W3121043774 hasConceptScore W3121043774C138885662 @default.
- W3121043774 hasConceptScore W3121043774C154945302 @default.
- W3121043774 hasConceptScore W3121043774C165801399 @default.
- W3121043774 hasConceptScore W3121043774C2524010 @default.
- W3121043774 hasConceptScore W3121043774C2777601683 @default.
- W3121043774 hasConceptScore W3121043774C2778112365 @default.
- W3121043774 hasConceptScore W3121043774C28490314 @default.
- W3121043774 hasConceptScore W3121043774C33923547 @default.
- W3121043774 hasConceptScore W3121043774C38652104 @default.
- W3121043774 hasConceptScore W3121043774C41008148 @default.
- W3121043774 hasConceptScore W3121043774C41895202 @default.
- W3121043774 hasConceptScore W3121043774C48145219 @default.
- W3121043774 hasConceptScore W3121043774C54355233 @default.
- W3121043774 hasConceptScore W3121043774C62520636 @default.
- W3121043774 hasConceptScore W3121043774C66322947 @default.
- W3121043774 hasConceptScore W3121043774C86803240 @default.
- W3121043774 hasConceptScore W3121043774C90805587 @default.
- W3121043774 hasLocation W31210437741 @default.
- W3121043774 hasOpenAccess W3121043774 @default.
- W3121043774 hasPrimaryLocation W31210437741 @default.
- W3121043774 hasRelatedWork W1570102481 @default.
- W3121043774 hasRelatedWork W1583489134 @default.
- W3121043774 hasRelatedWork W1963734729 @default.
- W3121043774 hasRelatedWork W2050755277 @default.
- W3121043774 hasRelatedWork W2101346879 @default.
- W3121043774 hasRelatedWork W2101627487 @default.
- W3121043774 hasRelatedWork W2117523216 @default.
- W3121043774 hasRelatedWork W2126560900 @default.
- W3121043774 hasRelatedWork W2155528703 @default.