Matches in SemOpenAlex for { <https://semopenalex.org/work/W4306294800> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4306294800 abstract "In this paper, we investigate whether artificial agents can develop a shared language in an ecological setting where communication relies on a sensory-motor channel. To this end, we introduce the Graphical Referential Game (GREG) where a speaker must produce a graphical utterance to name a visual referent object while a listener has to select the corresponding object among distractor referents, given the delivered message. The utterances are drawing images produced using dynamical motor primitives combined with a sketching library. To tackle GREG we present CURVES: a multimodal contrastive deep learning mechanism that represents the energy (alignment) between named referents and utterances generated through gradient ascent on the learned energy landscape. We demonstrate that CURVES not only succeeds at solving the GREG but also enables agents to self-organize a language that generalizes to feature compositions never seen during training. In addition to evaluating the communication performance of our approach, we also explore the structure of the emerging language. Specifically, we show that the resulting language forms a coherent lexicon shared between agents and that basic compositional rules on the graphical productions could not explain the compositional generalization." @default.
- W4306294800 created "2022-10-15" @default.
- W4306294800 creator A5018010486 @default.
- W4306294800 creator A5019224674 @default.
- W4306294800 creator A5033121487 @default.
- W4306294800 creator A5085903884 @default.
- W4306294800 creator A5089214987 @default.
- W4306294800 date "2022-10-03" @default.
- W4306294800 modified "2023-10-14" @default.
- W4306294800 title "Contrastive Multimodal Learning for Emergence of Graphical Sensory-Motor Communication" @default.
- W4306294800 doi "https://doi.org/10.48550/arxiv.2210.06468" @default.
- W4306294800 hasPublicationYear "2022" @default.
- W4306294800 type Work @default.
- W4306294800 citedByCount "0" @default.
- W4306294800 crossrefType "posted-content" @default.
- W4306294800 hasAuthorship W4306294800A5018010486 @default.
- W4306294800 hasAuthorship W4306294800A5019224674 @default.
- W4306294800 hasAuthorship W4306294800A5033121487 @default.
- W4306294800 hasAuthorship W4306294800A5085903884 @default.
- W4306294800 hasAuthorship W4306294800A5089214987 @default.
- W4306294800 hasBestOaLocation W43062948001 @default.
- W4306294800 hasConcept C107457646 @default.
- W4306294800 hasConcept C134306372 @default.
- W4306294800 hasConcept C138885662 @default.
- W4306294800 hasConcept C154945302 @default.
- W4306294800 hasConcept C155846161 @default.
- W4306294800 hasConcept C177148314 @default.
- W4306294800 hasConcept C204321447 @default.
- W4306294800 hasConcept C2775852435 @default.
- W4306294800 hasConcept C2776401178 @default.
- W4306294800 hasConcept C2777096784 @default.
- W4306294800 hasConcept C2778121359 @default.
- W4306294800 hasConcept C2781238097 @default.
- W4306294800 hasConcept C33923547 @default.
- W4306294800 hasConcept C41008148 @default.
- W4306294800 hasConcept C41895202 @default.
- W4306294800 hasConceptScore W4306294800C107457646 @default.
- W4306294800 hasConceptScore W4306294800C134306372 @default.
- W4306294800 hasConceptScore W4306294800C138885662 @default.
- W4306294800 hasConceptScore W4306294800C154945302 @default.
- W4306294800 hasConceptScore W4306294800C155846161 @default.
- W4306294800 hasConceptScore W4306294800C177148314 @default.
- W4306294800 hasConceptScore W4306294800C204321447 @default.
- W4306294800 hasConceptScore W4306294800C2775852435 @default.
- W4306294800 hasConceptScore W4306294800C2776401178 @default.
- W4306294800 hasConceptScore W4306294800C2777096784 @default.
- W4306294800 hasConceptScore W4306294800C2778121359 @default.
- W4306294800 hasConceptScore W4306294800C2781238097 @default.
- W4306294800 hasConceptScore W4306294800C33923547 @default.
- W4306294800 hasConceptScore W4306294800C41008148 @default.
- W4306294800 hasConceptScore W4306294800C41895202 @default.
- W4306294800 hasLocation W43062948001 @default.
- W4306294800 hasOpenAccess W4306294800 @default.
- W4306294800 hasPrimaryLocation W43062948001 @default.
- W4306294800 hasRelatedWork W1523377463 @default.
- W4306294800 hasRelatedWork W1529136209 @default.
- W4306294800 hasRelatedWork W1554149234 @default.
- W4306294800 hasRelatedWork W1595294003 @default.
- W4306294800 hasRelatedWork W2006904376 @default.
- W4306294800 hasRelatedWork W2315940440 @default.
- W4306294800 hasRelatedWork W2921012827 @default.
- W4306294800 hasRelatedWork W3027466640 @default.
- W4306294800 hasRelatedWork W3107474891 @default.
- W4306294800 hasRelatedWork W3192010045 @default.
- W4306294800 isParatext "false" @default.
- W4306294800 isRetracted "false" @default.
- W4306294800 workType "article" @default.