Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385571036> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4385571036 abstract "We propose a simple yet effective and robust method for contrastive captioning: generating discriminative captions that distinguish target images from very similar alternative distractor images. Our approach is built on a pragmatic inference procedure that formulates captioning as a reference game between a speaker, which produces possible captions describing the target, and a listener, which selects the target given the caption. Unlike previous methods that derive both speaker and listener distributions from a single captioning model, we leverage an off-the-shelf CLIP model to parameterize the listener. Compared with captioner-only pragmatic models, our method benefits from rich vision-language alignment representations from CLIP when reasoning over distractors. Like previous methods for discriminative captioning, our method uses a hyperparameter to control the tradeoff between the informativity (how likely captions are to allow a human listener to discriminate the target image) and the fluency of the captions. However, we find that our method is substantially more robust to the value of this hyperparameter than past methods, which allows us to automatically optimize the captions for informativity — outperforming past methods for discriminative captioning by 11% to 15% accuracy in human evaluations." @default.
- W4385571036 created "2023-08-05" @default.
- W4385571036 creator A5003637850 @default.
- W4385571036 creator A5044588154 @default.
- W4385571036 creator A5073456064 @default.
- W4385571036 date "2023-01-01" @default.
- W4385571036 modified "2023-09-24" @default.
- W4385571036 title "Pragmatic Inference with a CLIP Listener for Contrastive Captioning" @default.
- W4385571036 doi "https://doi.org/10.18653/v1/2023.findings-acl.120" @default.
- W4385571036 hasPublicationYear "2023" @default.
- W4385571036 type Work @default.
- W4385571036 citedByCount "0" @default.
- W4385571036 crossrefType "proceedings-article" @default.
- W4385571036 hasAuthorship W4385571036A5003637850 @default.
- W4385571036 hasAuthorship W4385571036A5044588154 @default.
- W4385571036 hasAuthorship W4385571036A5073456064 @default.
- W4385571036 hasBestOaLocation W43855710361 @default.
- W4385571036 hasConcept C115961682 @default.
- W4385571036 hasConcept C138885662 @default.
- W4385571036 hasConcept C153083717 @default.
- W4385571036 hasConcept C154945302 @default.
- W4385571036 hasConcept C157657479 @default.
- W4385571036 hasConcept C204321447 @default.
- W4385571036 hasConcept C2776214188 @default.
- W4385571036 hasConcept C2777413886 @default.
- W4385571036 hasConcept C28490314 @default.
- W4385571036 hasConcept C41008148 @default.
- W4385571036 hasConcept C41895202 @default.
- W4385571036 hasConcept C542774811 @default.
- W4385571036 hasConcept C8642999 @default.
- W4385571036 hasConcept C97931131 @default.
- W4385571036 hasConceptScore W4385571036C115961682 @default.
- W4385571036 hasConceptScore W4385571036C138885662 @default.
- W4385571036 hasConceptScore W4385571036C153083717 @default.
- W4385571036 hasConceptScore W4385571036C154945302 @default.
- W4385571036 hasConceptScore W4385571036C157657479 @default.
- W4385571036 hasConceptScore W4385571036C204321447 @default.
- W4385571036 hasConceptScore W4385571036C2776214188 @default.
- W4385571036 hasConceptScore W4385571036C2777413886 @default.
- W4385571036 hasConceptScore W4385571036C28490314 @default.
- W4385571036 hasConceptScore W4385571036C41008148 @default.
- W4385571036 hasConceptScore W4385571036C41895202 @default.
- W4385571036 hasConceptScore W4385571036C542774811 @default.
- W4385571036 hasConceptScore W4385571036C8642999 @default.
- W4385571036 hasConceptScore W4385571036C97931131 @default.
- W4385571036 hasLocation W43855710361 @default.
- W4385571036 hasOpenAccess W4385571036 @default.
- W4385571036 hasPrimaryLocation W43855710361 @default.
- W4385571036 hasRelatedWork W2547835662 @default.
- W4385571036 hasRelatedWork W2749708282 @default.
- W4385571036 hasRelatedWork W2765845685 @default.
- W4385571036 hasRelatedWork W2953084091 @default.
- W4385571036 hasRelatedWork W3044039333 @default.
- W4385571036 hasRelatedWork W3045147787 @default.
- W4385571036 hasRelatedWork W3183824823 @default.
- W4385571036 hasRelatedWork W4299318496 @default.
- W4385571036 hasRelatedWork W4320016117 @default.
- W4385571036 hasRelatedWork W4380993945 @default.
- W4385571036 isParatext "false" @default.
- W4385571036 isRetracted "false" @default.
- W4385571036 workType "article" @default.