Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385718058> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4385718058 abstract "Automatic image comprehension is an important yet challenging task that includes identifying actions in an image and corresponding action participants. Most current approaches to this task, now termed Grounded Situation Recognition (GSR), start by predicting a verb that describes the action and then predict the nouns that can participate in the action as arguments to the verb. This problem formulation limits each image to a single action even though several actions could be depicted. In contrast, text-based Semantic Role Labeling (SRL) aims to label all actions in a sentence, typically resulting in at least two or three predicate argument structures per sentence. We hypothesize that expanding GSR to follow the more liberal SRL text-based approach to action and participant identification could improve image comprehension results. To test this hypothesis and to preserve generalization capabilities, we use general-purpose vision and language components as a front-end. This paper presents our results, a substantial 28.6 point jump in performance on the SWiG dataset, which confirm our hypothesis. We also discuss the benefits of loosely coupled broad-coverage off-the-shelf components which generalized well to out of domain images, and can decrease the need for manual image semantic role annotation." @default.
- W4385718058 created "2023-08-11" @default.
- W4385718058 creator A5009328815 @default.
- W4385718058 creator A5017464054 @default.
- W4385718058 creator A5077772271 @default.
- W4385718058 date "2023-01-01" @default.
- W4385718058 modified "2023-09-27" @default.
- W4385718058 title "CRAPES:Cross-modal Annotation Projection for Visual Semantic Role Labeling" @default.
- W4385718058 doi "https://doi.org/10.18653/v1/2023.starsem-1.7" @default.
- W4385718058 hasPublicationYear "2023" @default.
- W4385718058 type Work @default.
- W4385718058 citedByCount "0" @default.
- W4385718058 crossrefType "proceedings-article" @default.
- W4385718058 hasAuthorship W4385718058A5009328815 @default.
- W4385718058 hasAuthorship W4385718058A5017464054 @default.
- W4385718058 hasAuthorship W4385718058A5077772271 @default.
- W4385718058 hasBestOaLocation W43857180581 @default.
- W4385718058 hasConcept C121332964 @default.
- W4385718058 hasConcept C121934690 @default.
- W4385718058 hasConcept C154945302 @default.
- W4385718058 hasConcept C162324750 @default.
- W4385718058 hasConcept C187736073 @default.
- W4385718058 hasConcept C199360897 @default.
- W4385718058 hasConcept C204321447 @default.
- W4385718058 hasConcept C2776321320 @default.
- W4385718058 hasConcept C2776397901 @default.
- W4385718058 hasConcept C2777530160 @default.
- W4385718058 hasConcept C2780451532 @default.
- W4385718058 hasConcept C2780791683 @default.
- W4385718058 hasConcept C41008148 @default.
- W4385718058 hasConcept C511192102 @default.
- W4385718058 hasConcept C62520636 @default.
- W4385718058 hasConcept C67277372 @default.
- W4385718058 hasConceptScore W4385718058C121332964 @default.
- W4385718058 hasConceptScore W4385718058C121934690 @default.
- W4385718058 hasConceptScore W4385718058C154945302 @default.
- W4385718058 hasConceptScore W4385718058C162324750 @default.
- W4385718058 hasConceptScore W4385718058C187736073 @default.
- W4385718058 hasConceptScore W4385718058C199360897 @default.
- W4385718058 hasConceptScore W4385718058C204321447 @default.
- W4385718058 hasConceptScore W4385718058C2776321320 @default.
- W4385718058 hasConceptScore W4385718058C2776397901 @default.
- W4385718058 hasConceptScore W4385718058C2777530160 @default.
- W4385718058 hasConceptScore W4385718058C2780451532 @default.
- W4385718058 hasConceptScore W4385718058C2780791683 @default.
- W4385718058 hasConceptScore W4385718058C41008148 @default.
- W4385718058 hasConceptScore W4385718058C511192102 @default.
- W4385718058 hasConceptScore W4385718058C62520636 @default.
- W4385718058 hasConceptScore W4385718058C67277372 @default.
- W4385718058 hasLocation W43857180581 @default.
- W4385718058 hasOpenAccess W4385718058 @default.
- W4385718058 hasPrimaryLocation W43857180581 @default.
- W4385718058 hasRelatedWork W1983033081 @default.
- W4385718058 hasRelatedWork W2016212773 @default.
- W4385718058 hasRelatedWork W2107730911 @default.
- W4385718058 hasRelatedWork W2251603441 @default.
- W4385718058 hasRelatedWork W2365751640 @default.
- W4385718058 hasRelatedWork W2381280132 @default.
- W4385718058 hasRelatedWork W2527956357 @default.
- W4385718058 hasRelatedWork W2793539281 @default.
- W4385718058 hasRelatedWork W4252011628 @default.
- W4385718058 hasRelatedWork W658489636 @default.
- W4385718058 isParatext "false" @default.
- W4385718058 isRetracted "false" @default.
- W4385718058 workType "article" @default.