Matches in SemOpenAlex for { <https://semopenalex.org/work/W3214213327> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W3214213327 abstract "We provide a probabilistic interpretation of attention and show that the standard dot-product attention in transformers is a special case of Maximum A Posteriori (MAP) inference. The proposed approach suggests the use of Expectation Maximization algorithms for online adaptation of key and value model parameters. This approach is useful for cases in which external agents, e.g., annotators, provide inference-time information about the correct values of some tokens, e.g, the semantic category of some pixels, and we need for this new information to propagate to other tokens in a principled manner. We illustrate the approach on an interactive semantic segmentation task in which annotators and models collaborate online to improve annotation efficiency. Using standard benchmarks, we observe that key adaptation boosts model performance ($sim10%$ mIoU) in the low feedback regime and value propagation improves model responsiveness in the high feedback regime. A PyTorch layer implementation of our probabilistic attention model will be made publicly available here: this https URL." @default.
- W3214213327 created "2021-11-22" @default.
- W3214213327 creator A5010136172 @default.
- W3214213327 creator A5055285115 @default.
- W3214213327 creator A5074505854 @default.
- W3214213327 date "2021-12-06" @default.
- W3214213327 modified "2023-09-24" @default.
- W3214213327 title "Probabilistic Attention for Interactive Segmentation" @default.
- W3214213327 hasPublicationYear "2021" @default.
- W3214213327 type Work @default.
- W3214213327 sameAs 3214213327 @default.
- W3214213327 citedByCount "0" @default.
- W3214213327 crossrefType "proceedings-article" @default.
- W3214213327 hasAuthorship W3214213327A5010136172 @default.
- W3214213327 hasAuthorship W3214213327A5055285115 @default.
- W3214213327 hasAuthorship W3214213327A5074505854 @default.
- W3214213327 hasConcept C105795698 @default.
- W3214213327 hasConcept C119857082 @default.
- W3214213327 hasConcept C120665830 @default.
- W3214213327 hasConcept C121332964 @default.
- W3214213327 hasConcept C139807058 @default.
- W3214213327 hasConcept C154945302 @default.
- W3214213327 hasConcept C162324750 @default.
- W3214213327 hasConcept C165801399 @default.
- W3214213327 hasConcept C175444787 @default.
- W3214213327 hasConcept C187736073 @default.
- W3214213327 hasConcept C26517878 @default.
- W3214213327 hasConcept C2776214188 @default.
- W3214213327 hasConcept C2776330181 @default.
- W3214213327 hasConcept C2780451532 @default.
- W3214213327 hasConcept C33923547 @default.
- W3214213327 hasConcept C38652104 @default.
- W3214213327 hasConcept C41008148 @default.
- W3214213327 hasConcept C49781872 @default.
- W3214213327 hasConcept C49937458 @default.
- W3214213327 hasConcept C62520636 @default.
- W3214213327 hasConcept C66322947 @default.
- W3214213327 hasConcept C89600930 @default.
- W3214213327 hasConcept C9810830 @default.
- W3214213327 hasConceptScore W3214213327C105795698 @default.
- W3214213327 hasConceptScore W3214213327C119857082 @default.
- W3214213327 hasConceptScore W3214213327C120665830 @default.
- W3214213327 hasConceptScore W3214213327C121332964 @default.
- W3214213327 hasConceptScore W3214213327C139807058 @default.
- W3214213327 hasConceptScore W3214213327C154945302 @default.
- W3214213327 hasConceptScore W3214213327C162324750 @default.
- W3214213327 hasConceptScore W3214213327C165801399 @default.
- W3214213327 hasConceptScore W3214213327C175444787 @default.
- W3214213327 hasConceptScore W3214213327C187736073 @default.
- W3214213327 hasConceptScore W3214213327C26517878 @default.
- W3214213327 hasConceptScore W3214213327C2776214188 @default.
- W3214213327 hasConceptScore W3214213327C2776330181 @default.
- W3214213327 hasConceptScore W3214213327C2780451532 @default.
- W3214213327 hasConceptScore W3214213327C33923547 @default.
- W3214213327 hasConceptScore W3214213327C38652104 @default.
- W3214213327 hasConceptScore W3214213327C41008148 @default.
- W3214213327 hasConceptScore W3214213327C49781872 @default.
- W3214213327 hasConceptScore W3214213327C49937458 @default.
- W3214213327 hasConceptScore W3214213327C62520636 @default.
- W3214213327 hasConceptScore W3214213327C66322947 @default.
- W3214213327 hasConceptScore W3214213327C89600930 @default.
- W3214213327 hasConceptScore W3214213327C9810830 @default.
- W3214213327 hasLocation W32142133271 @default.
- W3214213327 hasOpenAccess W3214213327 @default.
- W3214213327 hasPrimaryLocation W32142133271 @default.
- W3214213327 hasRelatedWork W2233838193 @default.
- W3214213327 hasRelatedWork W2796418006 @default.
- W3214213327 hasRelatedWork W2901679674 @default.
- W3214213327 hasRelatedWork W2949992281 @default.
- W3214213327 hasRelatedWork W2951464217 @default.
- W3214213327 hasRelatedWork W3006966862 @default.
- W3214213327 hasRelatedWork W3034718094 @default.
- W3214213327 hasRelatedWork W3080217226 @default.
- W3214213327 hasRelatedWork W3092805083 @default.
- W3214213327 hasRelatedWork W3114735516 @default.
- W3214213327 hasRelatedWork W3114880807 @default.
- W3214213327 hasRelatedWork W3135460631 @default.
- W3214213327 hasRelatedWork W3137257446 @default.
- W3214213327 hasRelatedWork W3161515022 @default.
- W3214213327 hasRelatedWork W3174012569 @default.
- W3214213327 hasRelatedWork W3174921981 @default.
- W3214213327 hasRelatedWork W3177307299 @default.
- W3214213327 hasRelatedWork W3183860306 @default.
- W3214213327 hasRelatedWork W3196670469 @default.
- W3214213327 hasRelatedWork W3205986049 @default.
- W3214213327 hasVolume "34" @default.
- W3214213327 isParatext "false" @default.
- W3214213327 isRetracted "false" @default.
- W3214213327 magId "3214213327" @default.
- W3214213327 workType "article" @default.