Matches in SemOpenAlex for { <https://semopenalex.org/work/W4300980466> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4300980466 abstract "Extracting informative representations from videos is fundamental for effectively learning various downstream tasks. We present a novel approach for unsupervised learning of meaningful representations from videos, leveraging the concept of image spatial entropy (ISE) that quantifies the per-pixel information in an image. We argue that textit{local entropy} of pixel neighborhoods and their temporal evolution create valuable intrinsic supervisory signals for learning prominent features. Building on this idea, we abstract visual features into a concise representation of keypoints that act as dynamic information transmitters, and design a deep learning model that learns, purely unsupervised, spatially and temporally consistent representations textit{directly} from video frames. Two original information-theoretic losses, computed from local entropy, guide our model to discover consistent keypoint representations; a loss that maximizes the spatial information covered by the keypoints and a loss that optimizes the keypoints' information transportation over time. We compare our keypoint representation to strong baselines for various downstream tasks, eg, learning object dynamics. Our empirical results show superior performance for our information-driven keypoints that resolve challenges like attendance to static and dynamic objects or objects abruptly entering and leaving the scene." @default.
- W4300980466 created "2022-10-04" @default.
- W4300980466 creator A5020367705 @default.
- W4300980466 creator A5026055366 @default.
- W4300980466 creator A5079476861 @default.
- W4300980466 date "2022-09-30" @default.
- W4300980466 modified "2023-09-23" @default.
- W4300980466 title "Entropy-driven Unsupervised Keypoint Representation Learning in Videos" @default.
- W4300980466 doi "https://doi.org/10.48550/arxiv.2209.15404" @default.
- W4300980466 hasPublicationYear "2022" @default.
- W4300980466 type Work @default.
- W4300980466 citedByCount "0" @default.
- W4300980466 crossrefType "posted-content" @default.
- W4300980466 hasAuthorship W4300980466A5020367705 @default.
- W4300980466 hasAuthorship W4300980466A5026055366 @default.
- W4300980466 hasAuthorship W4300980466A5079476861 @default.
- W4300980466 hasBestOaLocation W43009804661 @default.
- W4300980466 hasConcept C106301342 @default.
- W4300980466 hasConcept C119857082 @default.
- W4300980466 hasConcept C121332964 @default.
- W4300980466 hasConcept C153180895 @default.
- W4300980466 hasConcept C154945302 @default.
- W4300980466 hasConcept C17744445 @default.
- W4300980466 hasConcept C199539241 @default.
- W4300980466 hasConcept C2776359362 @default.
- W4300980466 hasConcept C31972630 @default.
- W4300980466 hasConcept C41008148 @default.
- W4300980466 hasConcept C59404180 @default.
- W4300980466 hasConcept C62520636 @default.
- W4300980466 hasConcept C8038995 @default.
- W4300980466 hasConcept C94625758 @default.
- W4300980466 hasConceptScore W4300980466C106301342 @default.
- W4300980466 hasConceptScore W4300980466C119857082 @default.
- W4300980466 hasConceptScore W4300980466C121332964 @default.
- W4300980466 hasConceptScore W4300980466C153180895 @default.
- W4300980466 hasConceptScore W4300980466C154945302 @default.
- W4300980466 hasConceptScore W4300980466C17744445 @default.
- W4300980466 hasConceptScore W4300980466C199539241 @default.
- W4300980466 hasConceptScore W4300980466C2776359362 @default.
- W4300980466 hasConceptScore W4300980466C31972630 @default.
- W4300980466 hasConceptScore W4300980466C41008148 @default.
- W4300980466 hasConceptScore W4300980466C59404180 @default.
- W4300980466 hasConceptScore W4300980466C62520636 @default.
- W4300980466 hasConceptScore W4300980466C8038995 @default.
- W4300980466 hasConceptScore W4300980466C94625758 @default.
- W4300980466 hasLocation W43009804661 @default.
- W4300980466 hasOpenAccess W4300980466 @default.
- W4300980466 hasPrimaryLocation W43009804661 @default.
- W4300980466 hasRelatedWork W2292254049 @default.
- W4300980466 hasRelatedWork W2592385986 @default.
- W4300980466 hasRelatedWork W2608244370 @default.
- W4300980466 hasRelatedWork W2695951553 @default.
- W4300980466 hasRelatedWork W2775464024 @default.
- W4300980466 hasRelatedWork W2899683012 @default.
- W4300980466 hasRelatedWork W2902482704 @default.
- W4300980466 hasRelatedWork W2908875379 @default.
- W4300980466 hasRelatedWork W3158586592 @default.
- W4300980466 hasRelatedWork W4221136938 @default.
- W4300980466 isParatext "false" @default.
- W4300980466 isRetracted "false" @default.
- W4300980466 workType "article" @default.