Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385328207> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4385328207 abstract "Neuromorphic visual sensors are artificial retinas that output sequences of asynchronous events when brightness changes occur in the scene. These sensors offer many advantages including very high temporal resolution, no motion blur and smart data compression ideal for real-time processing. In this study, we introduce an event-based dataset on fine-grained manipulation actions and perform an experimental study on the use of transformers for action prediction with events. There is enormous interest in the fields of cognitive robotics and human-robot interaction on understanding and predicting human actions as early as possible. Early prediction allows anticipating complex stages for planning, enabling effective and real-time interaction. Our Transformer network uses events to predict manipulation actions as they occur, using online inference. The model succeeds at predicting actions early on, building up confidence over time and achieving state-of-the-art classification. Moreover, the attention-based transformer architecture allows us to study the role of the spatio-temporal patterns selected by the model. Our experiments show that the Transformer network captures action dynamic features outperforming video-based approaches and succeeding with scenarios where the differences between actions lie in very subtle cues. Finally, we release the new event dataset, which is the first in the literature for manipulation action recognition. Code will be available at https://github.com/DaniDeniz/EventVisionTransformer." @default.
- W4385328207 created "2023-07-28" @default.
- W4385328207 creator A5001763650 @default.
- W4385328207 creator A5026839405 @default.
- W4385328207 creator A5038861361 @default.
- W4385328207 creator A5083553427 @default.
- W4385328207 creator A5088847033 @default.
- W4385328207 date "2023-07-26" @default.
- W4385328207 modified "2023-10-16" @default.
- W4385328207 title "Event-based Vision for Early Prediction of Manipulation Actions" @default.
- W4385328207 doi "https://doi.org/10.48550/arxiv.2307.14332" @default.
- W4385328207 hasPublicationYear "2023" @default.
- W4385328207 type Work @default.
- W4385328207 citedByCount "0" @default.
- W4385328207 crossrefType "posted-content" @default.
- W4385328207 hasAuthorship W4385328207A5001763650 @default.
- W4385328207 hasAuthorship W4385328207A5026839405 @default.
- W4385328207 hasAuthorship W4385328207A5038861361 @default.
- W4385328207 hasAuthorship W4385328207A5083553427 @default.
- W4385328207 hasAuthorship W4385328207A5088847033 @default.
- W4385328207 hasBestOaLocation W43853282071 @default.
- W4385328207 hasConcept C119857082 @default.
- W4385328207 hasConcept C121332964 @default.
- W4385328207 hasConcept C151319957 @default.
- W4385328207 hasConcept C151927369 @default.
- W4385328207 hasConcept C154945302 @default.
- W4385328207 hasConcept C165801399 @default.
- W4385328207 hasConcept C2776214188 @default.
- W4385328207 hasConcept C31258907 @default.
- W4385328207 hasConcept C41008148 @default.
- W4385328207 hasConcept C50644808 @default.
- W4385328207 hasConcept C62520636 @default.
- W4385328207 hasConcept C66322947 @default.
- W4385328207 hasConceptScore W4385328207C119857082 @default.
- W4385328207 hasConceptScore W4385328207C121332964 @default.
- W4385328207 hasConceptScore W4385328207C151319957 @default.
- W4385328207 hasConceptScore W4385328207C151927369 @default.
- W4385328207 hasConceptScore W4385328207C154945302 @default.
- W4385328207 hasConceptScore W4385328207C165801399 @default.
- W4385328207 hasConceptScore W4385328207C2776214188 @default.
- W4385328207 hasConceptScore W4385328207C31258907 @default.
- W4385328207 hasConceptScore W4385328207C41008148 @default.
- W4385328207 hasConceptScore W4385328207C50644808 @default.
- W4385328207 hasConceptScore W4385328207C62520636 @default.
- W4385328207 hasConceptScore W4385328207C66322947 @default.
- W4385328207 hasLocation W43853282071 @default.
- W4385328207 hasOpenAccess W4385328207 @default.
- W4385328207 hasPrimaryLocation W43853282071 @default.
- W4385328207 hasRelatedWork W2005906350 @default.
- W4385328207 hasRelatedWork W2029553609 @default.
- W4385328207 hasRelatedWork W2367372208 @default.
- W4385328207 hasRelatedWork W2961085424 @default.
- W4385328207 hasRelatedWork W2988062464 @default.
- W4385328207 hasRelatedWork W4229054264 @default.
- W4385328207 hasRelatedWork W4306674287 @default.
- W4385328207 hasRelatedWork W4322716755 @default.
- W4385328207 hasRelatedWork W4327773954 @default.
- W4385328207 hasRelatedWork W2185703995 @default.
- W4385328207 isParatext "false" @default.
- W4385328207 isRetracted "false" @default.
- W4385328207 workType "article" @default.