Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387156616> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4387156616 abstract "Recently, the RGB images and point clouds fusion methods have been proposed to jointly estimate 2D optical flow and 3D scene flow. However, as both conventional RGB cameras and LiDAR sensors adopt a frame-based data acquisition mechanism, their performance is limited by the fixed low sampling rates, especially in highly-dynamic scenes. By contrast, the event camera can asynchronously capture the intensity changes with a very high temporal resolution, providing complementary dynamic information of the observed scenes. In this paper, we incorporate RGB images, Point clouds and Events for joint optical flow and scene flow estimation with our proposed multi-stage multimodal fusion model, RPEFlow. First, we present an attention fusion module with a cross-attention mechanism to implicitly explore the internal cross-modal correlation for 2D and 3D branches, respectively. Second, we introduce a mutual information regularization term to explicitly model the complementary information of three modalities for effective multimodal feature learning. We also contribute a new synthetic dataset to advocate further research. Experiments on both synthetic and real datasets show that our model outperforms the existing state-of-the-art by a wide margin. Code and dataset is available at https://npucvr.github.io/RPEFlow." @default.
- W4387156616 created "2023-09-30" @default.
- W4387156616 creator A5010779145 @default.
- W4387156616 creator A5036202579 @default.
- W4387156616 creator A5050347496 @default.
- W4387156616 creator A5089981289 @default.
- W4387156616 date "2023-09-26" @default.
- W4387156616 modified "2023-09-30" @default.
- W4387156616 title "RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation" @default.
- W4387156616 doi "https://doi.org/10.48550/arxiv.2309.15082" @default.
- W4387156616 hasPublicationYear "2023" @default.
- W4387156616 type Work @default.
- W4387156616 citedByCount "0" @default.
- W4387156616 crossrefType "posted-content" @default.
- W4387156616 hasAuthorship W4387156616A5010779145 @default.
- W4387156616 hasAuthorship W4387156616A5036202579 @default.
- W4387156616 hasAuthorship W4387156616A5050347496 @default.
- W4387156616 hasAuthorship W4387156616A5089981289 @default.
- W4387156616 hasBestOaLocation W43871566161 @default.
- W4387156616 hasConcept C115961682 @default.
- W4387156616 hasConcept C119857082 @default.
- W4387156616 hasConcept C121332964 @default.
- W4387156616 hasConcept C131979681 @default.
- W4387156616 hasConcept C153180895 @default.
- W4387156616 hasConcept C154945302 @default.
- W4387156616 hasConcept C155542232 @default.
- W4387156616 hasConcept C2776135515 @default.
- W4387156616 hasConcept C2779662365 @default.
- W4387156616 hasConcept C31972630 @default.
- W4387156616 hasConcept C41008148 @default.
- W4387156616 hasConcept C62520636 @default.
- W4387156616 hasConcept C774472 @default.
- W4387156616 hasConcept C82990744 @default.
- W4387156616 hasConceptScore W4387156616C115961682 @default.
- W4387156616 hasConceptScore W4387156616C119857082 @default.
- W4387156616 hasConceptScore W4387156616C121332964 @default.
- W4387156616 hasConceptScore W4387156616C131979681 @default.
- W4387156616 hasConceptScore W4387156616C153180895 @default.
- W4387156616 hasConceptScore W4387156616C154945302 @default.
- W4387156616 hasConceptScore W4387156616C155542232 @default.
- W4387156616 hasConceptScore W4387156616C2776135515 @default.
- W4387156616 hasConceptScore W4387156616C2779662365 @default.
- W4387156616 hasConceptScore W4387156616C31972630 @default.
- W4387156616 hasConceptScore W4387156616C41008148 @default.
- W4387156616 hasConceptScore W4387156616C62520636 @default.
- W4387156616 hasConceptScore W4387156616C774472 @default.
- W4387156616 hasConceptScore W4387156616C82990744 @default.
- W4387156616 hasLocation W43871566161 @default.
- W4387156616 hasOpenAccess W4387156616 @default.
- W4387156616 hasPrimaryLocation W43871566161 @default.
- W4387156616 hasRelatedWork W2171116555 @default.
- W4387156616 hasRelatedWork W2283162247 @default.
- W4387156616 hasRelatedWork W2314488738 @default.
- W4387156616 hasRelatedWork W2524507886 @default.
- W4387156616 hasRelatedWork W2755343736 @default.
- W4387156616 hasRelatedWork W3088596192 @default.
- W4387156616 hasRelatedWork W3172812035 @default.
- W4387156616 hasRelatedWork W4212983513 @default.
- W4387156616 hasRelatedWork W4281553171 @default.
- W4387156616 hasRelatedWork W4293067784 @default.
- W4387156616 isParatext "false" @default.
- W4387156616 isRetracted "false" @default.
- W4387156616 workType "article" @default.