FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3136147018> ?p ?o ?g. }

• W3136147018 abstract "We address the problem of estimating depth with multi modal audio visual data. Inspired by the ability of animals, such as bats and dolphins, to infer distance of objects with echolocation, some recent methods have utilized echoes for depth estimation. We propose an end-to-end deep learning based pipeline utilizing RGB images, binaural echoes and estimated material properties of various objects within a scene. We argue that the relation between image, echoes and depth, for different scene elements, is greatly influenced by the properties of those elements, and a method designed to leverage this information can lead to significantly improved depth estimation from audio visual inputs. We propose a novel multi modal fusion technique, which incorporates the material properties explicitly while combining audio (echoes) and visual modalities to predict the scene depth. We show empirically, with experiments on Replica dataset, that the proposed method obtains 28% improvement in RMSE compared to the state-of-the-art audio-visual depth prediction method. To demonstrate the effectiveness of our method on larger dataset, we report competitive performance on Matterport3D, proposing to use it as a multimodal depth prediction benchmark with echoes for the first time. We also analyse the proposed method with exhaustive ablation experiments and qualitative results. The code and models are available at this https URL" @default.
• W3136147018 created "2021-03-29" @default.
• W3136147018 creator A5041837701 @default.
• W3136147018 creator A5051876605 @default.
• W3136147018 creator A5086161904 @default.
• W3136147018 date "2021-03-15" @default.
• W3136147018 modified "2023-09-27" @default.
• W3136147018 title "Beyond Image to Depth: Improving Depth Prediction using Echoes" @default.
• W3136147018 cites W15713842 @default.
• W3136147018 cites W1597254465 @default.
• W3136147018 cites W1797096580 @default.
• W3136147018 cites W1901129140 @default.
• W3136147018 cites W1953465585 @default.
• W3136147018 cites W2026062564 @default.
• W3136147018 cites W2129931127 @default.
• W3136147018 cites W2173474324 @default.
• W3136147018 cites W2194775991 @default.
• W3136147018 cites W2518469796 @default.
• W3136147018 cites W2619697695 @default.
• W3136147018 cites W2794739174 @default.
• W3136147018 cites W2890855852 @default.
• W3136147018 cites W2912836860 @default.
• W3136147018 cites W2929928372 @default.
• W3136147018 cites W2939707141 @default.
• W3136147018 cites W2942368658 @default.
• W3136147018 cites W2949830259 @default.
• W3136147018 cites W2950388022 @default.
• W3136147018 cites W2952394248 @default.
• W3136147018 cites W2962960500 @default.
• W3136147018 cites W2963115079 @default.
• W3136147018 cites W2963218389 @default.
• W3136147018 cites W2963867516 @default.
• W3136147018 cites W2963911235 @default.
• W3136147018 cites W2964339842 @default.
• W3136147018 cites W2969202876 @default.
• W3136147018 cites W2981851635 @default.
• W3136147018 cites W2985775862 @default.
• W3136147018 cites W2988200020 @default.
• W3136147018 cites W2996849311 @default.
• W3136147018 cites W2997790735 @default.
• W3136147018 cites W3009928773 @default.
• W3136147018 cites W3017343282 @default.
• W3136147018 cites W3025520547 @default.
• W3136147018 cites W3034287518 @default.
• W3136147018 cites W3034923778 @default.
• W3136147018 cites W3049847664 @default.
• W3136147018 cites W3081167590 @default.
• W3136147018 cites W3089944088 @default.
• W3136147018 cites W3092603041 @default.
• W3136147018 cites W3103830518 @default.
• W3136147018 cites W3106362698 @default.
• W3136147018 cites W3108332675 @default.
• W3136147018 cites W3108655859 @default.
• W3136147018 cites W3108735274 @default.
• W3136147018 cites W3119136678 @default.
• W3136147018 cites W3205147687 @default.
• W3136147018 hasPublicationYear "2021" @default.
• W3136147018 type Work @default.
• W3136147018 sameAs 3136147018 @default.
• W3136147018 citedByCount "1" @default.
• W3136147018 countsByYear W31361470182021 @default.
• W3136147018 crossrefType "posted-content" @default.
• W3136147018 hasAuthorship W3136147018A5041837701 @default.
• W3136147018 hasAuthorship W3136147018A5051876605 @default.
• W3136147018 hasAuthorship W3136147018A5086161904 @default.
• W3136147018 hasConcept C108583219 @default.
• W3136147018 hasConcept C127313418 @default.
• W3136147018 hasConcept C13280743 @default.
• W3136147018 hasConcept C153083717 @default.
• W3136147018 hasConcept C153180895 @default.
• W3136147018 hasConcept C154945302 @default.
• W3136147018 hasConcept C177264268 @default.
• W3136147018 hasConcept C185592680 @default.
• W3136147018 hasConcept C185798385 @default.
• W3136147018 hasConcept C188027245 @default.
• W3136147018 hasConcept C199360897 @default.
• W3136147018 hasConcept C2776760102 @default.
• W3136147018 hasConcept C31972630 @default.
• W3136147018 hasConcept C41008148 @default.
• W3136147018 hasConcept C71139939 @default.
• W3136147018 hasConcept C82990744 @default.
• W3136147018 hasConceptScore W3136147018C108583219 @default.
• W3136147018 hasConceptScore W3136147018C127313418 @default.
• W3136147018 hasConceptScore W3136147018C13280743 @default.
• W3136147018 hasConceptScore W3136147018C153083717 @default.
• W3136147018 hasConceptScore W3136147018C153180895 @default.
• W3136147018 hasConceptScore W3136147018C154945302 @default.
• W3136147018 hasConceptScore W3136147018C177264268 @default.
• W3136147018 hasConceptScore W3136147018C185592680 @default.
• W3136147018 hasConceptScore W3136147018C185798385 @default.
• W3136147018 hasConceptScore W3136147018C188027245 @default.
• W3136147018 hasConceptScore W3136147018C199360897 @default.
• W3136147018 hasConceptScore W3136147018C2776760102 @default.
• W3136147018 hasConceptScore W3136147018C31972630 @default.
• W3136147018 hasConceptScore W3136147018C41008148 @default.
• W3136147018 hasConceptScore W3136147018C71139939 @default.
• W3136147018 hasConceptScore W3136147018C82990744 @default.
• W3136147018 hasLocation W31361470181 @default.
• W3136147018 hasOpenAccess W3136147018 @default.
• W3136147018 hasPrimaryLocation W31361470181 @default.

• next