Matches in SemOpenAlex for { <https://semopenalex.org/work/W2890415768> ?p ?o ?g. }
- W2890415768 endingPage "3004" @default.
- W2890415768 startingPage "2993" @default.
- W2890415768 abstract "We propose a new approach for 3D reconstruction of dynamic indoor and outdoor scenes in everyday environments, leveraging only cameras worn by a user. This approach allows 3D reconstruction of experiences at any location and virtual tours from anywhere. The key innovation of the proposed ego-centric reconstruction system is to capture the wearer's body pose and facial expression from near-body views, e.g. cameras on the user's glasses, and to capture the surrounding environment using outward-facing views. The main challenge of the ego-centric reconstruction, however, is the poor coverage of the near-body views - that is, the user's body and face are observed from vantage points that are convenient for wear but inconvenient for capture. To overcome these challenges, we propose a parametric-model-based approach to user motion estimation. This approach utilizes convolutional neural networks (CNNs) for near-view body pose estimation, and we introduce a CNN-based approach for facial expression estimation that combines audio and video. For each time-point during capture, the intermediate model-based reconstructions from these systems are used to re-target a high-fidelity pre-scanned model of the user. We demonstrate that the proposed self-sufficient, head-worn capture system is capable of reconstructing the wearer's movements and their surrounding environment in both indoor and outdoor situations without any additional views. As a proof of concept, we show how the resulting 3D-plus-time reconstruction can be immersively experienced within a virtual reality system (e.g., the HTC Vive). We expect that the size of the proposed egocentric capture-and-reconstruction system will eventually be reduced to fit within future AR glasses, and will be widely useful for immersive 3D telepresence, virtual tours, and general use-anywhere 3D content creation." @default.
- W2890415768 created "2018-09-27" @default.
- W2890415768 creator A5011535172 @default.
- W2890415768 creator A5014889758 @default.
- W2890415768 creator A5018151384 @default.
- W2890415768 creator A5018210834 @default.
- W2890415768 creator A5028832520 @default.
- W2890415768 creator A5032875389 @default.
- W2890415768 creator A5041514597 @default.
- W2890415768 creator A5050549724 @default.
- W2890415768 creator A5059798354 @default.
- W2890415768 creator A5063867727 @default.
- W2890415768 creator A5067307489 @default.
- W2890415768 creator A5083407224 @default.
- W2890415768 creator A5086362590 @default.
- W2890415768 creator A5087062965 @default.
- W2890415768 creator A5087243468 @default.
- W2890415768 date "2018-11-01" @default.
- W2890415768 modified "2023-10-17" @default.
- W2890415768 title "Towards Fully Mobile 3D Face, Body, and Environment Capture Using Only Head-worn Cameras" @default.
- W2890415768 cites W1917711508 @default.
- W2890415768 cites W1936186068 @default.
- W2890415768 cites W1938204631 @default.
- W2890415768 cites W1966718790 @default.
- W2890415768 cites W1967554269 @default.
- W2890415768 cites W1971968197 @default.
- W2890415768 cites W1987648924 @default.
- W2890415768 cites W1988693037 @default.
- W2890415768 cites W1990937109 @default.
- W2890415768 cites W1992642990 @default.
- W2890415768 cites W1999293003 @default.
- W2890415768 cites W2004447433 @default.
- W2890415768 cites W2008550072 @default.
- W2890415768 cites W2009422376 @default.
- W2890415768 cites W2017107803 @default.
- W2890415768 cites W2033777009 @default.
- W2890415768 cites W2042843908 @default.
- W2890415768 cites W2062192902 @default.
- W2890415768 cites W2063634999 @default.
- W2890415768 cites W2071523568 @default.
- W2890415768 cites W2086331119 @default.
- W2890415768 cites W2091564812 @default.
- W2890415768 cites W2099011563 @default.
- W2890415768 cites W2099800354 @default.
- W2890415768 cites W2099940712 @default.
- W2890415768 cites W2104974755 @default.
- W2890415768 cites W2105906154 @default.
- W2890415768 cites W2110434318 @default.
- W2890415768 cites W2117888987 @default.
- W2890415768 cites W2122007052 @default.
- W2890415768 cites W2122025115 @default.
- W2890415768 cites W2155893237 @default.
- W2890415768 cites W2157285372 @default.
- W2890415768 cites W2158179171 @default.
- W2890415768 cites W2160014001 @default.
- W2890415768 cites W2163446794 @default.
- W2890415768 cites W2169757860 @default.
- W2890415768 cites W2461005315 @default.
- W2890415768 cites W2471962767 @default.
- W2890415768 cites W2474281075 @default.
- W2890415768 cites W2522541783 @default.
- W2890415768 cites W2525184802 @default.
- W2890415768 cites W2532511219 @default.
- W2890415768 cites W2559085405 @default.
- W2890415768 cites W2605082678 @default.
- W2890415768 cites W2606794968 @default.
- W2890415768 cites W2739192055 @default.
- W2890415768 cites W2963562098 @default.
- W2890415768 cites W2964014798 @default.
- W2890415768 cites W2964304707 @default.
- W2890415768 cites W3103648783 @default.
- W2890415768 cites W3104792420 @default.
- W2890415768 cites W4236667477 @default.
- W2890415768 cites W4242146635 @default.
- W2890415768 cites W4248870381 @default.
- W2890415768 cites W4256017923 @default.
- W2890415768 doi "https://doi.org/10.1109/tvcg.2018.2868527" @default.
- W2890415768 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/30207957" @default.
- W2890415768 hasPublicationYear "2018" @default.
- W2890415768 type Work @default.
- W2890415768 sameAs 2890415768 @default.
- W2890415768 citedByCount "36" @default.
- W2890415768 countsByYear W28904157682019 @default.
- W2890415768 countsByYear W28904157682020 @default.
- W2890415768 countsByYear W28904157682021 @default.
- W2890415768 countsByYear W28904157682022 @default.
- W2890415768 countsByYear W28904157682023 @default.
- W2890415768 crossrefType "journal-article" @default.
- W2890415768 hasAuthorship W2890415768A5011535172 @default.
- W2890415768 hasAuthorship W2890415768A5014889758 @default.
- W2890415768 hasAuthorship W2890415768A5018151384 @default.
- W2890415768 hasAuthorship W2890415768A5018210834 @default.
- W2890415768 hasAuthorship W2890415768A5028832520 @default.
- W2890415768 hasAuthorship W2890415768A5032875389 @default.
- W2890415768 hasAuthorship W2890415768A5041514597 @default.
- W2890415768 hasAuthorship W2890415768A5050549724 @default.
- W2890415768 hasAuthorship W2890415768A5059798354 @default.
- W2890415768 hasAuthorship W2890415768A5063867727 @default.