Matches in SemOpenAlex for { <https://semopenalex.org/work/W3178334627> ?p ?o ?g. }
- W3178334627 abstract "Event cameras are sensors with pixels that respond independently and asynchronously to changes in scene illumination. Event cameras have a number of advantages when compared to conventional cameras: low-latency, high temporal resolution, high dynamic range, low power and sparse data output. However, existing event cameras also suffer from comparatively low spatial resolution and are sensitive to noise. Recently, it has been shown that it is possible to reconstruct an intensity frame stream from an event stream. These reconstructions preserve the high temporal rate of the event stream, but tend to suffer from significant artifacts and low image quality due to the shortcomings of event cameras. In this work we demonstrate that it is possible to combine the best of both worlds, by fusing a color frame stream at low temporal resolution and high spatial resolution with an event stream at high temporal resolution and low spatial resolution to generate a video stream with both high temporal and spatial resolutions while preserving the original color information. We utilize a novel event frame interpolation network (EFI-Net), a multi-phase convolutional neural network which fuses the frame and event streams. EFI-Net is trained using only simulated data and generalizes exceptionally well to real-world experimental data. We show that our method is able to interpolate frames where traditional video interpolation approaches fail, while also outperforming event-only reconstructions. We further contribute a new dataset, containing event camera data synchronized with high speed video. This work opens the door to a new application for event cameras, enabling high fidelity fusion with frame based image streams for generation of high-quality high-speed video. The dataset is available at https://drive.google.com/file/d/1UIGVBqNER_5KguYPAu5y7TVg-JlNhz3-/view?usp=sharing" @default.
- W3178334627 created "2021-07-19" @default.
- W3178334627 creator A5021840451 @default.
- W3178334627 creator A5084021209 @default.
- W3178334627 creator A5085622166 @default.
- W3178334627 creator A5085954960 @default.
- W3178334627 date "2021-06-01" @default.
- W3178334627 modified "2023-09-25" @default.
- W3178334627 title "EFI-Net: Video Frame Interpolation from Fusion of Events and Frames" @default.
- W3178334627 cites W1905052409 @default.
- W3178334627 cites W1973207880 @default.
- W3178334627 cites W1975697167 @default.
- W3178334627 cites W2016574277 @default.
- W3178334627 cites W2033515444 @default.
- W3178334627 cites W2036861225 @default.
- W3178334627 cites W2083862419 @default.
- W3178334627 cites W2103336008 @default.
- W3178334627 cites W2108467139 @default.
- W3178334627 cites W2114961653 @default.
- W3178334627 cites W2132608653 @default.
- W3178334627 cites W2133791842 @default.
- W3178334627 cites W2168224540 @default.
- W3178334627 cites W2461158874 @default.
- W3178334627 cites W2469278928 @default.
- W3178334627 cites W2472115300 @default.
- W3178334627 cites W2515375631 @default.
- W3178334627 cites W2530906228 @default.
- W3178334627 cites W2565755350 @default.
- W3178334627 cites W2586480386 @default.
- W3178334627 cites W2602186967 @default.
- W3178334627 cites W2739136981 @default.
- W3178334627 cites W2745933219 @default.
- W3178334627 cites W2754360834 @default.
- W3178334627 cites W2788172931 @default.
- W3178334627 cites W2789435382 @default.
- W3178334627 cites W2809852002 @default.
- W3178334627 cites W2884195444 @default.
- W3178334627 cites W2904275768 @default.
- W3178334627 cites W2938463073 @default.
- W3178334627 cites W2949258649 @default.
- W3178334627 cites W2949903291 @default.
- W3178334627 cites W2963093735 @default.
- W3178334627 cites W2963268050 @default.
- W3178334627 cites W2963483509 @default.
- W3178334627 cites W2963782415 @default.
- W3178334627 cites W2964132169 @default.
- W3178334627 cites W2964615694 @default.
- W3178334627 cites W2970672284 @default.
- W3178334627 cites W2992384714 @default.
- W3178334627 cites W3005611077 @default.
- W3178334627 cites W3017280322 @default.
- W3178334627 cites W3034469298 @default.
- W3178334627 cites W3034685081 @default.
- W3178334627 cites W3034769793 @default.
- W3178334627 cites W3035212231 @default.
- W3178334627 cites W3035566737 @default.
- W3178334627 cites W3035642679 @default.
- W3178334627 cites W3035669331 @default.
- W3178334627 cites W3099039688 @default.
- W3178334627 cites W3101923070 @default.
- W3178334627 cites W3102015846 @default.
- W3178334627 cites W3122190729 @default.
- W3178334627 cites W4253803843 @default.
- W3178334627 doi "https://doi.org/10.1109/cvprw53098.2021.00142" @default.
- W3178334627 hasPublicationYear "2021" @default.
- W3178334627 type Work @default.
- W3178334627 sameAs 3178334627 @default.
- W3178334627 citedByCount "9" @default.
- W3178334627 countsByYear W31783346272022 @default.
- W3178334627 countsByYear W31783346272023 @default.
- W3178334627 crossrefType "proceedings-article" @default.
- W3178334627 hasAuthorship W3178334627A5021840451 @default.
- W3178334627 hasAuthorship W3178334627A5084021209 @default.
- W3178334627 hasAuthorship W3178334627A5085622166 @default.
- W3178334627 hasAuthorship W3178334627A5085954960 @default.
- W3178334627 hasConcept C115961682 @default.
- W3178334627 hasConcept C119666444 @default.
- W3178334627 hasConcept C121332964 @default.
- W3178334627 hasConcept C126042441 @default.
- W3178334627 hasConcept C137800194 @default.
- W3178334627 hasConcept C154945302 @default.
- W3178334627 hasConcept C160633673 @default.
- W3178334627 hasConcept C167510206 @default.
- W3178334627 hasConcept C202474056 @default.
- W3178334627 hasConcept C205372480 @default.
- W3178334627 hasConcept C2779662365 @default.
- W3178334627 hasConcept C31972630 @default.
- W3178334627 hasConcept C3261483 @default.
- W3178334627 hasConcept C41008148 @default.
- W3178334627 hasConcept C62520636 @default.
- W3178334627 hasConcept C65483669 @default.
- W3178334627 hasConcept C72560505 @default.
- W3178334627 hasConcept C76155785 @default.
- W3178334627 hasConcept C79403827 @default.
- W3178334627 hasConceptScore W3178334627C115961682 @default.
- W3178334627 hasConceptScore W3178334627C119666444 @default.
- W3178334627 hasConceptScore W3178334627C121332964 @default.
- W3178334627 hasConceptScore W3178334627C126042441 @default.
- W3178334627 hasConceptScore W3178334627C137800194 @default.
- W3178334627 hasConceptScore W3178334627C154945302 @default.