Matches in SemOpenAlex for { <https://semopenalex.org/work/W2996564689> ?p ?o ?g. }
- W2996564689 endingPage "180280" @default.
- W2996564689 startingPage "180270" @default.
- W2996564689 abstract "Different from other human behaviors, sign language has the characteristics of limited local motion of upper limb and meticulous hand action. Some sign language gestures are ambiguous in RGB video due to the influence of lighting and background color, which affects the recognition accuracy. We propose a multimodal deep learning architecture for sign language recognition which effectively combines RGB-D input and two-stream spatiotemporal networks. Depth videos, as an effective compensation of RGB input, can supply additional distance information about the signer's hands. A novel sampling method called ARSS (Aligned Random Sampling in Segments) is put forward to select and align optimal RGB-D video frames, which improves the capacity utilization of multimodal data and reduces the redundancy. We get the hand ROI by joints information of RGB data for local focus in spatial stream. D-shift Net is proposed as depth motion feature extraction in temporal stream, which fully utilizes three dimensional motion information of the sign language. Both streams are fused by convolutional fusion layer to get complementary features. Our approach explored the multimodal information and enhanced the recognition precision. It obtains the state-the-of-art performance on the datasets of CSL (96.7%) and IsoGD (63.78%)." @default.
- W2996564689 created "2019-12-26" @default.
- W2996564689 creator A5007928549 @default.
- W2996564689 creator A5013902548 @default.
- W2996564689 creator A5073942316 @default.
- W2996564689 creator A5081147212 @default.
- W2996564689 date "2019-01-01" @default.
- W2996564689 modified "2023-10-15" @default.
- W2996564689 title "Multimodal Spatiotemporal Networks for Sign Language Recognition" @default.
- W2996564689 cites W1522734439 @default.
- W2996564689 cites W1965483705 @default.
- W2996564689 cites W2004074725 @default.
- W2996564689 cites W2007396849 @default.
- W2996564689 cites W2082765213 @default.
- W2996564689 cites W2096621047 @default.
- W2996564689 cites W2110679950 @default.
- W2996564689 cites W2119799051 @default.
- W2996564689 cites W2126574503 @default.
- W2996564689 cites W2295038166 @default.
- W2996564689 cites W2342662179 @default.
- W2996564689 cites W2471695703 @default.
- W2996564689 cites W2518448700 @default.
- W2996564689 cites W2559085405 @default.
- W2996564689 cites W2560474170 @default.
- W2996564689 cites W2595328592 @default.
- W2996564689 cites W2765354204 @default.
- W2996564689 cites W2766868096 @default.
- W2996564689 cites W2769039400 @default.
- W2996564689 cites W2770472008 @default.
- W2996564689 cites W2776782656 @default.
- W2996564689 cites W2785343708 @default.
- W2996564689 cites W2806985529 @default.
- W2996564689 cites W2888099010 @default.
- W2996564689 cites W2891726870 @default.
- W2996564689 cites W2904518066 @default.
- W2996564689 cites W2963150697 @default.
- W2996564689 cites W2963315828 @default.
- W2996564689 cites W2963488642 @default.
- W2996564689 cites W2963681914 @default.
- W2996564689 cites W2963782415 @default.
- W2996564689 cites W2964094092 @default.
- W2996564689 cites W2964297311 @default.
- W2996564689 cites W2981531407 @default.
- W2996564689 cites W639708223 @default.
- W2996564689 doi "https://doi.org/10.1109/access.2019.2959206" @default.
- W2996564689 hasPublicationYear "2019" @default.
- W2996564689 type Work @default.
- W2996564689 sameAs 2996564689 @default.
- W2996564689 citedByCount "13" @default.
- W2996564689 countsByYear W29965646892021 @default.
- W2996564689 countsByYear W29965646892022 @default.
- W2996564689 countsByYear W29965646892023 @default.
- W2996564689 crossrefType "journal-article" @default.
- W2996564689 hasAuthorship W2996564689A5007928549 @default.
- W2996564689 hasAuthorship W2996564689A5013902548 @default.
- W2996564689 hasAuthorship W2996564689A5073942316 @default.
- W2996564689 hasAuthorship W2996564689A5081147212 @default.
- W2996564689 hasBestOaLocation W29965646891 @default.
- W2996564689 hasConcept C111919701 @default.
- W2996564689 hasConcept C138885662 @default.
- W2996564689 hasConcept C152124472 @default.
- W2996564689 hasConcept C153180895 @default.
- W2996564689 hasConcept C154945302 @default.
- W2996564689 hasConcept C159437735 @default.
- W2996564689 hasConcept C207347870 @default.
- W2996564689 hasConcept C2776401178 @default.
- W2996564689 hasConcept C31972630 @default.
- W2996564689 hasConcept C41008148 @default.
- W2996564689 hasConcept C41895202 @default.
- W2996564689 hasConcept C522192633 @default.
- W2996564689 hasConcept C52622490 @default.
- W2996564689 hasConcept C81363708 @default.
- W2996564689 hasConcept C82990744 @default.
- W2996564689 hasConceptScore W2996564689C111919701 @default.
- W2996564689 hasConceptScore W2996564689C138885662 @default.
- W2996564689 hasConceptScore W2996564689C152124472 @default.
- W2996564689 hasConceptScore W2996564689C153180895 @default.
- W2996564689 hasConceptScore W2996564689C154945302 @default.
- W2996564689 hasConceptScore W2996564689C159437735 @default.
- W2996564689 hasConceptScore W2996564689C207347870 @default.
- W2996564689 hasConceptScore W2996564689C2776401178 @default.
- W2996564689 hasConceptScore W2996564689C31972630 @default.
- W2996564689 hasConceptScore W2996564689C41008148 @default.
- W2996564689 hasConceptScore W2996564689C41895202 @default.
- W2996564689 hasConceptScore W2996564689C522192633 @default.
- W2996564689 hasConceptScore W2996564689C52622490 @default.
- W2996564689 hasConceptScore W2996564689C81363708 @default.
- W2996564689 hasConceptScore W2996564689C82990744 @default.
- W2996564689 hasFunder F4320321001 @default.
- W2996564689 hasLocation W29965646891 @default.
- W2996564689 hasOpenAccess W2996564689 @default.
- W2996564689 hasPrimaryLocation W29965646891 @default.
- W2996564689 hasRelatedWork W1979988555 @default.
- W2996564689 hasRelatedWork W2011928081 @default.
- W2996564689 hasRelatedWork W2367741884 @default.
- W2996564689 hasRelatedWork W2546942002 @default.
- W2996564689 hasRelatedWork W2903018492 @default.
- W2996564689 hasRelatedWork W2940209620 @default.