Matches in SemOpenAlex for { <https://semopenalex.org/work/W4375858649> ?p ?o ?g. }
- W4375858649 endingPage "100811" @default.
- W4375858649 startingPage "100811" @default.
- W4375858649 abstract "Action identification for smart home ecosystem has experienced a rising interest among relevant fields. Nevertheless, thoroughly understanding context and movement in video, which is the key component for an effective action identification system and a visual-based smart home ecosystem, remains a challenge. Recently, 3DCNN architectures including SlowFast, have proved to be the proper solution for this issue due to ability to filter spatiotemporal features in video. Additionally, the growth in Natural Language Processing, particularly BERT, has shown the potential of utilizing the Attention Mechanism for extracting temporal relationship of movement throughout a video. We introduce a novel fusing approach aiming to fully exploit the temporal relationship within spatiotemporal features produced by 3DCNN and enhance the efficiency of action identification system for smart home surveillance. The proposed method consists of two models: SlowFast with two distinct ResNet-50 backbones for spatiotemporal features extraction and BERT for aggregating temporal relationship. These models are sequentially stacked using two varieties of fusing techniques: early-ensemble and late-ensemble, constructing a robust unified system with the capability to compete against state-of-the-art modalities. This paper also contribute a new Kinetics51 dataset for our experiment on these mentioned models. The proposed method provides positively high top-1 accuracy for the following datasets: specifically, HMDB-51 dataset, which contains 51 variety of actions, achieves 78.05% using 10-crop testing; Kinetics51, our derived dataset from Kinetics400, achieves 82.53% using 10-crop testing. The performance on challenging action identification datasets HMDB51 and our Kinetics51 has shown the robustness of the mentioned fusing technique applied on two proposed models." @default.
- W4375858649 created "2023-05-10" @default.
- W4375858649 creator A5024109615 @default.
- W4375858649 creator A5037897550 @default.
- W4375858649 creator A5041464195 @default.
- W4375858649 date "2023-07-01" @default.
- W4375858649 modified "2023-09-29" @default.
- W4375858649 title "Action identification with fusion of BERT and 3DCNN for smart home systems" @default.
- W4375858649 cites W1522734439 @default.
- W4375858649 cites W1677182931 @default.
- W4375858649 cites W1744759976 @default.
- W4375858649 cites W1983364832 @default.
- W4375858649 cites W2016053056 @default.
- W4375858649 cites W2082627290 @default.
- W4375858649 cites W2105101328 @default.
- W4375858649 cites W2108598243 @default.
- W4375858649 cites W2126579184 @default.
- W4375858649 cites W2147800946 @default.
- W4375858649 cites W2151103935 @default.
- W4375858649 cites W2161969291 @default.
- W4375858649 cites W2163352848 @default.
- W4375858649 cites W2194775991 @default.
- W4375858649 cites W2487442924 @default.
- W4375858649 cites W2747474452 @default.
- W4375858649 cites W2786808285 @default.
- W4375858649 cites W2805029945 @default.
- W4375858649 cites W2962934715 @default.
- W4375858649 cites W2963524571 @default.
- W4375858649 cites W2964037671 @default.
- W4375858649 cites W2972317743 @default.
- W4375858649 cites W2990503944 @default.
- W4375858649 cites W3011785450 @default.
- W4375858649 cites W3045185375 @default.
- W4375858649 cites W3084848528 @default.
- W4375858649 cites W3090689520 @default.
- W4375858649 cites W3145385912 @default.
- W4375858649 cites W3170837227 @default.
- W4375858649 cites W3202691929 @default.
- W4375858649 cites W4214507759 @default.
- W4375858649 cites W4224302133 @default.
- W4375858649 cites W4249279051 @default.
- W4375858649 cites W4308036518 @default.
- W4375858649 doi "https://doi.org/10.1016/j.iot.2023.100811" @default.
- W4375858649 hasPublicationYear "2023" @default.
- W4375858649 type Work @default.
- W4375858649 citedByCount "0" @default.
- W4375858649 crossrefType "journal-article" @default.
- W4375858649 hasAuthorship W4375858649A5024109615 @default.
- W4375858649 hasAuthorship W4375858649A5037897550 @default.
- W4375858649 hasAuthorship W4375858649A5041464195 @default.
- W4375858649 hasConcept C104317684 @default.
- W4375858649 hasConcept C116834253 @default.
- W4375858649 hasConcept C119857082 @default.
- W4375858649 hasConcept C136197465 @default.
- W4375858649 hasConcept C151730666 @default.
- W4375858649 hasConcept C154945302 @default.
- W4375858649 hasConcept C165696696 @default.
- W4375858649 hasConcept C185592680 @default.
- W4375858649 hasConcept C2779343474 @default.
- W4375858649 hasConcept C38652104 @default.
- W4375858649 hasConcept C41008148 @default.
- W4375858649 hasConcept C507571656 @default.
- W4375858649 hasConcept C55493867 @default.
- W4375858649 hasConcept C59822182 @default.
- W4375858649 hasConcept C63479239 @default.
- W4375858649 hasConcept C76155785 @default.
- W4375858649 hasConcept C86803240 @default.
- W4375858649 hasConceptScore W4375858649C104317684 @default.
- W4375858649 hasConceptScore W4375858649C116834253 @default.
- W4375858649 hasConceptScore W4375858649C119857082 @default.
- W4375858649 hasConceptScore W4375858649C136197465 @default.
- W4375858649 hasConceptScore W4375858649C151730666 @default.
- W4375858649 hasConceptScore W4375858649C154945302 @default.
- W4375858649 hasConceptScore W4375858649C165696696 @default.
- W4375858649 hasConceptScore W4375858649C185592680 @default.
- W4375858649 hasConceptScore W4375858649C2779343474 @default.
- W4375858649 hasConceptScore W4375858649C38652104 @default.
- W4375858649 hasConceptScore W4375858649C41008148 @default.
- W4375858649 hasConceptScore W4375858649C507571656 @default.
- W4375858649 hasConceptScore W4375858649C55493867 @default.
- W4375858649 hasConceptScore W4375858649C59822182 @default.
- W4375858649 hasConceptScore W4375858649C63479239 @default.
- W4375858649 hasConceptScore W4375858649C76155785 @default.
- W4375858649 hasConceptScore W4375858649C86803240 @default.
- W4375858649 hasLocation W43758586491 @default.
- W4375858649 hasOpenAccess W4375858649 @default.
- W4375858649 hasPrimaryLocation W43758586491 @default.
- W4375858649 hasRelatedWork W1607315280 @default.
- W4375858649 hasRelatedWork W2077573236 @default.
- W4375858649 hasRelatedWork W2331043530 @default.
- W4375858649 hasRelatedWork W2374725260 @default.
- W4375858649 hasRelatedWork W2393933887 @default.
- W4375858649 hasRelatedWork W2961085424 @default.
- W4375858649 hasRelatedWork W2997512100 @default.
- W4375858649 hasRelatedWork W4306674287 @default.
- W4375858649 hasRelatedWork W4386140649 @default.
- W4375858649 hasRelatedWork W4224009465 @default.
- W4375858649 hasVolume "22" @default.