Matches in SemOpenAlex for { <https://semopenalex.org/work/W4225810142> ?p ?o ?g. }
- W4225810142 endingPage "1918" @default.
- W4225810142 startingPage "1906" @default.
- W4225810142 abstract "Learning the hidden dynamics from sequence data is crucial. Attention mechanism can be introduced to spotlight on the region of interest for sequential learning. Traditional attention was measured between a query and a sequence based on a discrete-time state trajectory. Such a mechanism could not characterize the irregularly-sampled sequence data. This paper presents an attentive differential network (ADN) where the attention over continuous-time dynamics is developed. The continuous-time attention is performed over the dynamics at all time. The missing information in irregular or sparse samples can be seamlessly compensated and attended. Self attention is computed to find the attended state trajectory. However, the memory cost for attention score between a query and a sequence is demanding since self attention treats all time instants as query points in an ordinary differential equation solver. This issue is tackled by imposing the causality constraint in causal ADN (CADN) where the query is merged up to current time. To enhance the model robustness, this study further explores a latent CADN where the attended dynamics are calculated in an encoder-decoder structure via Bayesian learning. Experiments on the irregularly-sampled actions, dialogues and bio-signals illustrate the merits of the proposed methods in action recognition, emotion recognition and mortality prediction, respectively." @default.
- W4225810142 created "2022-05-05" @default.
- W4225810142 creator A5030620861 @default.
- W4225810142 creator A5061908942 @default.
- W4225810142 date "2023-02-01" @default.
- W4225810142 modified "2023-09-30" @default.
- W4225810142 title "Learning Continuous-Time Dynamics With Attention" @default.
- W4225810142 cites W2171323895 @default.
- W4225810142 cites W2194775991 @default.
- W4225810142 cites W2242047860 @default.
- W4225810142 cites W2250539671 @default.
- W4225810142 cites W2405331948 @default.
- W4225810142 cites W2614121823 @default.
- W4225810142 cites W2963686995 @default.
- W4225810142 cites W2964010366 @default.
- W4225810142 cites W2964300796 @default.
- W4225810142 cites W2996849360 @default.
- W4225810142 cites W3014475539 @default.
- W4225810142 cites W3093463432 @default.
- W4225810142 cites W3134794314 @default.
- W4225810142 cites W3138043709 @default.
- W4225810142 cites W3163201210 @default.
- W4225810142 cites W3173899333 @default.
- W4225810142 cites W3174283492 @default.
- W4225810142 doi "https://doi.org/10.1109/tpami.2022.3162711" @default.
- W4225810142 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/35344486" @default.
- W4225810142 hasPublicationYear "2023" @default.
- W4225810142 type Work @default.
- W4225810142 citedByCount "2" @default.
- W4225810142 countsByYear W42258101422022 @default.
- W4225810142 countsByYear W42258101422023 @default.
- W4225810142 crossrefType "journal-article" @default.
- W4225810142 hasAuthorship W4225810142A5030620861 @default.
- W4225810142 hasAuthorship W4225810142A5061908942 @default.
- W4225810142 hasConcept C104317684 @default.
- W4225810142 hasConcept C107673813 @default.
- W4225810142 hasConcept C111919701 @default.
- W4225810142 hasConcept C11413529 @default.
- W4225810142 hasConcept C118505674 @default.
- W4225810142 hasConcept C119857082 @default.
- W4225810142 hasConcept C121332964 @default.
- W4225810142 hasConcept C1276947 @default.
- W4225810142 hasConcept C134306372 @default.
- W4225810142 hasConcept C13662910 @default.
- W4225810142 hasConcept C153180895 @default.
- W4225810142 hasConcept C154945302 @default.
- W4225810142 hasConcept C185592680 @default.
- W4225810142 hasConcept C2778112365 @default.
- W4225810142 hasConcept C33923547 @default.
- W4225810142 hasConcept C40506919 @default.
- W4225810142 hasConcept C41008148 @default.
- W4225810142 hasConcept C51544822 @default.
- W4225810142 hasConcept C54355233 @default.
- W4225810142 hasConcept C55493867 @default.
- W4225810142 hasConcept C63479239 @default.
- W4225810142 hasConcept C78045399 @default.
- W4225810142 hasConcept C86803240 @default.
- W4225810142 hasConceptScore W4225810142C104317684 @default.
- W4225810142 hasConceptScore W4225810142C107673813 @default.
- W4225810142 hasConceptScore W4225810142C111919701 @default.
- W4225810142 hasConceptScore W4225810142C11413529 @default.
- W4225810142 hasConceptScore W4225810142C118505674 @default.
- W4225810142 hasConceptScore W4225810142C119857082 @default.
- W4225810142 hasConceptScore W4225810142C121332964 @default.
- W4225810142 hasConceptScore W4225810142C1276947 @default.
- W4225810142 hasConceptScore W4225810142C134306372 @default.
- W4225810142 hasConceptScore W4225810142C13662910 @default.
- W4225810142 hasConceptScore W4225810142C153180895 @default.
- W4225810142 hasConceptScore W4225810142C154945302 @default.
- W4225810142 hasConceptScore W4225810142C185592680 @default.
- W4225810142 hasConceptScore W4225810142C2778112365 @default.
- W4225810142 hasConceptScore W4225810142C33923547 @default.
- W4225810142 hasConceptScore W4225810142C40506919 @default.
- W4225810142 hasConceptScore W4225810142C41008148 @default.
- W4225810142 hasConceptScore W4225810142C51544822 @default.
- W4225810142 hasConceptScore W4225810142C54355233 @default.
- W4225810142 hasConceptScore W4225810142C55493867 @default.
- W4225810142 hasConceptScore W4225810142C63479239 @default.
- W4225810142 hasConceptScore W4225810142C78045399 @default.
- W4225810142 hasConceptScore W4225810142C86803240 @default.
- W4225810142 hasFunder F4320322795 @default.
- W4225810142 hasIssue "2" @default.
- W4225810142 hasLocation W42258101421 @default.
- W4225810142 hasLocation W42258101422 @default.
- W4225810142 hasOpenAccess W4225810142 @default.
- W4225810142 hasPrimaryLocation W42258101421 @default.
- W4225810142 hasRelatedWork W2227316993 @default.
- W4225810142 hasRelatedWork W2510887268 @default.
- W4225810142 hasRelatedWork W2788270507 @default.
- W4225810142 hasRelatedWork W2892118914 @default.
- W4225810142 hasRelatedWork W2901105815 @default.
- W4225810142 hasRelatedWork W2963309363 @default.
- W4225810142 hasRelatedWork W3015961574 @default.
- W4225810142 hasRelatedWork W3024133716 @default.
- W4225810142 hasRelatedWork W3133902173 @default.
- W4225810142 hasRelatedWork W4300560941 @default.
- W4225810142 hasVolume "45" @default.
- W4225810142 isParatext "false" @default.