Matches in SemOpenAlex for { <https://semopenalex.org/work/W2951614005> ?p ?o ?g. }
- W2951614005 abstract "We propose a framework for parsing video and text jointly for understanding events and answering user queries. Our framework produces a parse graph that represents the compositional structures of spatial information (objects and scenes), temporal information (actions and events) and causal information (causalities between events and fluents) in the video and text. The knowledge representation of our framework is based on a spatial-temporal-causal And-Or graph (S/T/C-AOG), which jointly models possible hierarchical compositions of objects, scenes and events as well as their interactions and mutual contexts, and specifies the prior probabilistic distribution of the parse graphs. We present a probabilistic generative model for joint parsing that captures the relations between the input video/text, their corresponding parse graphs and the joint parse graph. Based on the probabilistic model, we propose a joint parsing system consisting of three modules: video parsing, text parsing and joint inference. Video parsing and text parsing produce two parse graphs from the input video and text respectively. The joint inference module produces a joint parse graph by performing matching, deduction and revision on the video and text parse graphs. The proposed framework has the following objectives: Firstly, we aim at deep semantic parsing of video and text that goes beyond the traditional bag-of-words approaches; Secondly, we perform parsing and reasoning across the spatial, temporal and causal dimensions based on the joint S/T/C-AOG representation; Thirdly, we show that deep joint parsing facilitates subsequent applications such as generating narrative text descriptions and answering queries in the forms of who, what, when, where and why. We empirically evaluated our system based on comparison against ground-truth as well as accuracy of query answering and obtained satisfactory results." @default.
- W2951614005 created "2019-06-27" @default.
- W2951614005 creator A5034228010 @default.
- W2951614005 creator A5038476106 @default.
- W2951614005 creator A5066753006 @default.
- W2951614005 creator A5072165642 @default.
- W2951614005 creator A5085488411 @default.
- W2951614005 date "2013-08-29" @default.
- W2951614005 modified "2023-09-26" @default.
- W2951614005 title "Joint Video and Text Parsing for Understanding Events and Answering Queries" @default.
- W2951614005 cites W1492798374 @default.
- W2951614005 cites W1507854426 @default.
- W2951614005 cites W1509392121 @default.
- W2951614005 cites W1544874167 @default.
- W2951614005 cites W1574901103 @default.
- W2951614005 cites W1589169499 @default.
- W2951614005 cites W1794771410 @default.
- W2951614005 cites W1819150958 @default.
- W2951614005 cites W1907013787 @default.
- W2951614005 cites W1987835821 @default.
- W2951614005 cites W1998678766 @default.
- W2951614005 cites W2000636201 @default.
- W2951614005 cites W2019989248 @default.
- W2951614005 cites W2038248725 @default.
- W2951614005 cites W2044982188 @default.
- W2951614005 cites W2045792079 @default.
- W2951614005 cites W2056860348 @default.
- W2951614005 cites W2077797310 @default.
- W2951614005 cites W2084168100 @default.
- W2951614005 cites W2101105183 @default.
- W2951614005 cites W2109305780 @default.
- W2951614005 cites W2109463015 @default.
- W2951614005 cites W2115752676 @default.
- W2951614005 cites W2119713076 @default.
- W2951614005 cites W2122695597 @default.
- W2951614005 cites W2123053055 @default.
- W2951614005 cites W2123301721 @default.
- W2951614005 cites W2126747264 @default.
- W2951614005 cites W2128107557 @default.
- W2951614005 cites W2131564913 @default.
- W2951614005 cites W2132232128 @default.
- W2951614005 cites W2137079713 @default.
- W2951614005 cites W2137444342 @default.
- W2951614005 cites W2137471889 @default.
- W2951614005 cites W2139381543 @default.
- W2951614005 cites W2145743319 @default.
- W2951614005 cites W2150406842 @default.
- W2951614005 cites W2152239535 @default.
- W2951614005 cites W2156336347 @default.
- W2951614005 cites W2156830856 @default.
- W2951614005 cites W2169255714 @default.
- W2951614005 cites W2189472871 @default.
- W2951614005 cites W2238904277 @default.
- W2951614005 cites W2417825098 @default.
- W2951614005 cites W2465309725 @default.
- W2951614005 cites W2610257307 @default.
- W2951614005 cites W2953361271 @default.
- W2951614005 doi "https://doi.org/10.48550/arxiv.1308.6628" @default.
- W2951614005 hasPublicationYear "2013" @default.
- W2951614005 type Work @default.
- W2951614005 sameAs 2951614005 @default.
- W2951614005 citedByCount "2" @default.
- W2951614005 countsByYear W29516140052016 @default.
- W2951614005 countsByYear W29516140052017 @default.
- W2951614005 crossrefType "posted-content" @default.
- W2951614005 hasAuthorship W2951614005A5034228010 @default.
- W2951614005 hasAuthorship W2951614005A5038476106 @default.
- W2951614005 hasAuthorship W2951614005A5066753006 @default.
- W2951614005 hasAuthorship W2951614005A5072165642 @default.
- W2951614005 hasAuthorship W2951614005A5085488411 @default.
- W2951614005 hasBestOaLocation W29516140051 @default.
- W2951614005 hasConcept C118364021 @default.
- W2951614005 hasConcept C132525143 @default.
- W2951614005 hasConcept C147547768 @default.
- W2951614005 hasConcept C154945302 @default.
- W2951614005 hasConcept C186644900 @default.
- W2951614005 hasConcept C204321447 @default.
- W2951614005 hasConcept C2776214188 @default.
- W2951614005 hasConcept C41008148 @default.
- W2951614005 hasConcept C42560504 @default.
- W2951614005 hasConcept C49937458 @default.
- W2951614005 hasConcept C60690694 @default.
- W2951614005 hasConcept C80444323 @default.
- W2951614005 hasConceptScore W2951614005C118364021 @default.
- W2951614005 hasConceptScore W2951614005C132525143 @default.
- W2951614005 hasConceptScore W2951614005C147547768 @default.
- W2951614005 hasConceptScore W2951614005C154945302 @default.
- W2951614005 hasConceptScore W2951614005C186644900 @default.
- W2951614005 hasConceptScore W2951614005C204321447 @default.
- W2951614005 hasConceptScore W2951614005C2776214188 @default.
- W2951614005 hasConceptScore W2951614005C41008148 @default.
- W2951614005 hasConceptScore W2951614005C42560504 @default.
- W2951614005 hasConceptScore W2951614005C49937458 @default.
- W2951614005 hasConceptScore W2951614005C60690694 @default.
- W2951614005 hasConceptScore W2951614005C80444323 @default.
- W2951614005 hasLocation W29516140051 @default.
- W2951614005 hasLocation W29516140052 @default.
- W2951614005 hasOpenAccess W2951614005 @default.
- W2951614005 hasPrimaryLocation W29516140051 @default.
- W2951614005 hasRelatedWork W1532436150 @default.