Matches in SemOpenAlex for { <https://semopenalex.org/work/W3113547664> ?p ?o ?g. }
- W3113547664 abstract "When humans converse, what a speaker will say next significantly depends on what he sees. Unfortunately, existing dialogue models generate dialogue utterances only based on preceding textual contexts, and visual contexts are rarely considered. This is due to a lack of a large-scale multi-module dialogue dataset with utterances paired with visual contexts. In this paper, we release {bf OpenViDial}, a large-scale multi-module dialogue dataset. The dialogue turns and visual contexts are extracted from movies and TV series, where each dialogue turn is paired with the corresponding visual context in which it takes place. OpenViDial contains a total number of 1.1 million dialogue turns, and thus 1.1 million visual contexts stored in images. Based on this dataset, we propose a family of encoder-decoder models leveraging both textual and visual contexts, from coarse-grained image features extracted from CNNs to fine-grained object features extracted from Faster R-CNNs. We observe that visual information significantly improves dialogue generation qualities, verifying the necessity of integrating multi-modal features for dialogue learning. Our work marks an important step towards large-scale multi-modal dialogue learning." @default.
- W3113547664 created "2021-01-05" @default.
- W3113547664 creator A5003979715 @default.
- W3113547664 creator A5012288572 @default.
- W3113547664 creator A5014777126 @default.
- W3113547664 creator A5023207081 @default.
- W3113547664 creator A5060339946 @default.
- W3113547664 creator A5074612639 @default.
- W3113547664 creator A5077851706 @default.
- W3113547664 date "2020-12-30" @default.
- W3113547664 modified "2023-09-27" @default.
- W3113547664 title "OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts." @default.
- W3113547664 cites W1522301498 @default.
- W3113547664 cites W1591706642 @default.
- W3113547664 cites W1646777016 @default.
- W3113547664 cites W1995945562 @default.
- W3113547664 cites W2125320996 @default.
- W3113547664 cites W2130942839 @default.
- W3113547664 cites W2145482038 @default.
- W3113547664 cites W2161466446 @default.
- W3113547664 cites W2194187530 @default.
- W3113547664 cites W2194775991 @default.
- W3113547664 cites W2302255633 @default.
- W3113547664 cites W2311783643 @default.
- W3113547664 cites W2399880602 @default.
- W3113547664 cites W2410983263 @default.
- W3113547664 cites W2419539795 @default.
- W3113547664 cites W2463565445 @default.
- W3113547664 cites W2470875822 @default.
- W3113547664 cites W2499265956 @default.
- W3113547664 cites W2558809543 @default.
- W3113547664 cites W2560730294 @default.
- W3113547664 cites W2583679610 @default.
- W3113547664 cites W2594978815 @default.
- W3113547664 cites W2603266952 @default.
- W3113547664 cites W2605133118 @default.
- W3113547664 cites W2605246398 @default.
- W3113547664 cites W2745461083 @default.
- W3113547664 cites W2750998636 @default.
- W3113547664 cites W2754388020 @default.
- W3113547664 cites W2765617518 @default.
- W3113547664 cites W2784400615 @default.
- W3113547664 cites W2787266721 @default.
- W3113547664 cites W2787711783 @default.
- W3113547664 cites W2797585226 @default.
- W3113547664 cites W2801760385 @default.
- W3113547664 cites W2807880213 @default.
- W3113547664 cites W2810643877 @default.
- W3113547664 cites W2810840719 @default.
- W3113547664 cites W2890276793 @default.
- W3113547664 cites W2892245540 @default.
- W3113547664 cites W2896457183 @default.
- W3113547664 cites W2903594499 @default.
- W3113547664 cites W2911400095 @default.
- W3113547664 cites W2911994530 @default.
- W3113547664 cites W2914190582 @default.
- W3113547664 cites W2916046739 @default.
- W3113547664 cites W2916772188 @default.
- W3113547664 cites W2918076322 @default.
- W3113547664 cites W2939790162 @default.
- W3113547664 cites W2945978556 @default.
- W3113547664 cites W2950242852 @default.
- W3113547664 cites W2950297087 @default.
- W3113547664 cites W2950761309 @default.
- W3113547664 cites W2950902819 @default.
- W3113547664 cites W2951520714 @default.
- W3113547664 cites W2951580200 @default.
- W3113547664 cites W2951877072 @default.
- W3113547664 cites W2952254585 @default.
- W3113547664 cites W2953106684 @default.
- W3113547664 cites W2954367631 @default.
- W3113547664 cites W2962784628 @default.
- W3113547664 cites W2962806234 @default.
- W3113547664 cites W2962852262 @default.
- W3113547664 cites W2963035145 @default.
- W3113547664 cites W2963206148 @default.
- W3113547664 cites W2963403868 @default.
- W3113547664 cites W2963520511 @default.
- W3113547664 cites W2963527228 @default.
- W3113547664 cites W2963623904 @default.
- W3113547664 cites W2963643760 @default.
- W3113547664 cites W2963647456 @default.
- W3113547664 cites W2963656855 @default.
- W3113547664 cites W2963791035 @default.
- W3113547664 cites W2963890019 @default.
- W3113547664 cites W2964119254 @default.
- W3113547664 cites W2964213933 @default.
- W3113547664 cites W2964218959 @default.
- W3113547664 cites W2966158321 @default.
- W3113547664 cites W2967045987 @default.
- W3113547664 cites W2967593235 @default.
- W3113547664 cites W2968124245 @default.
- W3113547664 cites W2969576497 @default.
- W3113547664 cites W2969862959 @default.
- W3113547664 cites W2970608575 @default.
- W3113547664 cites W2971164557 @default.
- W3113547664 cites W2975501350 @default.
- W3113547664 cites W2981902456 @default.
- W3113547664 cites W2986823309 @default.
- W3113547664 cites W2995460200 @default.