Matches in SemOpenAlex for { <https://semopenalex.org/work/W2404502354> ?p ?o ?g. }
- W2404502354 startingPage "15" @default.
- W2404502354 abstract "In the German SmartWeb project, the user is interacting with the web via a PDA in order to get information on, for example, points of interest. To overcome the tedious use of devices such as push-to-talk, but still to be able to tell whether the user is addressing the system or talking to herself or to a third person, we developed a module that monitors speech and video in parallel. Our database (3.2 hours of speech, 2086 turns) has been recorded in a real-life setting, indoors as well as outdoors, with unfavourable acoustic and light conditions. With acoustic features, we classify up to 4 different types of addressing (talking to the system: On-Talk, reading from the display: Read OffTalk, paraphrasing information presented on the screen: Paraphrasing Off-Talk, talking to a third person or to oneself: Spontaneous Off-Talk). With a camera integrated in the PDA, we record the user’s face and decide whether she is looking onto the PDA or somewhere else. We use three different types of turn features based on classification scores of frame-based face detection and word-based analysis: 13 acoustic-prosodic features, 18 linguistic features, and 9 video features. The classification rate for acoustics only is up to 62 % for the four-class problem, and up to 77 % for the most important two-class problem ”user is focussing on interaction with the system or not”. For video only, it is 45 % and 71 %, respectively. By combining the two modalities, and using linguistic information in addition, classification performance for the two-class problem so far rises up to 85 %. Index Terms: Multi-modal Human Machine Interaction, OffTalk, audio, video" @default.
- W2404502354 created "2016-06-24" @default.
- W2404502354 creator A5034153831 @default.
- W2404502354 creator A5040258691 @default.
- W2404502354 creator A5054443473 @default.
- W2404502354 creator A5064612306 @default.
- W2404502354 creator A5089090103 @default.
- W2404502354 date "2007-01-01" @default.
- W2404502354 modified "2023-09-28" @default.
- W2404502354 title "Taking into Account the User's Focus of Attention with the Help of Audio-Visual Information: Towards less Artificial Human-Machine-Communication" @default.
- W2404502354 cites W120719704 @default.
- W2404502354 cites W139719423 @default.
- W2404502354 cites W1490252571 @default.
- W2404502354 cites W1512372384 @default.
- W2404502354 cites W1593355466 @default.
- W2404502354 cites W1595187495 @default.
- W2404502354 cites W1616123134 @default.
- W2404502354 cites W1882254825 @default.
- W2404502354 cites W1912255453 @default.
- W2404502354 cites W2011126660 @default.
- W2404502354 cites W2066792660 @default.
- W2404502354 cites W2076576397 @default.
- W2404502354 cites W2118924889 @default.
- W2404502354 cites W2124864341 @default.
- W2404502354 cites W2141765414 @default.
- W2404502354 cites W2144155486 @default.
- W2404502354 cites W2155341315 @default.
- W2404502354 cites W2243943203 @default.
- W2404502354 cites W2758076141 @default.
- W2404502354 cites W3020974803 @default.
- W2404502354 cites W3097096317 @default.
- W2404502354 cites W847145940 @default.
- W2404502354 cites W2487754837 @default.
- W2404502354 hasPublicationYear "2007" @default.
- W2404502354 type Work @default.
- W2404502354 sameAs 2404502354 @default.
- W2404502354 citedByCount "2" @default.
- W2404502354 crossrefType "journal-article" @default.
- W2404502354 hasAuthorship W2404502354A5034153831 @default.
- W2404502354 hasAuthorship W2404502354A5040258691 @default.
- W2404502354 hasAuthorship W2404502354A5054443473 @default.
- W2404502354 hasAuthorship W2404502354A5064612306 @default.
- W2404502354 hasAuthorship W2404502354A5089090103 @default.
- W2404502354 hasConcept C107457646 @default.
- W2404502354 hasConcept C120665830 @default.
- W2404502354 hasConcept C121332964 @default.
- W2404502354 hasConcept C126042441 @default.
- W2404502354 hasConcept C138885662 @default.
- W2404502354 hasConcept C144024400 @default.
- W2404502354 hasConcept C154775046 @default.
- W2404502354 hasConcept C154945302 @default.
- W2404502354 hasConcept C192209626 @default.
- W2404502354 hasConcept C204321447 @default.
- W2404502354 hasConcept C2777212361 @default.
- W2404502354 hasConcept C2779903281 @default.
- W2404502354 hasConcept C28490314 @default.
- W2404502354 hasConcept C36289849 @default.
- W2404502354 hasConcept C41008148 @default.
- W2404502354 hasConcept C41895202 @default.
- W2404502354 hasConcept C554936623 @default.
- W2404502354 hasConcept C76155785 @default.
- W2404502354 hasConceptScore W2404502354C107457646 @default.
- W2404502354 hasConceptScore W2404502354C120665830 @default.
- W2404502354 hasConceptScore W2404502354C121332964 @default.
- W2404502354 hasConceptScore W2404502354C126042441 @default.
- W2404502354 hasConceptScore W2404502354C138885662 @default.
- W2404502354 hasConceptScore W2404502354C144024400 @default.
- W2404502354 hasConceptScore W2404502354C154775046 @default.
- W2404502354 hasConceptScore W2404502354C154945302 @default.
- W2404502354 hasConceptScore W2404502354C192209626 @default.
- W2404502354 hasConceptScore W2404502354C204321447 @default.
- W2404502354 hasConceptScore W2404502354C2777212361 @default.
- W2404502354 hasConceptScore W2404502354C2779903281 @default.
- W2404502354 hasConceptScore W2404502354C28490314 @default.
- W2404502354 hasConceptScore W2404502354C36289849 @default.
- W2404502354 hasConceptScore W2404502354C41008148 @default.
- W2404502354 hasConceptScore W2404502354C41895202 @default.
- W2404502354 hasConceptScore W2404502354C554936623 @default.
- W2404502354 hasConceptScore W2404502354C76155785 @default.
- W2404502354 hasLocation W24045023541 @default.
- W2404502354 hasOpenAccess W2404502354 @default.
- W2404502354 hasPrimaryLocation W24045023541 @default.
- W2404502354 hasRelatedWork W1126354848 @default.
- W2404502354 hasRelatedWork W120719704 @default.
- W2404502354 hasRelatedWork W1508834538 @default.
- W2404502354 hasRelatedWork W153524745 @default.
- W2404502354 hasRelatedWork W2010223195 @default.
- W2404502354 hasRelatedWork W2016540105 @default.
- W2404502354 hasRelatedWork W2074608841 @default.
- W2404502354 hasRelatedWork W2182276771 @default.
- W2404502354 hasRelatedWork W2185031771 @default.
- W2404502354 hasRelatedWork W2387453296 @default.
- W2404502354 hasRelatedWork W2595299412 @default.
- W2404502354 hasRelatedWork W2891460598 @default.
- W2404502354 hasRelatedWork W2945019330 @default.
- W2404502354 hasRelatedWork W2952182676 @default.
- W2404502354 hasRelatedWork W3013897061 @default.
- W2404502354 hasRelatedWork W3095634777 @default.
- W2404502354 hasRelatedWork W3136640134 @default.