tailieunhanh - Báo cáo khoa học: "Non-Verbal Cues for Discourse Structure"

This paper addresses the issue of designing embodied conversational agents that exhibit appropriate posture shifts during dialogues with human users. Previous research has noted the importance of hand gestures, eye gaze and head nods in conversations between embodied agents and humans. We present an analysis of human monologues and dialogues that suggests that postural shifts can be predicted as a function of discourse state in monologues, and discourse and conversation state in dialogues. On the basis of these findings, we have implemented an embodied conversational agent that uses Collagen in such a way as to generate postural shifts. . | Non-Verbal Cues for Discourse Structure Justine Cassell Yukiko I. Nakanof Timothy W. Bickmoref Candace L. SidnerỊ and Charles RichỊ fMIT Media Laboratory 20 Ames Street Cambridge MA 02139 justine yukiko bickmore @ Abstract This paper addresses the issue of designing embodied conversational agents that exhibit appropriate posture shifts during dialogues with human users. Previous research has noted the importance of hand gestures eye gaze and head nods in conversations between embodied agents and humans. We present an analysis of human monologues and dialogues that suggests that postural shifts can be predicted as a function of discourse state in monologues and discourse and conversation state in dialogues. On the basis of these findings we have implemented an embodied conversational agent that uses Collagen in such a way as to generate postural shifts. 1. Introduction This paper provides empirical support for the relationship between posture shifts and discourse structure and then derives an algorithm for generating posture shifts in an animated embodied conversational agent from discourse states produced by the middleware architecture known as Collagen 18 . Other nonverbal behaviors have been shown to be correlated with the underlying conversational structure and information structure of discourse. For example gaze shifts towards the listener correlate with a shift in conversational turn from the conversational participants Mitsubishi Electric Research Laboratories 201 Broadway Cambridge MA 02139 sidner rich @ perspective they can be seen as a signal that the floor is available . Gestures correlate with rhematic content in accompanying language from the conversational participants perspective these behaviors can be seen as a signal that accompanying speech is of high interest . A better understanding of the role of nonverbal behaviors in conveying discourse structures enables improvements in the naturalness of embodied dialogue systems such as