tailieunhanh - Báo cáo khoa học: "SPEECH DIALOGUE WITH FACIAL DISPLAYS: MULTIMODAL HUMAN-COMPUTER CONVERSATION"

Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multiplicity of communication channels that act on multiple modalities. To realize a natural multimodal dialogue, it is necessary to study how humans perceive information and determine the information to which humans are sensitive. A face is an independent communication channel that conveys emotional and conversational signals, encoded as facial expressions. We have developed an experimental system that integrates speech dialogue and facial animation, to investigate the effect of introducing communicative facial expressions as a new modality in human-computer conversation | SPEECH DIALOGUE WITH FACIAL DISPLAYS MULTIMODAL HUMAN-COMPUTER CONVERSATION Katashi Nagao and Akikazu Takeuchi Sony Computer Science Laboratory Inc. 3-14-13 Higashi-gotanda Shinagawa-ku Tokyo 141 Japan E-mail nagao takeuchi @ Abstract Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multiplicity of communication channels that act on multiple modalities. To realize a natural multimodal dialogue it is necessary to study how humans perceive information and determine the information to which humans are sensitive. A face is an independent communication channel that conveys emotional and conversational signals encoded as facial expressions. We have developed an experimental system that integrates speech dialogue and facial animation to investigate the effect of introducing communicative facial expressions as a new modality in human-computer conversation. Our experiments have showen that facial expressions are helpful especially upon first contact with the system. We have also discovered that featuring facial expressions at an early stage improves subsequent interaction. Introduction Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multiplicity of communication channels that act on multiple modalities. A channel is a communication medium associated with a particular encoding method. Examples are the auditory channel carrying speech and the visual channel carrying facial expressions . A modality is the sense used to perceive signals from the outside world. Many researchers have been developing multimodal dialogue systems. In some cases researchers have shown that information in one channel complements or modifies information in another. As a simple example the phrase delete it involves the coordination of voice with gesture. Neither makes sense without the other. Researchers .

• Báo cáo khoa học
• SPEECH DIALOGUE
• FACIAL DISPLAYS
• MULTIMODAL HUMAN COMPUTER CONVERSATION
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Multimodal Menu based Dialogue
• Speech Cursor in DICO II+
• Staffan Larsson
• báo cáo ngôn ngữ
• ngôn ngữ tự nhiên
• Automatic Detectio
• Poor Speech Recognition
• Dialogue Level
• User Simulations
• context sensitive speech recognition
• Spoken Dialogue Systems
• scientific reports
• model language
• process natural language
• Advanced In Vehicle
• Spoken Dialog Corpus
• Dialogue System
• Robust Dialog Management
• Correcting Code
• Robust Speech Recognition
• how to learn english
• english grammar
• basic english
• english verbs
• subjects English
• dialogue in English
• foreign language skills
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học