tailieunhanh - Báo cáo khoa học: "MATCH: An Architecture for Multimodal Dialogue Systems"

Mobile interfaces need to allow the user and system to adapt their choice of communication modes according to user preferences, the task at hand, and the physical and social environment. We describe a multimodal application architecture which combines finite-state multimodal language processing, a speech-act based multimodal dialogue manager, dynamic multimodal output generation, and user-tailored text planning to enable rapid prototyping of multimodal interfaces with flexible input and adaptive output. . | Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics ACL Philadelphia July 2002 pp. 376-383. MATCH An Architecture for Multimodal Dialogue Systems Michael Johnston Srinivas Bangalore Gunaranjan Vasireddy Amanda Stent Patrick Ehlen Marilyn Walker Steve Whittaker Preetam Maloor AT T Labs - Research 180 Park Ave Florham Park NJ 07932 USA johnston srini guna ehlen walker stevew pmaloor@ Now at SUNY Stonybrook stent@ Abstract Mobile interfaces need to allow the user and system to adapt their choice of communication modes according to user preferences the task at hand and the physical and social environment. We describe a multimodal application architecture which combines finite-state multimodal language processing a speech-act based multimodal dialogue manager dynamic multimodal output generation and user-tailored text planning to enable rapid prototyping of multimodal interfaces with flexible input and adaptive output. Our testbed application MATCH Multimodal Access To City Help provides a mobile multimodal speech-pen interface to restaurant and subway information for New York City. 1 Multimodal Mobile Information Access In urban environments tourists and residents alike need access to a complex and constantly changing body of information regarding restaurants theatre schedules transportation topology and timetables. This information is most valuable if it can be delivered effectively while mobile since places close and plans change. Mobile information access devices PDAs tablet PCs next-generation phones offer limited screen real estate and no keyboard or mouse making complex graphical interfaces cumbersome. Multimodal interfaces can address this problem by enabling speech and pen input and output combining speech and graphics See Andre 2002 for a detailed overview of previous work on multimodal input and output . Since mobile devices are used in different physical and social environments for different .