tailieunhanh - Báo cáo khoa học: "Using Conditional Random Fields to Extract Contexts and Answers of Questions from Online Forums"

Online forum discussions often contain vast amounts of questions that are the focuses of discussions. Extracting contexts and answers together with the questions will yield not only a coherent forum summary but also a valuable QA knowledge base. In this paper, we propose a general framework based on Conditional Random Fields (CRFs) to detect the contexts and answers of questions from forum threads. We improve the basic framework by Skip-chain CRFs and 2D CRFs to better accommodate the features of forums for better performance. Experimental results show that our techniques are very promising. . | Using Conditional Random Fields to Extract Contexts and Answers of Questions from Online Forums Shilin Ding f Gao Cong t Chin-Yew Linị Xiaoyan Zhuf fDepartment of Computer Science and Technology Tsinghua University Beijing China Department of Computer Science Aalborg University Denmark Microsoft Research Asia Beijing China dingsl@ gaocong@ cyl@ zxy-dcs@ Abstract Online forum discussions often contain vast amounts of questions that are the focuses of discussions. Extracting contexts and answers together with the questions will yield not only a coherent forum summary but also a valuable QA knowledge base. In this paper we propose a general framework based on Conditional Random Fields CRFs to detect the contexts and answers of questions from forum threads. We improve the basic framework by Skip-chain CRFs and 2D CRFs to better accommodate the features of forums for better performance. Experimental results show that our techniques are very promising. 1 Introduction Forums are web virtual spaces where people can ask questions answer questions and participate in discussions. The availability of vast amounts of thread discussions in forums has promoted increasing interests in knowledge acquisition and summarization for forum threads. Forum thread usually consists of an initiating post and a number of reply posts. The initiating post usually contains several questions and the reply posts usually contain answers to the questions and perhaps new questions. Forum participants are not physically co-present and thus reply may not happen immediately after questions are posted. The asynchronous nature and multiparticipants make multiple questions and answers Tliis work was done when Shilin Ding was a visiting student at the Microsoft Research Asia Uhis work was done when Gao Cong worked as a researcher at the Microsoft Research Asia. context id 1 S1 Hi I am looking for a pet friendly hotel in Hong Kong because all of my family is .

• Báo cáo khoa học
• Using Conditional Random Fields
• Extract Contexts
• Answers of Questions from Online Forums
• báo cáo khoa học
• báo cáo ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học