tailieunhanh - Báo cáo khoa học: "Phrase Linguistic Classification and Generalization for Improving Statistical Machine Translation"

In this paper a method to incorporate linguistic information regarding single-word and compound verbs is proposed, as a first step towards an SMT model based on linguistically-classified phrases. By substituting these verb structures by the base form of the head verb, we achieve a better statistical word alignment performance, and are able to better estimate the translation model and generalize to unseen verb forms during translation. Preliminary experiments for the English - Spanish language pair are performed, and future research lines are detailed. . | Phrase Linguistic Classification and Generalization for Improving Statistical Machine Translation Adria de Gispert TALP Research Center Universitat Politecnica de Catalunya UPC Barcelona agispert@ Abstract In this paper a method to incorporate linguistic information regarding single-word and compound verbs is proposed as a first step towards an SMT model based on linguistically-classified phrases. By substituting these verb structures by the base form of the head verb we achieve a better statistical word alignment performance and are able to better estimate the translation model and generalize to unseen verb forms during translation. Preliminary experiments for the English - Spanish language pair are performed and future research lines are detailed. 1 Introduction Since its revival in the beginning of the 1990s statistical machine translation SMT has shown promising results in several evaluation campaigns. From original word-based models results were further improved by the appearance of phrase-based translation models. However many SMT systems still ignore any morphological analysis and work at the surface level of word forms. For highly-inflected languages such as German or Spanish or any language of the Romance family this poses severe limitations both in training from parallel corpora as well as in producing a correct translation of an input sentence. This lack of linguistic knowledge in SMT forces the translation model to learn different translation probability distributions for all inflected forms of nouns adjectives or verbs vengo vienes viene etc. and this suffers from usual data sparseness. Despite the recent efforts in the community to provide models with this kind of information see Section 6 for details on related previous work results are yet to be encouraging. In this paper we address the incorporation of morphological and shallow syntactic information regarding verbs and compound verbs as a first step towards an SMT model based on .

• Báo cáo khoa học
• Phrase Linguistic Classification
• Generalization
• Improving Statistical Machine Translation
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học