tailieunhanh - Báo cáo khoa học: "Evaluating Smoothing Algorithms against Plausibility Judgements"

Previous research has shown that the plausibility of an adjective-noun combination is correlated with its corpus co-occurrence frequency. In this paper, we estimate the co-occurrence frequencies of adjective-noun pairs that fail to occur in a 100 million word corpus using smoothing techniques and compare them to human plausibility ratings. Both class-based smoothing and distance-weighted averaging yield frequency estimates that are significant predictors of rated plausibility, which provides independent evidence for the validity of these smoothing techniques. . | Evaluating Smoothing Algorithms against Plausibility Judgements Maria Lapata and Frank Keller Department of Computational Linguistics Saarland University POBox 15 11 50 66041 Saarbrucken Germany mlap keller @ Scott McDonald Language Technology Group University of Edinburgh 2 Buccleuch Place Edinburgh EH8 9LW UK scottm@ Abstract Previous research has shown that the plausibility of an adjective-noun combination is correlated with its corpus co-occurrence frequency. In this paper we estimate the co-occurrence frequencies of adjective-noun pairs that fail to occur in a 100 million word corpus using smoothing techniques and compare them to human plausibility ratings. Both class-based smoothing and distance-weighted averaging yield frequency estimates that are significant predictors of rated plausibility which provides independent evidence for the validity of these smoothing techniques. 1 Introduction Certain combinations of adjectives and nouns are perceived as more plausible than others. A classical example is strong tea which is highly plausible as opposed to powerful tea which is not. On the other hand powerful car is highly plausible whereas strong car is less plausible. It has been argued in the theoretical literature that the plausibility of an adjective-noun pair is largely a collocational . idiosyncratic property in contrast to verb-object or noun-noun plausibility which is more predictable Cruse 1986 Smadja 1991 . The collocational hypothesis has recently been investigated in a corpus study by Lapata et al. 1999 . This study investigated potential statistical predictors of adjective-noun plausibility by using correlation analysis to compare judgements elicited from human subjects with five corpus-derived measures co-occurrence frequency of the adjective-noun pair noun frequency conditional probability of the noun given the adjective the log-likelihood ratio and Resnik s 1993 selectional association measure. All predictors but one

• Báo cáo khoa học
• Evaluating Smoothing Algorithms
• Plausibility Judgements
• Maria Lapata and Frank Keller
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học