tailieunhanh - Báo cáo khoa học: "Neural Network Recognition of Spelling Errors"

One area in which artificial neural networks (ANNs) may strengthen NLP systems is in the identification of words under noisy conditions. In order to achieve this benefit when spelling errors or spelling variants are present, variable-length strings of symbols must be converted to ANN input/output form--fixed-length arrays of numbers. A common view in the neural network community has been that different forms of input/output representations have negligible effect on ANN performance. | Neural Network Recognition of Spelling Errors Mark Lewellen Computational Linguistics Georgetown University Washington DC 20057-1051 m lewel len@ Abstract One area in which artificial neural networks ANNs may strengthen NLP systems is in the identification of words under noisy conditions. In order to achieve this benefit when spelling errors or spelling variants are present variable-length strings of symbols must be converted to ANN input output form fixed-length arrays of numbers. A common view in the neural network community has been that different forms of input output representations have negligible effect on ANN performance. This paper however shows that input output representations can in fact affect the performance of ANNs in the case of natural language words. Minimum properties for an adequate word representation are proposed as well as new methods of word representation. To test the hypothesis that word representations significantly affect ANN performance traditional and new word representations are evaluated for their ability to recognize words in the presence of four types of typographical noise substitutions insertions deletions and reversals of letters. The results indicate that word representations have a significant effect on ANN performance. Additionally different types of word representation are shown to perform better on different types of error. Introduction ANNs are a promising technology for NLP since a strength of ANNS is their common sense ability to make reasonable decisions even when faced with novel data while a weakness of NLP applications is brittleness in the face of ambiguous situations. One area in which much ambiguity occurs is the identification of words words may be misspelled they may have valid spelling variants and they can be homographic. Robust word recognition capabilities can improve applications which involve text understanding and are the central component of applications such as spell-checking and name .

• Báo cáo khoa học
• Neural Network Recognition
• Spelling Errors
• Mark Lewellen
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Bài giảng Xử lý ngôn ngữ tự nhiên
• Ngôn ngữ tự nhiên
• Kỹ thuật lập trình
• Xử lý nhập nhằng ngữ nghĩa
• Xử lý ngữ nghĩa
• Xử lý ngôn ngữ
• Natural Language Processing
• Ngôn ngữ lập trình
• Nhập nhằng cấu trúc
• Tri thức về ngôn ngữ
• Mô hình n gram
• Dịch máy
• Phương pháp dịch máy
• Hiểu ngôn ngữ
• Phân tích ngữ nghĩa
• Phân loại tin tự động
• Biểu diễn vị từ
• Thuộc tính về sự kiện
• Thuộc tính về sự kiện
• Mô hình ngôn ngữ Google Book N grams
• Mô hình ngôn ngữ KenLM
• Phương pháp làm mịn
• Tách từ tiếng Việt
• Gán nhãn từ loại
• Phân tích cú pháp
• Nghĩa từ vựng
• Phân giải nhập nhằng từ
• Phân loại văn bản
• Lexical chain
• Phản hồi thông tin
• Bài toán PTCP
• Cấu trúc ngữ pháp
• Phân tích cú pháp xác suất
• CKY kết hợp xác suất
• Văn phạm phi ngữ cảnh xác suất
• Hình thái học