tailieunhanh - Báo cáo khoa học: "Automatic Identification of Non-compositional Phrases"

Non-compositional expressions present a special challenge to NLP applications. We present a method for automatic identification of non-compositional expressions using their statistical properties in a text corpus. Our method is based on the hypothesis that when a phrase is non-composition, its mutual information differs significantly from the mutual informations of phrases obtained by substituting one of the word in the phrase with a similar word. | Automatic Identification of Non-compositional Phrases Dekang Lin Department of Computer Science University of Manitoba Winnipeg Manitoba Canada R3T 2N2 an lindek@ UMIACS University of Maryland College Park Maryland 20742 lindek@ Abstract Non-compositional expressions present a special challenge to NLP applications. We present a method for automatic identification of non-compositional expressions using their statistical properties in a text corpus. Our method is based on the hypothesis that when a phrase is non-composition its mutual information differs significantly from the mutual informations of phrases obtained by substituting one of the word in the phrase with a similar word. 1 Introduction Non-compositional expressions present a special challenge to NLP applications. In machine translation word-for-word translation of non-compositional expressions can result in very misleading sometimes laughable translations. In information retrieval expansion of words in a non-compositional expression can lead to dramatic decrease in precision without any gain in recall. Less obviously non-compositional expressions need to be treated differently than other phrases in many statistical or corpus-based NLP methods. For example an underlying assumption in some word sense disambiguation systems . Da-gan and Itai 1994 Li et al. 1995 Lin 1997 is that if two words occurred in the same context they are probably similar. Suppose we want to determine the intended meaning of product in hot product . We can find other words that are also modified by hot . hot car and then choose the meaning of product that is most similar to meanings of these words. However this method fails when non-compositional expressions are involved. For instance using the same algorithm to determine the meaning of line in hot line the words product merchandise car etc. would lead the algorithm to choose the line of product sense of line . We present a method for automatic .

• Báo cáo khoa học
• Automatic Identification
• Non compositional Phrases
• Dekang Lin
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• Folk songs
• Vietnamese folk Songs Cheo
• Automatic identification of Vietnamese
• Gaussian mixture model
• Industrial applications
• An efficient method
• Automatic recognizing
• Identification card
• Automatic recognizing text fields
• Automatic Identification of Pro
• Con Reasons in Online Reviews
• Soo Min Kim and Eduard Hovy
• Examining the Role
• Linguistic Knowledge Sources in the Automatic Identification
• Classification of Reviews
• Implementing a Characterization of Genre
• Automatic Genre Identification
• Web Pages
• Automatic Identification of Word Translations
• Unrelated English
• German Corpora
• Knowledge based Automatic Topic Identification
• Chin Yew Lin
• Long Papers
• TOWARDS THE AUTOMATIC IDENTIFICATION
• ADJECTIVAL SCALES
• CLUSTERING ADJECTIVES ACCORDING TO MEANING
• TOWARDS AN AUTOMATIC IDENTIFICATION
• TOPIC AND FOCUS
• Workshops
• scientific reports
• model language
• process natural language
• Journal of Computer Science and Cybernetics
• Automatic identification of Vietnamese dialects
• Faculty of Information Technology
• Mel frequency Cepstral Coefficients
• BMC Bioinformatics
• Single cell RNA sequencing
• Cell type identification
• Bone marrow
• Molecular signatures
• báo cáo hóa học
• công trình nghiên cứu về hóa học
• tài liệu về hóa học
• cách trình bày báo cáo
• báo cáo y học
• công trình nghiên cứu về y học
• tài liệu về y học
• AIS Capabilities
• Operating Parameters
• Shipboard Displays
• Determining Requirements
• Interface Design
• Skill Requirements
• Tạp chí Khoa học Công nghệ Hàng hải
• Hệ thống tự động nhận dạng
• Đặc tính của hệ thống tự động nhận dạng
• Phòng ngừa đâm va trên biển
• Automatic Identification System
• Positioning method
• Time of arrival
• Marine vessel positioning based on AIS signals
• Time of arrival estimation method
• Taxonomic identification
• Phylogenetic position
• Archaeal organisms
• 16S DNA sequences
• Genome Biology
• Cell identity
• Single cell transcriptomics
• Cellular composition
• Analysis pipelines
• Cell identities
• NaI(Tl) scintillation detector
• Spectrum stabilization
• Peak detection
• Spectrum analysis
• Geiger Muller counters
• International Journal of Computer Networks and Communications Security
• An efficient fingerprint compression algorithm using sparse coding
• Efficient fingerprint compression
• Computing l0 minimization
• Automatic Fingerprint identification