tailieunhanh - Báo cáo khoa học: "The Contribution of Linguistic Features to Automatic Machine Translation Evaluation"

A number of approaches to Automatic MT Evaluation based on deep linguistic knowledge have been suggested. However, n-gram based metrics are still today the dominant approach. The main reason is that the advantages of employing deeper linguistic information have not been clarified yet. In this work, we propose a novel approach for meta-evaluation of MT evaluation metrics, since correlation cofficient against human judges do not reveal details about the advantages and disadvantages of particular metrics. . | The Contribution of Linguistic Features to Automatic Machine Translation Evaluation Enrique Amigo1 Jesus Gimenez2 Julio Gonzalo 1 Felisa Verdejo1 1UNED Madrid enrique julio felisa @ 2UPC Barcelona jgimenez@ Abstract A number of approaches to Automatic MT Evaluation based on deep linguistic knowledge have been suggested. However n-gram based metrics are still today the dominant approach. The main reason is that the advantages of employing deeper linguistic information have not been clarified yet. In this work we propose a novel approach for meta-evaluation of MT evaluation metrics since correlation cofficient against human judges do not reveal details about the advantages and disadvantages of particular metrics. We then use this approach to investigate the benefits of introducing linguistic features into evaluation metrics. Overall our experiments show that i both lexical and linguistic metrics present complementary advantages and ii combining both kinds of metrics yields the most robust metaevaluation performance. 1 Introduction Automatic evaluation methods based on similarity to human references have substantially accelerated the development cycle of many NLP tasks such as Machine Translation Automatic Summarization Sentence Compression and Language Generation. These automatic evaluation metrics allow developers to optimize their systems without the need for expensive human assessments for each of their possible system configurations. However estimating the system output quality according to its similarity to human references is not a trivial task. The main problem is that many NLP tasks are open subjective therefore different humans may generate different outputs all of them equally valid. Thus language variability is an issue. In order to tackle language variability in the context of Machine Translation a considerable effort has also been made to include deeper linguistic information in automatic evaluation metrics both syntactic and .

• Báo cáo khoa học
• The Contribution
• Linguistic Features
• Automatic Machine Translation Evaluation
• báo cáo khoa học
• báo cáo ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• En linguistique Contribution
• Unpoint de vue théorique
• Linguistique Contribution
• Les classifications dergonomie servent
• Évaluation et inter sujet
• Climate change
• Mitigation strategies
• Livestock contribution
• Livestock contribution to climate change
• High priorities
• BMC Bioinformatics
• Optimum contribution selection
• Animal breeding
• Segment based kinship
• Native kinship
• Native contribution
• Runs of homozygosity
• Yield attributes
• Soybean (Glycine max L Merril)
• Yield of soybean
• Major nutrient contribution on growth
• Assessment of major nutrient contribution
• tmilitary
• experience
• training
• aptitude
• contribution
• performance
• findings
• productivity
• personnel
• review
• determinants
• press
• sir
• winston
• churchill
• dodo
• idea
• american
• The Contribution of Stylistic Information
• Dae Neung Sohn and Jung Tae Lee and Hae Chang Rim
• Content based Mobile Spam Filtering
• THE CONTRIBUTION OF PARSING TO PROSODIC PHRASING IN
• EXPERIMENTAL TEXT TO SPEECH SYSTEM
• Joan Bachenko Eileen Fitzpatrick
• scientific reports
• model language
• process natural language
• Pediatric chest imaging
• Classic chest radiology findings
• The pediatric chest
• P he pediatric chest
• Nuclear medicine to pulmonary
• Helical multidetector chest CT
• Vietnam Journal of Chemistry
• The contribution of free radicals in paracetamol degradation
• Free radicals in paracetamol degradation by UV NaClO
• Emerging advanced oxidation process
• UV Chlorine process
• Cost volume profit analysis
• Managerial accounting
• Dynamic business environment
• Cost management
• Contribution margin approach
• Contribution margin ratio
• Kế toán quản trị
• Data envelopment analysis
• Cross efficiency
• Contribution of inputs and outputs
• Non zero weights
• Decision making units
• Vietnam journal of earth sciences
• Fluid characteristics from shallow magmatic environments
• Contribution to danburite bearing Luc Yen pegmatites
• Shallow magmatic environments
• Fluid inclusions show the same chemistry
• A contribution to the understanding
• Understanding of Confucianism
• Confucianism in Vietnam
• Politicosocial doctrine
• The mankind which plays as a foundation
• The understanding of confucianism
• Practices associated
• The religious perspective
• During its existence
• Livestock rearing contribution towards
• Beneficiary and nonbeneficiary
• Watershed development programme
• Purposely selected
• Multi stage random purposive
• The contribution of labelling
• Safe medication administration
• Labelling to safe medication administration
• Anaesthetic practice
• Drug error
• Logistic contribution from the Vision of the technical services
• The hotel industry
• The Vision of the technical services
• The application of multivariate statistics
• Ensuring civil and political rights in Vietnam
• Some theoretical legal
• Political rights in Vietnam
• Solution is proposed to make a contribution
• Vietnam in the near future
• Contribution to ensuring civil
• Building trust through customer satisfaction in the airline industry
• The airline industry in Indonesia
• Service quality and price fairness contribution
• Service quality and price fairness
• Optimum service quality
• Summary of Doctoral thesis
• Summary of Doctoral thesis in Economics
• Contribution of banking credit
• New rural construction
• Banking credit