tailieunhanh - Báo cáo khoa học: "Syntax-Based Word Ordering Incorporating a Large-Scale Language Model"

A fundamental problem in text generation is word ordering. Word ordering is a computationally difficult problem, which can be constrained to some extent for particular applications, for example by using synchronous grammars for statistical machine translation. There have been some recent attempts at the unconstrained problem of generating a sentence from a multi-set of input words (Wan et al., 2009; Zhang and Clark, 2011). By using CCG and learning guided search, Zhang and Clark reported the highest scores on this task. One limitation of their system is the absence of an N-gram language model, which has been used by. | Syntax-Based Word Ordering Incorporating a Large-Scale Language Model Yue Zhang University of Cambridge Computer Laboratory yz360@ Graeme Blackwood University of Cambridge Engineering Department gwb24@ Stephen Clark University of Cambridge Computer Laboratory sc609@ Abstract A fundamental problem in text generation is word ordering. Word ordering is a computationally difficult problem which can be constrained to some extent for particular applications for example by using synchronous grammars for statistical machine translation. There have been some recent attempts at the unconstrained problem of generating a sentence from a multi-set of input words Wan et al. 2009 Zhang and Clark 2011 . By using CCG and learning guided search Zhang and Clark reported the highest scores on this task. One limitation of their system is the absence of an N-gram language model which has been used by text generation systems to improve fluency. We take the Zhang and Clark system as the baseline and incorporate an N-gram model by applying online large-margin training. Our system significantly improved on the baseline by BLEU points. 1 Introduction One fundamental problem in text generation is word ordering which can be abstractly formulated as finding a grammatical order for a multiset of words. The word ordering problem can also include word choice where only a subset of the input words are used to produce the output. Word ordering is a difficult problem. Finding the best permutation for a set of words according to a bigram language model for example is NP-hard which can be proved by linear reduction from the traveling salesman problem. In practice exploring the whole search space of permutations is often prevented by adding constraints. In phrase-based machine translation Koehn et al. 2003 Koehn et al. 2007 a distortion limit is used to constrain the position of output phrases. In syntax-based machine translation systems such as Wu 1997 and Chiang 2007

• Báo cáo khoa học
• Syntax Based Word Ordering Incorporating
• Large Scale Language Model
• Yue Zhang
• scientific reports
• model language
• process natural language
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln