tailieunhanh - Báo cáo khoa học: "Correcting a PoS-tagged corpus using three complementary methods"

The quality of the part-of-speech (PoS) annotation in a corpus is crucial for the development of PoS taggers. In this paper, we experiment with three complementary methods for automatically detecting errors in the PoS annotation for the Icelandic Frequency Dictionary corpus. The first two methods are language independent and we argue that the third method can be adapted to other morphologically complex languages. Once possible errors have been detected, we examine each error candidate and hand-correct the corresponding PoS tag if necessary. . | Correcting a PoS-tagged corpus using three complementary methods Hrafn Loftsson School of Computer Science Reykjavik University Reykjavik Iceland hrafn@ Abstract The quality of the part-of-speech PoS annotation in a corpus is crucial for the development of PoS taggers. In this paper we experiment with three complementary methods for automatically detecting errors in the PoS annotation for the Icelandic Frequency Dictionary corpus. The first two methods are language independent and we argue that the third method can be adapted to other morphologically complex languages. Once possible errors have been detected we examine each error candidate and hand-correct the corresponding PoS tag if necessary. Overall based on the three methods we hand-correct the PoS tagging of 1 334 tokens of the tokens in the corpus. Furthermore we re-evaluate existing state-of-the-art PoS taggers on Icelandic text using the corrected corpus. 1 Introduction Part-of-speech PoS tagged corpora are valuable resources for developing PoS taggers . programs which automatically tag each word in running text with morphosyntactic information. Corpora in various languages such as the English Penn Treebank corpus Marcus et al. 1993 the Swedish Stockholm-Umeả corpus Ejerhed et al. 1992 and the Icelandic Frequency Dictionary IFD corpus Pind et al. 1991 have been used to train in the case of data-driven methods and develop in the case of linguistic rule-based methods different taggers and to evaluate their accuracy . van Halteren et al. 2001 Megyesi 2001 Loftsson 2006 . Consequently the quality of the PoS annotation in a corpus the gold standard annotation is crucial. Many corpora are annotated semi-automatically. First a PoS tagger is run on the corpus text and then the text is hand-corrected by humans. Despite human post-editing large tagged corpora are almost certain to contain errors because humans make mistakes. Thus it is important to apply known methods and or develop new methods for .

• Báo cáo khoa học
• Correcting a PoS tagged corpus
• three complementary methods
• Hrafn Loftsson
• scientific reports
• model language
• process natural language
• Dialog Control
• Natural Language System
• Dialog Control in a Natural Language System
• Expanding the Horizons
• Natural Language Interfaces
• Phil Hayes
• PROSPECTS OR PRACTICAL
• NATURAL LANGUAGE SYSTEMS
• Workshops
• NATURAL LANGUAGE
• INTERACTION WITH MACHINES
• Long Papers
• COMPUTER INTEBFACE DESIGN MURRAY TUROFF DEPARTMENT OF COMPUTER
• IiVFORMATION SCIENCE IIEW JERSEY INSTITUTE OF TECHNOLOGY
• EVALUATION OF NATURAL LANGUAGE
• INTERFACES TO DATABASE SYSTEMS
• A PANEL DISCUSSION
• database query system
• J
• Norwood Crout
• INTERFACES TO DATA BASE SYSTEMS
• Bozena Henisz
• INTERPRETING NATURAL LANGUAGE
• DATABASE UPDATES
• S
• Jermld Kaplan Jim David
• TRANSPORTABLE NATURAL LANGUAGE
• INTERFACES TO DATABASES
• Gary G
• Hendrlx and William H
• Lewis
• DATABASES THEORETICAL
• TECHNICAL ISSUES
• TRANSPORTABLE NATURAL LANGUAGE INTERFACES
• PROBLEMS AND TECHNIQUES
• Barbara J
• Grosz
• THEORETICAL TECHNICAL ISSUES
• NATURAL LANGUAGE ACCESS TO DATABASES
• R
• Petrick
• Domain Independent
• Database Access Systems
• ISSUES IN NATURAL LANGUAGE
• ACCESS TO DATABASES
• A LOGIC PROGRAMMING PERSPECTIVE
• Sharon C
• Salveter David Maier
• PLANNING NATURAL LANGUAGE
• EXPRESSIONS REFERRING
• Douglas E
• Appelt
• THE TEXT SYSTEM
• NATURAL LANGUAGE GENERATION
• Kathleen R
• M
• MENTING A DATABASE
• KNOWLEDGE REPRESENTATION
• THE KEY TO THE SELECTION PROBLEM
• E
• Jeffrey Conklin David D
• McDonald
• A KNOWLEDGE ENGINEERING
• NATURAL LANGUAGE UNDERSTANDING
• Stuart C
• Shapiro
• NATURAL LANGUAGE TEXTS
• NECESSARILY GRAMMATICAL
• EVEN COMPLETE
• UNGRAMHATICALITY
• EXTRA GRAMMATICALITY
• NATURAL LANGUAGE UNDERSTANDING SYSTEMS
• Taxonomy
• Descriptions
• Individuals in Natural
• Language Understanding
• The Use of Ooject Special Knowledge
• Natural Language Processing
• Mark H
• Bursteln