tailieunhanh - Rater consistency in rating L2 learners’ writing task

This article discusses rater consistency in essay evaluation conducted by some randomly chosen raters in the Faculty of English, the University of Languages and International Studies, VNU and from that, some suggestions are made to improve the reliability in rating L2 learners’ essay writing. | VNU Journal of Science: Foreign Studies, Vol. 32, No. 2 (2016) 75-84 Rater Consistency in Rating L2 Learners’ Writing Task Nguyen Thi Quynh Yen* Center for Language Testing and Assessment, VNU University of Languages and International Studies Pham Van Dong, Cau Giay, Hanoi, Vietnam Received 18 March 2015 Revised 27 November 2015; Accepted 18 May 2016 Abstract: Rater consistency plays a critical part in the rating procedure. Test scores will be unreliable if examiners are inconsistent in their rating and fail to agree with other raters on the relative merits of rating scale, severity and leniency and so on. Despite the difficulty in matching the standard, writing paper is widely used in various kinds of language tests because it can provide not only a high motivation for writing, but also an excellent backwash effect on teaching. For this reason, it is necessary to establish high consistency in the scores given by one rater (intra-rater reliability) and by different raters (inter-rater reliability). This article discusses rater consistency in essay evaluation conducted by some randomly chosen raters in the Faculty of English, the University of Languages and International Studies, VNU and from that, some suggestions are made to improve the reliability in rating L2 learners’ essay writing. Keywords: Rater consistency, intra-rater reliability, inter-rater reliability, holistic scoring, analytical scoring. 1. Introduction* scoring validity of writing tests. Among these factors, rater reliability has been a matter of longstanding concern for many large-scale testing agencies. In test scores that are subjectively obtained such as ratings of essays, it is necessary to minimize the inconsistency in the scores given by one rater (intra-rater reliability) and by different raters (inter-rater reliability). The test scores will be unreliable if raters are inconsistent in their own rating and fail to agree with other raters on the relative merits of rating scale, severity .

• Ngôn ngữ học
• VNU Journal of Science
• Rater consistency in rating L2 learners’ writing task
• Rating L2 learners’ writing task
• The University of Languages and International Studies
• Intra rater reliability
• Data processing methods for deep level transients measurement
• Deep level transients measurement
• The Faculty of Physics
• VNU University of Science
• The main three approaches widely
• Journal of science
• Publications and trends of research in foreign language majors
• VNU university of languages and international studies
• A preliminary survey
• Dissertations by master and doctoral students
• Abbreviation detection in Vietnamese clinical texts
• Science Abbreviation detection
• Vietnamese clinical texts
• The readability of the records
• metamorphism
• earth sciences
• Research
• scientific research
• scientific reports
• HydrodynamicEnvironmental
• Bathymetry Mapping
• Estimation
• DETERMINING FLOW
• ASTER Data
• HANOI BUS
• Characteristics
• GEOLOGICAL MAP
• evapotranspiration
• biosolids application
• Environmental
• Assessment
• Photochemical
• remote sensing
• Building land
• Classification
• Landscape
• Thunderstorm forecast
• submerged
• Cu concentration