tailieunhanh - Paraphrasing and Translation - part 5

Phương pháp đánh giá của chúng tôi có thể được tóm tắt những điểm chính sau đây: • Chúng tôi đánh giá chất lượng diễn giải bằng cách thay thế các cụm từ với diễn giải của họ, mời các bản án về những câu kết quả. • Chúng tôi đánh giá ý nghĩa và grammaticality để kết quả | . Evaluating paraphrase quality 65 the different contexts. Tables and show what adequacy and fluency scores were assigned by one of our judges for paraphrases of at work. The paraphrases given in the tables were generated for our different experimental conditions which are explained in Section . Summary and limitations Our evaluation methodology can be summarized by the following key points We evaluated paraphrase quality by replacing phrases with their paraphrases soliciting judgments about the resulting sentences. We evaluated both meaning and grammaticality so that our results would be as generally applicable as possible. We used established guidelines for evaluating adequacy and fluency rather than inventing ad hoc guidelines ourselves. We choose multiple occurrences of the original phrase and substituted each paraphrase into more than one sentences. We choose 2-10 sentences that the original phrase occurred with an average of sentences per phrase. We had two native English speakers produce judgments of each paraphrase and measured their agreement on the task using the Kappa statistic. The interannotator agreement for these judgements was K which is conventionally interpreted as good agreement. We acknowledge that our evaluation methodology is limited in two ways Firstly the adequacy scale might be slightly inappropriate forjudging the meaning of our paraphrases. The adequacy scale only allows for the possibility that a paraphrased sentence contains less information than in the original sentence but in some circumstances paraphrases may add more information for instance if force were paraphrased as military force . It would be worthwhile to have a category that reflected whether information was added and possibly a separate judgment about whether it was acceptable given the context. Secondly testing paraphrases through substitution might be limiting because a change in one part of the sentence may require a change in another part

crossorigin="anonymous">
Đã phát hiện trình chặn quảng cáo AdBlock
Trang web này phụ thuộc vào doanh thu từ số lần hiển thị quảng cáo để tồn tại. Vui lòng tắt trình chặn quảng cáo của bạn hoặc tạm dừng tính năng chặn quảng cáo cho trang web này.