Table 6 Criteria for evaluating nonnative Japanese writing quality.
From: Applying large language models for automated essay scoring for non-native Japanese
Level | Lexical richness | Grammatical accuracy | Cohesion |
|---|---|---|---|
A1 | The lexicon is extremely limited with few recognizable strings | There is little or no evidence of sentence forms. | There is little relevant message, of the entire response may be off-topic |
A2 | The lexicon is limited and inadequate for or unrelated to the task. Vocabulary is basic and may be used repetitively. | A very limited range of structures is used. Subordinate clauses are rare; simple sentences predominate. | Information and ideas are evident but not arranged coherently; There is no clearer progression within the response. |
B1 | The lexicon is generally adequate and appropriate. The meaning is generally clear in spite of a rather restricted range or a lack of precision in word choice. | A mix of simple and complex sentence forms is used but flexibility is limited. Examples of more complex structures are not marked by the same level of accuracy as in simple structures. | Information and ideas are generally arranged coherently and there is a clear overall progression. Cohesive devices are used to some good effect but cohesion within and/ or mechanical due to misuse, overuse, or omission. |
B2 | The resource is sufficient to allow some flexibility and precision. There is some ability to use less common and/or idiomatic items. | A variety of complex structures is used with some flexibility and accuracy. | Information and ideas are logically organized and there is a clear progression throughout the response. A range of cohesive devices including reference and substitution is used flexibility but with some inaccuracies or some over/under use. |
C1 | Diverse lexicon is fluently and flexibly used to convey precise meanings within the scope of the task. There is skillful use of uncommon and or idiomatic items when appropriate, despite occasional inaccuracies in word choice and collocation. | A wide range of structures within the scope of the task is flexibility and accurately used. The majority of sentences are error-free. | The message can be followed with ease. Information and ideas are logically sequenced. Cohesion is well managed. Occasional lapses in coherence or cohesion may occur. Paragraphing is used sufficiently and appropriately. |
C2 | Full flexibility and precise use are evident within the scope of the task. A wide range of vocabulary is used accurately and appropriately with very natural and sophisticated control of lexical features. | A wide range of structures within the scope of the task is used with full flexibility and control. | The message can be followed effortlessly. Cohesion is used in such a way but it very rarely attracts attention. Any lapses in coherence or cohesion are minimal. |