Dòng Nội dung
1
2
Japanese speaking placement test : Validation of a task and an evaluation tool / Beukmann Fusako, Nemoto Aiko, Matsushita Tatsuhiko // Joural of japanese language teaching (日本語教育) No. 175, April 2020
Japan : The University of Tokyo, 2020
p. 146-154

Ideally, a placement speaking test should be administered to as many examiness as possible within a short period of timel the evaluation procedure should be simple and convenient, with highly reliable and valid resutls. To accomplish this, a Japanese speaking test task with an evaluation tool consisting of rubric and voice samples was developed. Test reliability and validity were verified with the implememtation of an experiment involving four Japanese teachers (raters) assessing the test results using the evaluation tool. The test task situation "refusal" was employed with 32 students from beginner to the advanced level participating. A high corresponding high correlation with the Simple Performance Oriented Test (SPOT) which requires aural skills. In contrast, there was a low correlation with written receptive skill; regardless, the criterion-related validity of this test was resonably and conclusively satisfied. The task and evaluation tools are well suited to evaliluate the learner's speaking ability, ensuring execellent reliability; assessing each learner's lavel required only one to two minutes with high consistency and correlation among raters. Although intermediate level assessments appear to be more challenging, this test task and evaluation tool can be very valuable as a Japanese speaking test.

3
Situational task ratings by non-speciallists : Validation of Japanese speaking test for placement / Nemoto Aiko, Beuckmann Fusako, Matsushita Tatsuhiko // Joural of japanese language teaching (日本語教育) No. 177, December 2020
Japan : The University of Tokyo, 2020
p. 1-16

In this study, 30 raters other than language teachers participated in a experiment where they were asked to rate the speking level of learners of Japanese in situational tasks, in oders to validate a speaking test designated as STAR (Speaking Test of Active Reaction), developed as a placement test by Beuckmann et al. (2020). From the analysis of the results, despite a possible insufficient discrimination of the intermadiate levels, STAR proved to have sufficient 'usefulness' (Bachman & Palmer, 1996), since STAR show it has good reliability, validity, and practicality. The analysis of rater's comment also found that: 10 naturalness and fluency are characteristics of the advanced level: 2) the perspectives used for content, text type, and interpersonal consideration differ between the intermediate-low and the intermediate-middle on ratings; and 30 the perspective for grammar differs between the intermediate-middle-middle and the intermediate-high. Furthermore, the analysis also revealed that there many positive comments for the inermediate-low level as they seem to be compared with the elementary level, while there were many negative comments for the intermediate-middle level relative to the advanced level.