Development of Integrated Language Skills Assessment Instruments for Korean as a Foreign Language Learning in Higher Education

Nuraziza Aliah; Nurasia Natsir

doi:10.61132/ijed.v2i2.288

Authors

Nuraziza Aliah Universitas Terbuka
Nurasia Natsir Sekolah Tinggi Ilmu Administrasi YAPPI Makassar

DOI:

https://doi.org/10.61132/ijed.v2i2.288

Keywords:

Communicative competence, Higher education pedagogy, Integrated language assessment, Korean as a foreign language, Task-based assessment

Abstract

This study explores the development of integrated language skills assessment instruments for Korean as a foreign language (KFL) learners in higher education, addressing the need for tools that reflect real-world communicative demands. Grounded in theoretical frameworks such as Bachman and Palmer's Communicative Language Ability model[1] and Vygotsky's Sociocultural Theory[2], the research employed a mixed-methods approach, including needs analysis[6], corpus studies, and pilot testing. The research process involved three primary phases: First, a comprehensive needs analysis was conducted among KFL instructors and students to identify assessment gaps and priorities. Second, authentic Korean language materials were collected to create a corpus that informed the development of contextualized assessment tasks. Finally, the instruments underwent rigorous pilot testing with 127 KFL students across three Indonesian universities.The developed assessment instruments integrate reading, writing, listening, and speaking skills through task-based scenarios that mirror authentic Korean language use contexts. These include collaborative problem-solving activities, multimedia-based comprehension tasks, and culturally situated role-plays. Statistical analysis demonstrated high inter-rater reliability (r=0.87) and construct validity when compared with established Korean proficiency measures.Results demonstrated the instruments' reliability, validity, and cultural relevance, fostering holistic skill development and promoting positive washback on teaching and learning practices. Implementation of these instruments led to significant improvements in students' integrated language performance and motivation. The study contributes to the field of Korean language assessment by providing empirically validated tools that bridge classroom learning with real-world language application in higher education contexts.

References

D. Shin and H. Kim, “Technology-enhanced assessment in Korean language education: Current practices and future directions,” CALICO Journal, vol. 38, no. 2, pp. 211–232, 2021, doi: 10.1558/cj.41524.

E. H. Jeon, “Multiple-modality assessment for Korean language learners: Integrating speaking and writing skills,” Language Testing, vol. 36, no. 2, pp. 219–241, 2019, doi: 10.1177/0265532218798191.

H. J. Lee and S. Kim, “Assessing intercultural competence in Korean language education: A mixed-methods approach,” International Journal of Korean Language Education, vol. 6, no. 1, pp. 87–112, 2020, doi: 10.18207/ijkle.2020.6.1.87.

H. Kang and A. Brown, “Reliability and validity of integrated performance assessment in Korean language education,” Language Assessment Quarterly, vol. 17, no. 4, pp. 395–417, 2020, doi: 10.1080/15434303.2020.1777630.

H. Kim and H. Shin, “Developing integrated performance assessment tasks for Korean language learners in Indonesia,” Foreign Language Annals, vol. 55, no. 1, pp. 135–158, 2022, doi: 10.1111/flan.12597.

H. Yoo and J. Lee, “Stakeholder perspectives on integrated skills assessment in Korean language programs: A qualitative inquiry,” Korean Language Education Research, vol. 27, no. 2, pp. 145–173, 2021, doi: 10.21731/kler.2021.27.2.145.

I. Choi and S. Park, “Diagnostic assessment of Korean language proficiency: Identifying areas for targeted instruction,” Language Testing, vol. 37, no. 4, pp. 512–534, 2020, doi: 10.1177/0265532220912150.

J. H. Lee, “Sociocultural approaches to language assessment: Theoretical foundations and practical applications in Korean language education,” Language and Education, vol. 33, no. 2, pp. 174–191, 2019, doi: 10.1080/09500782.2018.1553848.

J. J. Song, “Developing and validating a culture-integrated assessment framework for Korean as a foreign language,” International Journal of Bilingual Education and Bilingualism, vol. 23, no. 4, pp. 469–487, 2020, doi: 10.1080/13670050.2019.1693956.

J. Kim and H. Nam, “Integrated assessment of Korean language skills: Challenges and opportunities in higher education contexts,” Korean Language Education, vol. 31, no. 2, pp. 115–142, 2020, doi: 10.18209/kledu.2020.31.2.115.

J. Park and E. Suh, “Digital literacy and multimodal assessment in Korean language learning,” ReCALL, vol. 33, no. 2, pp. 133–150, 2021, doi: 10.1017/S0958344021000033.

J. Y. Kang and Y. S. Kim, “Collaborative writing assessment in Korean as a foreign language: Effects on student performance and perceptions,” Assessing Writing, vol. 41, pp. 36–54, 2019, doi: 10.1016/j.asw.2019.05.002.

K. Park and J. Lee, “Development and validation of an instrument for assessing Korean writing skills in academic contexts,” Language Testing in Asia, vol. 10, no. 12, pp. 1–23, 2020, doi: 10.1186/s40468-020-00111-4.

L. F. Bachman and A. S. Palmer, Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press, 2010.

L. S. Vygotsky, Mind in society: The development of higher psychological processes. Harvard University Press, 1978.

M. Cho and T. Kim, “Washback effects of integrated skills assessment on Korean language teaching,” Language Testing, vol. 36, no. 3, pp. 375–399, 2019, doi: 10.1177/0265532219828253.

M. Kim and J. Park, “Corpus-informed assessment of lexical competence in Korean as a foreign language,” Language Assessment Quarterly, vol. 16, no. 4, pp. 350–372, 2019, doi: 10.1080/15434303.2019.1648468.

M. Nam and S. Lee, “Intercultural communicative competence assessment in Korean language education: A systematic review,” System, vol. 97, p. 102452, 2021, doi: 10.1016/j.system.2021.102452.

M. Park and J. Lee, “Needs analysis for Korean language assessment in Indonesian higher education,” Journal of Language Teaching and Research, vol. 13, no. 4, pp. 781–793, 2022, doi: 10.17507/jltr.1304.09.

S. J. Youn, “Task-based needs analysis of Korean as a foreign language: A case study of university students,” Korean Language Education Research, vol. 24, no. 3, pp. 217–246, 2018, doi: 10.21731/kler.2018.24.3.217.

S. Jung and S. C. Rhee, “Developing and validating integrated listening-speaking assessment for Korean as a foreign language,” Language Testing, vol. 39, no. 2, pp. 253–279, 2022, doi: 10.1177/02655322211053484.

S. K. Shin, “Task-based language assessment of Korean: Principles and practice,” Language Testing in Asia, vol. 8, no. 14, pp. 1–18, 2018, doi: 10.1186/s40468-018-0068-1.

S. Lee and K. Jung, “Developing authentic assessment tools for Korean as a foreign language: A mixed-methods approach,” Applied Linguistics, vol. 42, no. 3, pp. 455–478, 2021, doi: 10.1093/applin/amaa044.

Y. Jung and Y. Kim, “Authentic assessment of Korean pragmatic competence: Development and validation,” Journal of Pragmatics, vol. 167, pp. 68–89, 2020, doi: 10.1016/j.pragma.2020.06.005.

Y. Kim and H. Lee, “Corpus-based development of Korean language assessment instruments for academic purposes,” Korean Journal of Applied Linguistics, vol. 37, no. 3, pp. 89–114, 2021, doi: 10.17154/kjal.2021.37.3.004.