Cultural Responsiveness in Language Assessment: Developing Equitable Evaluation Frameworks for Diverse Linguistic Communities

Amiruddin Amiruddin; Nurasia Natsir; Erminawati Erminawati; Fatimah Muhajir

doi:10.35445/alishlah.v17i4.8201

Cultural Responsiveness in Language Assessment: Developing Equitable Evaluation Frameworks for Diverse Linguistic Communities

Amiruddin Amiruddin, Nurasia Natsir, Erminawati Erminawati, Fatimah Muhajir

Abstract

Indonesia’s linguistic diversity, with over 700 regional languages, challenges traditional language assessment practices that privilege monolingual norms and marginalize multilingual learners. Existing frameworks often overlook cultural assets and translanguaging practices essential to equitable evaluation. This study employed a sequential three-phase mixed-methods design. Phase 1 involved a systematic review of 247 articles and 18 policy documents. Phase 2 included participatory co-design with 84 educators and 156 community stakeholders across five Indonesian metropolitan areas. Phase 3 validated the resulting Culturally Responsive Language Assessment Framework (CRLAF) with 1,247 students and 94 teachers using both quantitative (CFA, RMSEA, reliability tests) and qualitative analyses. CRLAF significantly improved academic self-efficacy (d = 1.42), reduced assessment anxiety (d = –1.89), and increased both Indonesian language confidence and regional language pride. Academic achievement scores improved (d = 0.72), and achievement gaps among ethnic groups narrowed by up to 54%. The framework achieved high reliability (α = 0.94) and strong cultural validity across ethnic and linguistic groups. CRLAF reframes assessment as culturally empowering rather than exclusionary. By integrating local values (e.g., gotong royong, bhinneka tunggal ika) and translanguaging practices, it aligns psychometric rigor with cultural fairness. The framework offers scalable implications for Indonesian education policy and serves as a model for multilingual, postcolonial contexts globally.

Keywords

culturally responsive assessment; translanguaging; equity in education; multilingualism; assessment framework

Full Text:

PDF

References

Adam, H., & Byrne, M. (2024). ‘I’m not from a country, I’m from Australia.’ Costumes, scarves, and fruit on their heads: The urgent need for Culturally Responsive Pedagogy when sharing diverse books with children. Australian Educational Researcher, 51(4), 1121–1140. https://doi.org/10.1007/s13384-023-00631-x

Arcos-Pumarola, J., Paquin, A. G., & Sitges, M. H. (2023). The use of intangible heritage and creative industries as a tourism asset in the UNESCO creative cities network. Heliyon, 9(1).

Au, A. (2019). Thinking about cross-cultural differences in qualitative interviewing: Practices for more responsive and trusting encounters. Qualitative Report, 24(1), 58–77. https://doi.org/10.46743/2160-3715/2019.3403

Beaudrie, S. (2023). Developing Critical Language Awareness in the Heritage Language Classroom: Implementation and Assessment in Diverse Educational Contexts. Languages, 8(1), 1–6. https://doi.org/10.3390/languages8010081

Bürgin, A. (2021). The european commission. In Environmental Policy in the EU (pp. 93–109). Routledge.

Chauhan, A., Walpola, R. L., Manias, E., Seale, H., Walton, M., Wilson, C., … Harrison, R. (2021). How do health services engage culturally and linguistically diverse consumers? An analysis of consumer engagement frameworks in Australia. Health Expectations, 24(5), 1747–1762. https://doi.org/10.1111/hex.13315

D’Andrea Martínez, P., Peoples, L. Q., & Martin, J. (2023). Becoming Culturally Responsive: Equitable and Inequitable Translations of CRE Theory into Teaching Practice. Urban Review, 55(4), 476–504. https://doi.org/10.1007/s11256-023-00658-5

Hardiansyah, F., & Zainuddin, Z. (2022). The Influence of Principal’s Motivation, Communication, and Parental Participation on Elementary School Teachers’ Performance. Al Ibtida: Jurnal Pendidikan Guru MI, 9(2), 319–334. https://doi.org/10.24235/al.ibtida.snj.v9i2.9936

Harrison, R., Walton, M., Chitkara, U., Manias, E., Chauhan, A., Latanik, M., & Leone, D. (2020). Beyond translation: Engaging with culturally and linguistically diverse consumers. Health Expectations, 23(1), 159–168. https://doi.org/10.1111/hex.12984

Herzog-Punzenberger, B., Altrichter, H., Brown, M., Burns, D., Nortvedt, G. A., Skedsmo, G., … O’Hara, J. (2020). Teachers responding to cultural diversity: case studies on assessment practices, challenges and experiences in secondary schools in Austria, Ireland, Norway and Turkey. Educational Assessment, Evaluation and Accountability, 32(3), 395–424. https://doi.org/10.1007/s11092-020-09330-y

Jacklin, K., Pitawanakwat, K., Blind, M., O’Connell, M. E., Walker, J., Lemieux, A. M., & Warry, W. (2020). Developing the Canadian indigenous cognitive assessment for use with indigenous older anishinaabe adults in Ontario, Canada. Innovation in Aging, 4(4), 1–13. https://doi.org/10.1093/geroni/igaa038

Jacobs, S. R., Glasgow, L. S., Amico, P., Farris, K. D., Rutledge, G., & Smith, B. D. (2024). Integrating the Consolidated Framework for Implementation Research (CFIR) into a Culturally Responsive Evaluation (CRE) Approach to Conduct Mixed-Method Evaluations of Diabetes Prevention and Management Programs Reaching Underresourced Populations and Communities. Prevention Science, 25(Suppl 1), 46–55. https://doi.org/10.1007/s11121-023-01509-1

Jaekel, N., Ritter, M., & Jaekel, J. (2023). Associations of students’ linguistic distance to the language of instruction and classroom composition with English reading and listening skills. Studies in Second Language Acquisition, 45(5), 1287–1309. https://doi.org/10.1017/S0272263123000268

Medina, M. S., Maerten-Rivera, J., Zhao, Y., & Henson, B. (2022). A Systematic Review of Assessment Tools Measuring Cultural Competence Outcomes Relevant to Pharmacy Education. American Journal of Pharmaceutical Education, 86(3), 207–216. https://doi.org/10.5688/ajpe8672

Memon, R., Asif, M., Khoso, A. B., Tofique, S., Kiran, T., Chaudhry, N., … Arshad, U. (2021). Recognising values and engaging communities across cultures: towards developing a cultural protocol for researchers. BMC Medical Ethics, 22(1), 1–8. https://doi.org/10.1186/s12910-021-00608-4

Minnican, C., & O’Toole, G. (2020). Exploring the incidence of culturally responsive communication in Australian healthcare: The first rapid review on this concept. BMC Health Services Research, 20(1), 1–14. https://doi.org/10.1186/s12913-019-4859-6

Mohammed, A. F. (2018). Language and Culture: Contexts in British English and Iraqi Arabic. RUDN Journal of Language Studies, Semiotics and Semantics, 9(3), 761–773. https://doi.org/10.22363/2313-2299-2018-9-3-761-773

Molina, R. L., & Kasper, J. (2019). The power of language-concordant care: A call to action for medical schools. BMC Medical Education, 19(1), 1–5. https://doi.org/10.1186/s12909-019-1807-4

Nortvedt, G. A., Wiese, E., Brown, M., Burns, D., McNamara, G., O’Hara, J., … Taneri, P. O. (2020). Aiding culturally responsive assessment in schools in a globalising world. Educational Assessment, Evaluation and Accountability, 32(1), 5–27. https://doi.org/10.1007/s11092-020-09316-w

Pazio Rossiter, M., & Bale, R. (2023). Cultural and linguistic dimensions of feedback: A model of intercultural feedback literacy. Innovations in Education and Teaching International, 60(3), 368–378. https://doi.org/10.1080/14703297.2023.2175017

Raubaugh, L., & Purmensky, K. (2023). Cultural Responsiveness and K-12 English Learners: Exploring Policy and Implementation Fidelity. Journal of Language, Identity and Education, 22(6), 634–651. https://doi.org/10.1080/15348458.2021.1945455

Schirmer, B. R., & Lockman, A. S. (2022). Culturally Responsive Teaching in an Undergraduate Online General Education Course. Online Learning Journal, 26(3), 132–148. https://doi.org/10.24059/olj.v26i3.2805

Schissel, J. L., De Korne, H., & López-Gopar, M. (2021). Grappling with translanguaging for teaching and assessment in culturally and linguistically diverse contexts: teacher perspectives from Oaxaca, Mexico. International Journal of Bilingual Education and Bilingualism, 24(3), 340–356. https://doi.org/10.1080/13670050.2018.1463965

Schissel, J. L., Leung, C., López-Gopar, M., & Davis, J. R. (2018). Multilingual learners in language assessment: assessment design for linguistically diverse communities. Language and Education, 32(2), 167–182. https://doi.org/10.1080/09500782.2018.1429463

Sepulveda, E. R., & Brooker, A.-S. (2021). Income inequality and COVID-19 mortality: Age-stratified analysis of 22 OECD countries. SSM-Population Health, 16, 100904.

Tosuncuoglu, I. (2019). Intercultural communicative competence awareness of Turkish students and instructors at university level. International Journal of Higher Education, 8(1), 44–54. https://doi.org/10.5430/ijhe.v8n1p44

Wang, Z., Buser, A. M., Cousins, I. T., Demattio, S., Drost, W., Johansson, O., … Walker, G. W. (2021). A new OECD definition for per-and polyfluoroalkyl substances. Environmental Science & Technology, 55(23), 15575–15578.

Yalcin, A. U., Dincer, M., Aslan, V., & Gulbas, Z. (2002). Effect of spironolactone on impaired fibrinolysis of hypertensive patients. Kidney and Blood Pressure Research, 25(4), 260–264. https://doi.org/10.1159/000066348

DOI: https://doi.org/10.35445/alishlah.v17i4.8201