Developing and Validating a Digital Literacy Assessment Tool for Indonesian Primary Education

Alfian Alfian; Imam Santoso; Deny Surya Saputra

doi:10.35445/alishlah.v17i2.7741

Developing and Validating a Digital Literacy Assessment Tool for Indonesian Primary Education

Alfian Alfian, Imam Santoso, Deny Surya Saputra

Abstract

The integration of digital technology into education requires valid and reliable tools to assess digital literacy, particularly at the primary school level where foundational skills are formed. This study aimed to develop and validate a digital literacy assessment instrument tailored for Indonesian primary school teachers and students. Using a Research and Development (R&D) approach based on the Borg and Gall model, the instrument was designed to measure four core dimensions: Technical Skills, Digital Information Evaluation, Digital Ethics, and Digital Collaboration. A total of 427 participants—213 teachers and 214 students—from six provinces across Indonesia participated in the validation process. Content validity was assessed using Aiken’s V, while construct validity and reliability were evaluated through Confirmatory Factor Analysis (CFA) and composite reliability measures. The findings demonstrated strong psychometric properties. Aiken’s V values were all ≥ 0.85, indicating high content validity. CFA results showed satisfactory factor loadings (≥ 0.60) and acceptable model fit indices (CFI ≥ 0.90; RMSEA ≤ 0.08). All four dimensions achieved composite reliability scores exceeding 0.70. The instrument proved to be a valid and reliable measure of digital literacy among primary school stakeholders. Although the study was limited to a specific sample, the results suggest potential for broader implementation. The tool offers practical value for educators and policymakers seeking to evaluate and enhance digital literacy, contributing to more inclusive, future-ready educational practices.

Keywords

digital literacy; instrument development; elementary education; digital skills; educational technology

Full Text:

PDF

References

Aesaert, K., & Van Braak, J. (2014). Exploring factors related to primary school pupils’ ICT self-efficacy: A multilevel approach. Computers in Human Behavior, 41, 327–341. https://doi.org/10.1016/j.chb.2014.10.006

Afandi, Alia Nur Hasan; Pristiani, Riska; Kusumaningrum, Shirly Rizki; Dewi, R. S. I. (2024). Digital Literacy Questionnaire Instrument: Based on the Integration of Elementary School Students’ Characteristics. International Journal of Elementary Education, 8(2), 344–353.

Akib, E., & Ghafar, M. N. A. (2015). Assessment for learning instrumentation in higher education. International Education Studies, 8(4), 166–172. https://doi.org/10.5539/ies.v8n4p166

Berganio, M. E. C., Tanpoco, M. R., & Dumagay, A. H. (2024). Pre-service Teachers’ Perceived Level of Digital Literacy: A Quantitative Study from a Developing Country. In M. S. & B. B. (Eds.), Lecture Notes in Networks and Systems: Vol. 1101 LNNS (pp. 158–167). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-68675-7_16

Bravo, M. C. M., Chalezquer, C. S., & Serrano-Puche, J. (2021). Meta-framework of digital literacy: Comparative analysis of 21st century skills frameworks. Revista Latina de Comunicacion Social, 2021(79), 76–110. https://doi.org/10.4185/RLCS-2021-1508

Calvani, A., Cartelli, A., Fini, A., & Ranieri, M. (2008). Models and Instruments for Assessing Digital Competence at School. Journal of E-Learning and Knowledge Society, 4(3), 183–193. https://doi.org/10.20368/1971-8829/288

Chang, C.-Y., & Kuo, H.-C. (2025). The development and validation of the digital literacy questionnaire and the evaluation of students’ digital literacy. Education and Information Technologies. https://doi.org/10.1007/s10639-024-13216-7

Chetty, K., Qigui, L., Gcora, N., Josie, J., Wenwei, L., & Fang, C. (2018). Bridging the digital divide: measuring digital literacy. 12, 2018.

Ding, S., Zhang, Y., Huang, H., Chen, D., & Gao, Z. (2024). The relationship between digital literacy and K-12 students’ academic performance: Mediation effects of problem-solving ability. In C. K.T., H. Y.K., Y. D., L. L.-K., W. L.-P., & R. B.L. (Eds.), Proceedings - 2024 International Symposium on Educational Technology, ISET 2024 (pp. 132–136). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ISET61814.2024.00034

Dou, J., & Zhao, X. (2023). Chinas Teacher Digital Literacy Framework and Development of an Evaluation System. ACM International Conference Proceeding Series, 588–593. https://doi.org/10.1145/3660043.3660148

Greene, J. A., Yu, S. B., & Copeland, D. Z. (2014). Measuring critical components of digital literacy and their relationships with learning. Computers and Education, 76, 55–69. https://doi.org/10.1016/j.compedu.2014.03.008

Gustiani, S. (2019). Research and Development (R&D) Method as a Model Design in Educational Research and Its Alternatives. Holistics Journal, 11(2), 12–22.

Hana Lestari, & Ima Rahmawati. (2024). Pengembangan Instrumen Asesmen Literasi Digital dalam Pembelajaran untuk Guru Madrasah Ibtidaiyah. EduInovasi: Journal of Basic Educational Studies, 4(2), 865–880. https://doi.org/10.47467/edu.v4i2.2345

Hutagalung, B., & Purbani, W. (2021). The Ability of Digital Literacy for Elementary School Teachers. JPI (Jurnal Pendidikan Indonesia), 10(4), 710–721. https://doi.org/10.23887/jpi-undiksha.v10i4.32938

Ilomäki, L., Paavola, S., Lakkala, M., & Kantosalo, A. (2016). Digital competence – an emergent boundary concept for policy and educational research. Education and Information Technologies, 21(3), 655–679. https://doi.org/10.1007/s10639-014-9346-4

Jin, K.-Y., Reichert, F., Cagasan, L. P., de la Torre, J., & Law, N. (2020). Measuring digital literacy across three age cohorts: Exploring test dimensionality and performance differences. Computers and Education, 157. https://doi.org/10.1016/j.compedu.2020.103968

Kömeçoglu, Y., Muftuoglu, Z., Umay, C., Tasdelen, A., & Ozdemir, S. (2019). Importance of data management in Digital Media Literacy: Integration of cultural elements in children with deep learning techniques. In Handbook of Research on Media Literacy Research and Applications Across Disciplines (pp. 235–247). IGI Global. https://doi.org/10.4018/978-1-5225-9261-7.ch015

Komenkominfo. (2022). Status Literasi Digtal di Indonesia. In Kominfo (Issue November).

Kusumasari, E. D. (2024). Meningkatkan Kemampuan Berpikir Kritis Siswa Sekolah Dasar pada Pembelajaran Bahasa Indonesia Berbasis Literasi Digital pada Kurikulum Merdeka. 3(1), 22–29.

Lazonder, A. W., Walraven, A., Gijlers, H., & Janssen, N. (2020). Longitudinal assessment of digital literacy in children: Findings from a large Dutch single-school study. Computers and Education, 143, 103681. https://doi.org/10.1016/j.compedu.2019.103681

Lee, S., & Kang, D. (2021). Development and Verification of Digital Literacy Test Tool for Elementary School Students. Journal of The Korean Association of Information Education, 25(1), 59–69. https://doi.org/10.14352/jkaie.2021.25.1.59

Lukitasari, M., Murtafiah, W., Ramdiah, S., Hasan, R., & Sukri, A. (2022). Constructing Digital Literacy Instrument and its Effect on College Students’ Learning Outcomes. International Journal of Instruction, 15(2), 171–188. https://doi.org/10.29333/iji.2022.15210a

Malik, A. A., Khan, R. A., Malik, H. N., Humayun, A., Butt, N. S., & Baig, M. (2019). Assessing reliability and validity of revised biggs two-factor study process questionnaire to measure learning approaches among undergraduate medical students in Lahore, Pakistan. Journal of the Pakistan Medical Association, 69(3), 337–342. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85062421576&partnerID=40&md5=615ef5f789a970aa7c1d2206af1b34ff

Marsa, P. B., Novisya, D., & Hamida, S. (2021). Development of instruments to measuring feasibility of context-based videos of sound. Journal of Physics: Conference Series, 1816(1). https://doi.org/10.1088/1742-6596/1816/1/012033

Masyhura, N., & Ramadan, Z. H. (2021). Implementation of Digital Literacy in Elementary Schools. International Journal of Elementary Education, 5(4), 639. https://doi.org/10.23887/ijee.v5i4.39480

Moreno-Morilla, C., Guzmán-Simón, F., & García-Jiménez, E. (2021). Digital and information literacy inside and outside Spanish primary education schools. Learning, Culture and Social Interaction, 28(March). https://doi.org/10.1016/j.lcsi.2020.100455

Narmanlıoğlu, H., & Bayrakcı, S. (2021). Digital literacy as whole of digital competences: scale development study tt - digital literacy as whole of digital competences: scale development study. Düşünce ve Toplum Sosyal Bilimler Dergisi, 4, 1–30.

Ng, W. (2012). Can we teach digital natives digital literacy? Computers and Education, 59(3), 1065–1078. https://doi.org/10.1016/j.compedu.2012.04.016

Nguyen, L. A. T., & Habók, A. (2024). Tools for assessing teacher digital literacy: a review. In Journal of Computers in Education (Vol. 11, Issue 1). Springer Berlin Heidelberg. https://doi.org/10.1007/s40692-022-00257-5

Parveen, A., Bashir, F., Nazir, A., Zimik, P., & Jan, S. (2024). Pedagogical strategies for developing digital literacy. In Digital Literacy at the Intersection of Equity, Inclusion, and Technology (pp. 251–269). IGI Global. https://doi.org/10.4018/979-8-3693-2591-9.ch011

Pérez-Escoda, A., García-Ruiz, R., & Aguaded, I. (2019). Dimensions of digital literacy based on five models of development. Cultura y Educacion, 31(2), 232–266. https://doi.org/10.1080/11356405.2019.1603274

Popov, E. V. (2023). FEATURES OF DIGITAL LITERACY MEASUREMENT IN RUSSIA. Sotsiologicheskie Issledovaniya, 2023(11), 51–61. https://doi.org/10.31857/S013216250028532-8

Qu, Z., Wu, J., Kueh, Y. C., Ye, D., & Kuan, G. (2025). Psychometric properties of the Chinese version physical literacy assessment questionnaire among high school students in Gansu, China. PeerJ, 13(4). https://doi.org/10.7717/peerj.19093

Reddy, P., Chaudhary, K., & Hussein, S. (2023). A digital literacy model to narrow the digital literacy skills gap. Heliyon, 9(4). https://doi.org/10.1016/j.heliyon.2023.e14878

Reichert, F., Zhang, D. (James), Law, N. W. Y., Wong, G. K. W., & de la Torre, J. (2020). Exploring the structure of digital literacy competence assessed using authentic software applications. Educational Technology Research and Development, 68(6), 2991–3013. https://doi.org/10.1007/s11423-020-09825-x

Ridsdale, C., Rothwell, J., Smit, M., Ali-Hassan, H., Bliemel, M., Irvine, D., Wuetherick, B. (2015). Strategies and Best Practices for Data Literacy Education. Knowledge Synthesis Report, 151, 10–17. https://doi.org/10.13140/RG.2.1.1922.5044

Sajidan, S., Maret, U. S., Java, C., Ragil, I., Atmojo, W., Maret, U. S., Desstya, A., Surakarta, U. M., Yani, J. A., Java, C., Parmin, P., Semarang, U. N., Saputri, D. Y., Maret, U. S., Java, C., Salimi, M., Maret, U. S., Java, C., & Nicosia, N. (2023). Educational Technology : Current Issues. 15(1), 59–71.

Schrier, K. (2018). Guiding Questions for Game-Based Learning. 1–20. https://doi.org/10.1007/978-3-319-53803-7_59-1

Siddiq, F., Gochyyev, P., & Wilson, M. (2017). Learning in Digital Networks – ICT literacy: A novel assessment of students’ 21st century skills. Computers and Education, 109, 11–37. https://doi.org/10.1016/j.compedu.2017.01.014

Siddiq, F., Scherer, R., & Tondeur, J. (2016). Teachers’ emphasis on developing students’ digital information and communication skills (TEDDICS): A new construct in 21st century education. Computers and Education, 92–93, 1–14. https://doi.org/10.1016/j.compedu.2015.10.006

Tsortanidou, X., Daradoumis, T., & Barberá-Gregori, E. (2022). Convergence among imagination, social-emotional learning and media literacy: an integrative literature review. Early Child Development and Care, 192(2), 173–186. https://doi.org/10.1080/03004430.2020.1753720

Wahyuni, T., Rahayu, W., & Naga, D. S. (2024). Validity and reliability of the situational judgment test instrument for assessing the ‘Pancasila’ student profile. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2439157

Wijayanti, A., Dwiningrum, S. I. A., & Saptono, B. (2024). Digital Literacy in Elementary Schools Post COVID-19: A Systematic Literature Review. International Journal of Learning, Teaching and Educational Research, 23(12), 96–112. https://doi.org/10.26803/ijlter.23.12.6

Winaryati, E., Munsarif, M., & Mardiana. (2021). Cercular Model of RD&D (Model RD&D Pendidikan dan Sosial). Penerbit KBM Indonesia.

Zhang, S., Mingyue Gu, M., Sun, W., & Jin, T. (2024). Digital literacy competence, digital literacy practices and teacher identity among pre-service teachers. Journal of Education for Teaching, 50(3), 464–478. https://doi.org/10.1080/02607476.2023.2283426

DOI: https://doi.org/10.35445/alishlah.v17i2.7741