Integrating Generative Artificial Intelligence (AI)-Based Multimodal Learning in Education to Enhance Literacy Aligned with Sustainable Development Goals (SDGs)

Authors

  • Asep Nurjamin Institut Pendidikan Indonesia Garut Author
  • Lucky Rahayu Nurjamin Institut Pendidikan Indonesia Garut Author
  • Yustika Nur Fajriah Institut Pendidikan Indonesia Garut Author
  • Hijrin Ahmad Firdaus Institut Pendidikan Indonesia Garut Author
  • Aisyah Khoerunnisa Nurjamin KB Al-Uswah Author

Keywords:

Deep learning, Elementary students, Generative AI, Multimodal learning

Abstract

This study aimed to investigate the integration of artificial 
intelligence (AI)-based multimodal learning in education to 
enhance students’ literacy in alignment with Sustainable 
Development Goals. A quasi-experimental design was 
employed with elementary students who participated in 
lessons supported by teacher modelling and AI scaffolding. 
The intervention was implemented through literacy tasks 
focusing on descriptive writing and multimodal expression. 
The results indicated that students improved in their ability 
to construct coherent descriptive texts enriched with visual 
elements, demonstrating progress in vocabulary use and 
multimodal literacy. These findings are significant because 
the combination of teacher guidance and AI feedback 
strengthened the learning process by connecting linguistic 
concepts with meaningful tasks. The study highlights the 
impact of aligning educational innovations with Sustainable 
Development Goals (SDGs), showing that AI-assisted 
multimodal learning can foster student-centered pedagogy, 
improve literacy development, and provide sustainable 
pathways for integrating digital technologies into education. 

References

Abdulmuhsin, I., Bolaji, H.O., Abdulazeez, B.T.A., and Salamia, A.O. Awareness and utilization

of artificial intelligence-based intelligent tutoring systems (ITS) in enhancing chemistry education through information and communication technology (ICT). ASEAN Journal of Educational Research and Technology, 4(2), 171-186.

Abdulmumin, I.A., and Abdulrahman, M.R. (2025). Undergraduate perception, attitude, and

utilization of artificial intelligence (AI) ChatGPT for learning: An educational technology

perspective. Indonesian Journal of Multidiciplinary Research, 5(1), 175-186

Afifah, S., Mudzakir, A., and Nandiyanto, A.B.D. (2022). How to calculate paired sample t-test

using SPSS software: From step-by-step processing for users to the practical examples in

the analysis of the effect of application anti-fire bamboo teaching materials on student

learning outcomes. Indonesian Journal of Teaching in Science, 2(1), 81-92.

Agarry, R.O., Omolafe, E.V., Animashaun, V.O., and Babalola, E.O. (2022). Primary education

undergraduates’ competency in the use of artificial intelligence for learning in Kwara

State. ASEAN Journal of Educational Research and Technology, 1(2), 111-118.

Agustin, M.I., Muktiarni, M., and Mupita, J. (2022). Implementation of the reading and writing

literacy program to elementary school students about the impact of the natural disaster

of mount Merapi. Indonesian Journal of Teaching in Science, 2(2), 99-106.

Al Husaeni, D.F., Al Husaeni, D.N., Nandiyanto, A.B.D., Rokhman, M., Chalim, S., Chano, J., Al

Obaidi, A.S.M., and Roestamy, M. (2024). How technology can change educational

research? Definition, factors for improving quality of education and computational

bibliometric analysis. ASEAN Journal of Science and Engineering, 4(2), 127-166.

Al Husaeni, D.F., Haristiani, N., Wahyudin, W., and Rasim, R. (2024). Chatbot artificial

intelligence as educational tools in science and engineering education: A literature

review and bibliometric mapping analysis with its advantages and disadvantages. ASEAN

Journal of Science and Engineering, 4(1), 93-118.

Al Husaeni, D.N., and Haristiani, N. (2025). What evidence supports the advancement of

language learning through digital innovation? Toward achieving Sustainable

Development Goals (SDGs) in the 21st century completed with bibliometric

analysis. ASEAN Journal of Science and Engineering, 5(2), 327-356

Alhammad, A. I. (2025). Implementing a genre-based approach to enhance essay writing skills

in Saudi EFL learners. Journal of Language Teaching and Research, 16(1), 295-301.

Alimi, A.E., Buraimoh, O.F., Aladesusi, G.A., and Babalola, E.O. (2021). University students’

awareness of, access to, and use of artificial intelligence for learning in Kwara State.

Indonesian Journal of Teaching in Science, 1(2), 91-104.

Al-Khassawneh, Y.A. (2023). A review of artificial intelligence in security and privacy: Research

advances, applications, opportunities, and challenges. Indonesian Journal of Science and

Technology, 8(1), 79-96.

Andhini, A.B., and Sakti, A.W. (2021). Impact of distance learning on reading and writing

ability in elementary school students. Indonesian Journal of Multidiciplinary Research,

(2), 393-398.

Arifin, K., Sirih, M., Munir, A., Jahidin, and Sabilu, M. (2025). The influence of multimodal learning strategies on prospective biology teachers' literacy-numeracy learning outcomes. EURASIA Journal of Mathematics, Science and Technology Education, 21(1), em2563.

Balasubramanian, K. (2025). The future of teaching: Artificial intelligence (AI) and artificial

general intelligence (AGI) for smarter, adaptive, and data-driven educator

training. Indonesian Journal of Teaching in Science, 5(1), 49-54.

Chan, A. Y. W., and Sung, C. C. M. (2025). Enhancing students’ digital literacy skills through

their technology use in a course-based research project: A Hong Kong case study. Asia

Pacific Education Review, 2025, 1-14.

Cheah, Y.H., Jingru, L., and Kim, J. (2025). Integrating generative artificial intelligence in K-12

education: Examining teachers’ preparedness, practices, and barriers. Computers and

Education: Artificial Intelligence, 8, 1-12.

Cheung, K. K. C., Pun, J., Kenneth-Li, W., and Mai, J. (2025). Exploring students’ multimodal

representations of ideas about epistemic reading of scientific texts in generative AI

tools. Journal of Science Education and Technology, 34(2), 284-297.

Damayanti, K.D., and Santosa, M.H. (2024). The effect of prowritingaid writing tool on the

writing skills of english as a foreign language (EFL) students: A systematic literature

review. Indonesian Journal of Multidiciplinary Research, 4(2), 469-478.

De Oliveira, L. C., and dos Santos, A. E. (2025). Using AI-text generated mentor texts for genre

based pedagogy in second language writing. Journal of Second Language Writing, 67,

Derewianka, B. (2003). Trends and issues in genre-based approaches. RELC Journal, 34(2),

-154.

Dimitriadou, E., and Lanitis, A. (2023). A critical evaluation, challenges, and future

perspectives of using artificial intelligence and emerging technologies in smart

classrooms. Smart Learning Environments, 10(1), 12.

Fedorenko, S.V. (2019). Experience of developing students’ multimodal literacy in the digital

learning environment of higher education institutions. Information Technologies and

Learning Tools, 69(1), 12-20.

Fiandini, M., Nandiyanto, A.B.D., Al Husaeni, D.F., Al Husaeni, D.N., and Mushiban, M. (2024).

How to calculate statistics for significant difference test using SPSS: Understanding

students comprehension on the concept of steam engines as power plant. Indonesian

Journal of Science and Technology, 9(1), 45-108.

Fiandini, M., Nandiyanto, A.B.D., and Kurniawan, T. (2023). Bibliometric analysis of research

trends in conceptual understanding and sustainability awareness through artificial

intelligence (AI) and digital learning media. Indonesian Journal of Multidiciplinary

Research, 3(2), 477-486.

Fufon, K., Notesiri, U., Lekchaum, K., Chomsuwan, K., Tanitteerapan, T., and Puengsungewan,

S. (2025). Smart electric resistance welding based on artificial intelligence (AI) based on

real-time adaptive statistical features completed with bibliometric analysis. ASEAN

Journal of Science and Engineering, 5(1), 173-198.

Gemil, K.W., Na’ila, D.S., Ardila, N.Z., and Sarahah, Z.U. (2024). The relationship of vocational education skills in agribusiness processing agricultural products in achieving sustainable development goals (SDGs). ASEAN Journal of Science and Engineering Education, 4(2), 181-192.

Guo, X. (2023). Multimodality in language education: Implications of a multimodal affective

perspective in foreign language teaching. Frontiers in Psychology, 14, 1283625.

Hamid, S. (2025). Integrating artificial intelligence and multimodality in language education:

A systematic review of emerging trends and practices. Journal of Social and Amp;

Organizational Matters, 4(2), 400-416.

Ibrahim, A., Bolaji, H.O., and Abdulraheem, A.J. (2025). Accessibility and utilization of artificial

intelligence (AI)-based intelligent tutoring systems (ITS) and information and

communication technology (ICT) in enhancing biology education. ASEAN Journal for

Science Education, 4(2), 93-104.

Jiang, J. (2024). When generative artificial intelligence meets multimodal composition:

Rethinking the composition process through an AI-assisted design project. Computers

and Composition, 74, 102883.

Keisyafa, A., Sunarya, D.N., Aghniya, S.M., and Maula, S.P. (2024). Analysis of student’s

awareness of sustainable diet in reducing carbon footprint to support sustainable

development goals (SDGs) 2030. ASEAN Journal of Agricultural and Food Engineering,

(1), 67-74.

Kelley, M., and Wenzel, S. (2025). Advancing teacher AI literacy: Professional partnerships for

effective integration of AI in education. Education Sciences, 15(6), 659.

Khalikova, K.A. (2025). Integrating artificial intelligence into education: Opportunities,

challenges, and future prospects. Indonesian Journal of Educational Research and

Technology, 5(2), 137-144.

Kosmas, P., Nisiforou, E. A., Kounnapi, E., Sophocleous, S., and Theophanous, G. (2025).

Integrating artificial intelligence in literacy lessons for elementary classrooms: A co

design approach. Educational Technology Research and Development, 2025, 1-27.

Lailatussyifa, N.P., Al Baekani, A.K., and Hakim, P.K. (2025). Implementing genre-based

approach in teaching reading: a case study at vocational high school students. Journal of

Educational Sciences, 9(1), 120-128.

Li, M., and Wilson, J. (2025). AI-Integrated scaffolding to enhance agency and creativity in k

English language learners: A systematic review. Information, 16(7), 519.

Lin, C. H., Zhou, K., Li, L., and Sun, L. (2025). Integrating generative AI into digital multimodal

composition: A study of multicultural second-language classrooms. Computers and

Composition, 75, 102895.

Makinde, S.O., Ajani, Y.A., and Abdulrahman, M.R. (2024). Smart learning as transformative

impact of technology: A paradigm for accomplishing sustainable development goals

(SDGs) in education. Indonesian Journal of Educational Research and Technology, 4(3),

-224.

Mamaraimova, D., and Safieva, M. (2025). Navigating the future of artificial intelligence: Innovations, ethical dilemmas, and societal impact. Indonesian Journal of Educational Research and Technology, 5(1), 71-76.

Mittal, U., Sai, S., Chamola, V., and Sangwan, D. (2017). A comprehensive review on

generative AI for education. IEEE Access. 12, 142733-142759.

Mohammadi, M. (2025). Artificial intelligence in multimodal learning analytics: A systematic

literature review. Computers and Education: Artificial Intelligence, 8, 100426.

Nagaraju, K., and Ramakrishna, S. (2025). Leveraging artificial intelligence (AI) and geospatial

technologies for community-centered urban expansion forecasting in Hyderabad. ASEAN

Journal of Community Service and Education, 3(2), 135-146

Nandiyanto, A. B. D., and Azizah, N. N. (2022). Analysis of common mistake in writing scientific

article in “engineering” undergraduate student. Journal of Engineering Science and

Technology, 17(1), 156-170.

Ntelioglou, B. Y., Fannin, J., Montanera, M., and Cummins, J. (2014). A multilingual and

multimodal approach to literacy teaching and learning in urban education: A

collaborative inquiry project in an inner-city elementary school. Frontiers in Psychology,

, 533.

Nurhasanah, S., and Nugraha, M.S. (2024). The future of learning: ethical and philosophical

implications of artificial intelligence (AI) integration in education. Indonesian Journal of

Multidiciplinary Research, 4(2), 341-352.

Nurjamin, A., and Nurjamin, L. R. (2016). The use of genre-based approach to teaching

students' writing skill of hortatory exposition text in Bahasa Indonesia. In Ninth

International Conference on Applied Linguistics, 9, 221-223.

Nurjamin, A., Nurjamin, L. R., Fajriah, Y. N., Nurjamin, A. K. Nugraha, I. (2025).

Developing and evaluating an augmented reality (AR) digital storytelling video to foster

multimodal literacy and narrative comprehension. Journal of Engineering Science and

Technology, 20(4) 919-956.

Olowoyeye, C.A.C., Deji-Afuye, O.O., and Aladesusi, G.A. (2023). Effect of multimedia

instructional approach on English writing performance of pre-service technical teachers

in South-Western Nigeria. Indonesian Journal of Multidiciplinary Research, 3(1), 21-30.

Prasetyo, I., Nugroho, A.A., Damayanto, A., and Fathoni, M.I. (2025). Developing an inclusive

ICT-based academic information system using REST API to promote Sustainable

Development Goals (SDGs) in higher education. ASEAN Journal of Science and

Engineering, 5(2), 395-416.

Purba, R., Herman, H., Fatmawati, E., Saputra, N., and Sabata, Y. N. (2023). The multimodal

based learning improves students' reading ability in perspective of systemic functional

linguistics. Journal of Education Technology, 7(1), 61-70.

Qazi, S., Kadri, M. B., Naveed, M., Khawaja, B. A., Khan, S. Z., Alam, M. M., and Su'ud, M. M.

(2024). AI-Driven learning management systems: Modern developments, challenges and

future trends during the age of ChatGPT. Computers, Materials and Continua, 80(2),

-3314.

Rahayu, N.I., and Ismail, A. (2023). Trends in the use of artificial intelligence (AI) technology in increasing physical activity. Indonesian Journal of Educational Research and Technology, 3(3), 295-304.

Rahayu, N.I., Muktiarni, M., and Hidayat, Y. (2024). An application of statistical testing: A

guide to basic parametric statistics in educational research using SPSS. ASEAN Journal of

Science and Engineering, 4(3), 569-582.

Rahmawati, T., and Fajriah, Y.N. (2023). The implementation of building knowledge of the

field (Bkof) in teaching narrative text. English Education and Applied Linguistics Journal

(EEAL Journal), 6(1), 10-18.

Rahmiyanti, H. (2024). Bibliometric analysis on artificial intelligence research in Indonesia

vocational education. ASEAN Journal for Science Education, 3(2), 183-192.

Reddy, A. S. (2024). Multimodal Gen AI: Integrating Text, Image, and Video Analysis for

Comprehensive Claims Assessment. ESP International Journal of Advancements in

Computational Technology, 2(2), 133-141.

Rochman, S., Rustaman, N., Ramalis, T.R., Amri, K., Zukmadini, A.Y., Ismail, I., and Putra, A.H.

(2024). How bibliometric analysis using VOSviewer based on artificial intelligence data

(using ResearchRabbit Data): Explore research trends in hydrology content. ASEAN

Journal of Science and Engineering, 4(2), 251-294.

Shamim, F., and Riaz, M. N. (2023). Impact of multimodal digital media communication on

generation Z’s language use and literacy practices. Academy of Education and Social

Sciences Review, 3(4), 398–409.

Smith, B. E., Shimizu, A. Y., Burriss, S. K., Hundley, M., and Pendergrass, E. (2025). Multimodal

composing with generative AI: Examining preservice teachers’ processes and

perspectives. Computers and Composition, 75, 102896.

Solihat, A.N., Dahlan, D., Kusnendi, K., Susetyo, B., and Al Obaidi, A.S.M. (2024). Artificial

intelligence (AI)-based learning media: Definition, bibliometric, classification, and issues

for enhancing creative thinking in education. ASEAN Journal of Science and

Engineering, 4(3), 349-382.

Susilawati, A., Al-Obaidi, A.S.M., Abduh, A., Irwansyah, F.S., and Nandiyanto, A.B.D. (2025).

How to do research methodology: From literature review, bibliometric, step-by-step

research stages, to practical examples in science and engineering education. Indonesian

Journal of Science and Technology, 10(1), 1-40

Tao, L., Deng, H., and Song, Y. (2025). Generative artificial intelligence in education: A topic

based bibliometric analysis. Educational Technology and Society, 28(2), p327.

Trisanti, N., Sukyadi, D., and Hermawan, B. (2024). University EFL teachers’ stance and

engagement in digital multimodal composing as multimodal literacy

practices. International Journal of Education, 17(1), 61-70.

Van Leeuwen, T. (2017). Multimodal literacy. Metaphor, 4, 17-23.

Xu, Z. (2024). AI in education: Enhancing learning experiences and student outcomes. Applied

and Computational Engineering, 51(1), 104-111.

Zhang, J., and Zhang, Z. (2024). AI in teacher education: Unlocking new dimensions in teaching support, inclusive learning, and digital literacy. Journal of Computer Assisted Learning, 40(4), 1871-1885.

Zhou, X. (2023). Teaching activities for English writing: based on a process genre. English

Language Teaching and Linguistics Studies, 5(2), 208-222.

Zhuang, Y., Zhao, R., Xie, Z., and Yu, P. L. H. (2025). Enhancing language learning through generative AI feedback on picture-cued writing tasks. Computers and Education: Artificial Intelligence, 9, 100450.

Downloads

Published

2026-03-01