AI-Integrated Learning in Society 5.0: Advancing Critical Thinking in English Language Education
The rapid integration of artificial intelligence (AI) in education has transformed learning environments in the era of Society 5.0, particularly in English language education, where critical thinking skills are increasingly required to support learners’ academic and digital competencies. This study investigated the relationship between AI-integrated English for Academic Purposes-Based Learning (EAPBL) and students’ critical thinking performance among English Language Learners (ELLs). The study employed a mixed-method explanatory sequential design involving 64 undergraduate students enrolled in English-related courses at Universitas Muhammadiyah Tangerang, Indonesia. Data were collected through questionnaires, performance-based assessments, AI-supported learning tasks, students’ reflective responses, and semi-structured interviews. The questionnaire measured AI engagement, AI literacy, cognitive engagement, and perceived critical thinking skills using a five-point Likert scale, while rubric-based assessments evaluated students’ written academic outputs. Quantitative data were analyzed using descriptive statistics, paired sample t-tests, multiple regression analysis, and Partial Least Squares Structural Equation Modeling (PLS-SEM). In contrast, qualitative data were analyzed through thematic analysis to support the interpretation of the quantitative findings. The findings revealed a moderate but statistically significant improvement in students’ critical thinking performance, with an overall post-test score of 46%. Among the five dimensions of critical thinking, interpretation demonstrated the highest performance, followed by argumentation, while analysis, evaluation, and synthesis remained relatively underdeveloped. The PLS-SEM analysis indicated that AI engagement significantly influenced cognitive engagement, which in turn contributed to students’ critical-thinking performance. In addition, AI literacy strengthened the relationship between cognitive engagement and critical thinking outcomes. Qualitative findings further revealed that AI-supported learning helped students organize ideas, generate initial responses, and improve learning efficiency; however, several participants demonstrated dependence on AI-generated responses, limited critical evaluation of AI outputs, and difficulty synthesizing multiple perspectives. These findings suggest that AI-supported learning can foster critical thinking when accompanied by active cognitive engagement and adequate AI literacy. The study highlights the importance of integrating digital, cognitive, and ethical AI literacy into English language education in the context of Society 5.0.
Keywords: Society 5.0, Artificial Intelligence, Critical Thinking, English for Academic Purposes-Based Learning, AI Literacy
Alaqad, M. H., Al-Saggaf, M. A., & Ingilan, S. S. (2026). The Future of AI in English Language Education. In The Sociology of English Language Teaching and Learning in the Age of AI (pp. 241–264). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-3755-5.ch010
Aryusmar, A. (2025). Exploring AI Integration with 21st-Century Skills in Language Education. ICCD, 7(1), 127–132. https://doi.org/10.33068/iccd.v7i1.850
Batubara, M. H. (2025). Harnessing Artificial Intelligence for English Language Learning: A Systematic Literature Review. Journal of Linguistics Literature and Language Teaching (JLLLT), 4(2), 107–122. https://doi.org/10.37249/jlllt.v4i2.853
Cohen, L., Manion, L., & Morrison, K. (2007). Research Methods in Education. In Professional Development in Education (Sixth Edition). Routledge. https://doi.org/10.1080/19415257.2011.643130
Dix, B. P., & Naar, M. M. (2025). AI as an open-ended dialogue. In Lingua Ex Machina (pp. 32–46). Routledge. https://doi.org/10.4324/9781003684411-4
Elen, J., & Bishop, M. J. (2020). Method. In Handbook of Research in Educational Communications and Technology (Latest Edition). Springer Nature Link. https://link.springer.com/book/10.1007/978-3-030-36119-8
Ghosh, O., & Kumar, B. (2026). Rethinking Society 5.0 of AI-Driven Educational Innovation. In A. Asrifan (Ed.), Advancing Society 5.0 Through AI-Driven Curriculum Innovation (pp. 27–54). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-1062-6.ch002
Giannikas, C. N., Tsagari, D., & Liontou, T. (2022). Digital Literacy in Language Education: The COVID-19 Era of Cyprus. In C. Giannikas (Ed.), Transferring Language Learning and Teaching From Face-to-Face to Online Settings (pp. 189–202). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-7998-8717-1.ch010
Glaser, G., & Watson, E. (2002). Critical Thinking Appraisal. In Pearson (UK Edition). Pearson Assessment. http://www.careers.cam.ac.uk/library/criticalthinkingpracticetest.pdf
Glaser, Goodwin; Watson, E. (2015). Free Critical Question Thinking Test. In Assessment Day Practice Aptitude Tests (pp. 1–45). Retrieved from www.Assessmentday.Co.Uk
Grace, H., Banson, K., & Saraf, A. (2023). Chapter 88 - Mixed-methods research. In A. E. M. Eltorai, J. A. Bakal, D. W. Kim, & D. E. Wazer (Eds.), Translational Radiation Oncology (pp. 531–536). Academic Press. https://doi.org/https://doi.org/10.1016/B978-0-323-88423-5.00029-7
Guest, G., Namey, E., & Chen, M. (2020). A simple method to assess and report thematic saturation in qualitative research. PLoS ONE, 15(5). https://doi.org/10.1371/journal.pone.0232076
Hafsa, N.-E. (2019). Mixed Methods Research: An Overview for Beginner Researchers. An International Peer-Reviewed Journal, 58. https://doi.org/10.7176/JLLL
Hassan, K. El, & Madhum, G. (2007). Validating the Watson Glaser Critical Thinking Appraisal. Higher Education, 54(3), 361–383. https://doi.org/10.1007/s10734-006-9002-z
He, H., Zou, B., & Du, Y. (2024). Exploring artificial intelligence technology for enhancing EAP learners’ speaking skills: A case study of EAP Talk. https://doi.org/10.31219/osf.io/syb62
Hong, H., & Guo, J. (2024). Cultivation of Critical Thinking Skills: Exploring the Impact of Generative Artificial Intelligence- Enabled Instruction in English Essay Writing. Journal of Contemporary Educational Research, 8(8), 226–232. https://doi.org/10.26689/jcer.v8i8.7999
HS, S. R., Eka, S., & Purba, E. (2025). The Role of Artificial Intelligence in Enhancing Learning in the Era of Society 5.0. Klasikal: Journal of Education, Language Teaching and Science, 7. https://doi.org/10.52208/klasikal.v7i2.1354
Hussein, A. (2009). The use of Triangulation in Social Sciences Research: Can qualitative and quantitative methods be combined? In Journal of Comparative Social Work (Number 1).
Hyland, K. (2008). Writing theories and writing pedagogies. Indonesian Journal of English Language Teaching, 4(2), 91–110. http://m.indonesianjelt.org/Pages/current_issues_detail.aspx?Id=132&year=2008&month=10&volume=4&edition=2&Type=BackIssue
Hyland, K. (2009). English for professional academic purposes. In Ann. Arbor (Ed.), English for specific purposes in theory and practice (Belcher, D). University of Michigan Press.
Iskandar, Z., Yulanda, N. I. P., Dubey, S. B., & Apriani, E. (2025). AI and Digital Literacy in Language Education: A Systematic Review on Critical Thinking Development. Journal of Language and Literature Studies, 5(4), 1012–1024. https://doi.org/10.36312/pyz75g90
Joseph, G. V., Athira, P., Anit Thomas, M., Jose, D., Roy, T. V., & Prasad, M. (2024). Impact of Digital Literacy, Use of AI tools and Peer Collaboration on AI Assisted Learning: Perceptions of the University students. Digital Education Review, (45), 43–49. https://doi.org/10.1344/der.2024.45.43-49
Jurayeva, Z. (2025). Fostering Higher-Order Thinking Skills in ESL Classrooms Through AI-Supported Writing Tasks. International Journal of Pedagogics, 5(6), 18–20. https://doi.org/10.37547/ijp/volume05issue06-05
Kholdaralievna, Z. A. (2025a). Integrating AI-Powered Tools to Develop Critical Thinking Skills in Pre-Service English Teachers: Challenges and Opportunities. International Scientific Innovation Research Conference.
Kholdaralievna, Z. A. (2025b, February 15). Enhancing Critical Thinking Skills of Future English Teachers through AI (Artificial Intelligence) Technology. https://doi.org/10.5281/zenodo.14867044
Kreuder, A., Frick, U., Rakoczy, K., & Schlittmeier, S. J. (2024). Digital competence in adolescents and young adults: a critical analysis of concomitant variables, methodologies and intervention strategies. In Humanities and Social Sciences Communications (Vol. 11, Number 1). Springer Nature. https://doi.org/10.1057/s41599-023-02501-4
Kumar, S. (2025). The Integration of Artificial Intelligence in English Language Education. In The Sociology of English Language Teaching and Learning in the Age of AI (pp. 265–286). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-3755-5.ch011
Lawasi, M. C., Rohman, V. A., & Shoreamanis, M. (2024). The Use of AI in Improving Student’s Critical Thinking Skills. Proceedings Series on Social Sciences & Humanities, 18, 366–370. https://doi.org/10.30595/pssh.v18i.1279
Lee, S., Eronen, J., Lee, S., & Eronen, J. (2025). Transforming English education in Japan by utilizing large language models for tailored learning and diverse skill development. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00856-1
Mitrulescu, C. M. (2025). Generative AI as a Tool for Cultivating Critical Thinking in the EFL Classroom. Land Forces Academy Review, 30(4), 586–594. https://doi.org/10.2478/raft-2025-0055
Mohadih, N. B. M., Azhar, N. B. B. K., Farizan, M. A. B. A., Radzi, N. A. B. M., & Manap, M. R. Bin. (2025). The Impact of Artificial Intelligence on Language Learners’ Critical Thinking Skills, Language Learning, And Academic Integrity. International Journal of Research and Innovation in Social Science, 9(24), 817–824. https://doi.org/10.47772/ijriss.2025.924ileiid0089
Mondal, R., & Alam, M. (2025). Mixed method research: a brief overview. The Social Science Review, a Multidisciplinary Journal, 3(5), 91–94. https://doi.org/10.70096/tssr.250305017
Normuratova, V. I. (2024). Digital literacy in modern education. The American Journal of Social Science and Education Innovations, 6(10), 61–65. https://doi.org/10.37547/tajssei/volume06issue10-07
Oranga, J. (2025). Mixed methods research: merits, applications and challenges. International Journal of Social Science, 5(2), 233–238. https://doi.org/10.53625/ijss.v5i2.11034
Pócza, K., & Dobos, G. (2018). Research methodology. In Constitutional Politics and the Judiciary: Decision-making in Central and Eastern Europe. https://doi.org/10.4324/9780429467097-2
Possin, K. (2014). Critique of the Watson-Glaser Critical Thinking Appraisal Test: The more you know, the lower your score. Informal Logic, 34(4), 393–416. https://doi.org/10.22329/il.v34i4.4141
Prot, S., & Anderson, C. A. (2013). Research Methods, Design, and Statistics in Media Psychology. (August), 1–34. https://doi.org/10.1093/oxfordhb/9780195398809.013.0007
Rosmayanti, V. (2026). Fostering Critical Thinking in AI-Assisted English Language Learning Environments. In K. Carlson (Ed.), Ethical, Legal, and Pedagogical Perspectives on AI in Education (pp. 301–324). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-3000-6.ch011
Ruzieva, M. (2025). AI-Supported Problem-Based Learning: A Pathway to Developing Students’ Critical Thinking Abilities. Zenodo. https://doi.org/10.5281/zenodo.15074358
Sá, M. J., Santos, A. I., Serpa, S., & Ferreira, C. M. (2021). Digital Literacy in Digital Society 5.0: Some Challenges. Academic Journal of Interdisciplinary Studies, 10(2), 1–9. https://doi.org/10.36941/ajis-2021-0033
Saidi, B. A. A.-, & Tobi, F. S. Al. (2025). Transforming English Language Classrooms: Empowering Future-Ready Learners through Critical Thinking and Creativity in Oman. International Journal of Social Science and Education Research Study, 05(10). https://doi.org/10.55677/ijssers/V05I10Y2025-05
Samaty, M. El. (2025). Beyond AI-Enabled Classrooms: Fostering Critical Thinking in the Age of Generative Artificial Intelligence. Advances in Computational Intelligence and Robotics Book Series, 527–546. https://doi.org/10.4018/979-8-3693-7332-3.ch030
Shakib Kotamjani, S., Jafary, M., & Amoozegar, A. (2026). AI-Integrated Language Learning: Transforming Pedagogical Paradigms in ELT. In The Sociology of English Language Teaching and Learning in the Age of AI (pp. 1–28). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-3755-5.ch001
Soelistiono, S., & Wahidin. (2023). Educational Technology Innovation: AI-Integrated Learning System Design in AILS-Based Education. Influence. https://doi.org/10.54783/influencejournal.v5i2.175
Son, J. (2024). Insights into Digital Literacy in Language Teaching. Castledown Publishers. https://doi.org/10.29140/9781914291210
Spires, H. A., Medlock Paul, C., & Kerkhoff, S. N. (2018). Digital Literacy for the 21st Century (pp. 12–21). https://doi.org/10.4018/978-1-5225-7659-4.ch002
Subrahmanyam, S. (2025). Developing Digital Citizenship Skills. Advances in Computational Intelligence and Robotics Book Series, 357–390. https://doi.org/10.4018/979-8-3373-1062-6.ch012
Sunarti, S. (2025). Utilization Of Artificial Intelligence In Digital Learning: 21st Century Learning Innovation In The Era Of Society 5.0. https://doi.org/10.47281/fas.v6i2.232
Thongsan, N. C., & Anderson, N. (2025). From Passive Answers to Active Inquiry: How AI Supports Critical Reading in EFL Classrooms. LEARN Journal : Language Education and Acquisition Research Network, 18(2), 795–820. https://doi.org/10.70730/kmkl8505
Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. 21, 1–29. https://doi.org/10.1186/s41239-024-00448-3
Zablotska, L., Chernii, L., Meleshchenko, V., Олендр, Т., & Tsar, I. (2026). Developing Students’ Critical Thinking through AI-Enhanced Foreign Language Instruction. Arab World English Journal, 3, 132–146. https://doi.org/10.24093/awej/ai3.9
Zakaria, N. Y. K., Hashim, H., & Jamaludin, K. A. (2025). Exploring the Impact of AI on Critical Thinking Development in ESL: A Systematic Literature Review. https://doi.org/10.31235/osf.io/dsqv2_v1
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The copyright is reserved to Pedagogy Review that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Address:
CV. IMRECS: Jalan Gagak I, Kecamatan Larangan, Kota Tangerang. Postal Code: 15155
STKIP Al Islam Tunas Bangsa: Jalan Z.A. Pagar Alam No. 41 Gedong Meneng Bandar Lampung