How AI Literacy Affects Students’ Educational Attainment in Online Learning: Testing a Structural Equation Model in Higher Education Context
DOI:
https://doi.org/10.19173/irrodl.v25i3.7720Keywords:
AI, AI applications, academic well-being, AI literacy, educational attainment, undergraduate studentsAbstract
Artificial intelligence (AI) has contributed to various facets of human lives for decades. Teachers and students must have competency in AI and AI-empowered applications, particularly when using online electronic platforms such as learning management systems (LMS). This study investigates the structural relationship between AI literacy, academic well-being, and educational attainment of Iranian undergraduate students. Using a convenience sampling approach, we selected 400 undergraduate students from virtual universities equipped with LMS platforms and facilities. We collected data using three instruments—an AI literacy scale, an academic well-being scale, and educational attainment scale—and analyzed the data using Smart-PLS3 software. Results showed that the hypothetical model had acceptable psychometrics (divergent and convergent validity, internal consistency, and composite reliability). Results also showed that the general model had goodness of fit. The study thus confirms the direct effect of AI on academic well-being and educational attainment. By measuring variables of academic well-being, we also show that AI literacy in China and Iran significantly affects educational attainment. These findings have implications for students, teachers, and educational administrators of universities and higher education institutes, providing knowledge about the educational uses of AI applications.
References
Ala-Mutka, K. (2011). Mapping digital competence: Towards a conceptual understanding (Report no. JRC67075). Institute for Prospective Technological Studies. https://www.researchgate.net/publication/340375234
Alavi, M., Marakas, G. M., & Yoo, Y. (2002). A comparative study of distributed learning environments on learning outcomes. Information Systems Research, 13(4), 404–415. https://doi.org/10.1287/isre.13.4.404.72
Bozkurt, A., Akgun-Ozbek, E., Yilmazel, S., Erdogdu, E., Ucar, H., Guler, E., Sezgin, S., Karadeniz, A., Sen-Ersoy, N., Goksel-Canbek, N., Deniz Dincer, G., Ari, S., & Aydin, C. H. (2015). Trends in distance education research: A content analysis of journals 2009–2013. International Review of Research in Open and Distributed Learning, 16(1), 330–363. https://doi.org/10.19173/irrodl.v16i1.1953
Budzianowski, P., & Vulić, I. (2019). Hello, it’s GPT-2—how can I help you? Towards the use of pre-trained language models for task-oriented dialogue systems. arXiv:1907.05774. https://doi.org/10.48550/arXiv.1907.05774
Calvani, A., Cartelli, A., Fini, A., & Ranieri, M. (2009). Models and instruments for assessing digital competence at school. Journal of E-Learning and Knowledge Society, 4(3). https://doi.org/10.20368/1971-8829/288
Chen, M., Gündüz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021). Distributed learning in wireless networks: Recent progress and future challenges. IEEE Journal on Selected Areas in Communications, 39(12), 3579–3605. https://doi.org/10.1109/JSAC.2021.3118346
Cote, T., & Milliner, B. (2018). A survey of EFL teachers’ digital literacy: A Report from a Japanese University. Teaching English with Technology, 18(4), 71–89. https://tewtjournal.org/download/6-a-survey-of-efl-teachers-digital-literacy-a-report-from-a-japanese-university-by-travis-cote-and-brett-milliner/
Davenport, T., & Kalakota, R. (2019). The potential for artificial intelligence in healthcare. Future Healthcare Journal, 6(2), 94–98. https://doi.org/10.7861/futurehosp.6-2-94
Davenport, T.H., & Ronanki, R. (2018) Artificial Intelligence for the Real World. Harvard Business Review, 96, 108-116. https://doi.org/10.1007/s11747-019-00696-0
Gómez-Trigueros, I. M., Ruiz-Bañuls, M., & Ortega-Sánchez, D. (2019). Digital literacy of teachers in training: Moving from ICTs (information and communication technologies) to LKTs (learning and knowledge technologies). Education Sciences, 9(4), 274. https://doi.org/10.3390/educsci9040274
Hao, K. (2019, August 2). China has started a grand experiment in AI education. It could reshape how the world learns. MIT Technology Review. https://www.technologyreview.com/2019/08/02/131198/china-squirrelhas-started-a-grandexperiment-in-ai-education-it-could-reshape-how-the/
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020, March 27). The difference between emergency remote teaching and online learning. EDUCAUSE Review. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning
Hoffman, M., & Blake, J. (2003). Computer literacy: Today and tomorrow. Journal of Computing Sciences in Colleges, 18(5), 221–233.
Jarrahi, M. H. (2018). Artificial intelligence and the future of work: Human–AI symbiosis in organizational decision making. Business Horizons, 61(4), 577–586. https://doi.org/10.1016/j.bushor.2018.03.007
Kandlhofer, M., Steinbauer, G., Hirschmugl-Gaisch, S., & Huber, P. (2016). Artificial intelligence and computer science in education: From kindergarten to university. In IEEE Frontiers in Education Conference (FIE) (pp. 1–9). IEEE. http://doi.org/10.1109/FIE.2016.7757570
Kay, J. (2012). AI and Education: Grand Challenges. IEEE Intelligent Systems, 27(5), 66–69. https://doi.org/10.1109/MIS.2012.92.
Kop, R., Fournier, H., & Mak, J. S. F. (2011). A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses. International Review of Research in Open and Distributed Learning, 12(7), 74–93. https://doi.org/10.19173/irrodl.v12i7.1041
Lea, M. R., & Nicoll, K. (Eds.). (2013). Distributed learning: Social and cultural approaches to practice. Routledge. https://doi.org/10.4324/9781315014500
Lee, S., & Choi, J. (2017). Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity. International Journal of Human- https://doi.org/10.1016/j.ijhcs.2017.02.005
Li, G., Zarei, M.A., Alibakhshi, G. & Labbafi, A. (2024). Teachers and educators’ experiences and perceptions of artificial-powered interventions for autism groups. BMC Psychology, 12, (2024). https://doi.org/10.1186/s40359-024-01664-2
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021). GPT understands, too. arXiv:2013.10385. https://doi.org/10.48550/arXiv.2103.10385
Long, D., & Magerko, B. (2020, April). What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1-16). Association for Computing Machinery. https://aiunplugged.lmc.gatech.edu/wp-content/uploads/sites/36/2020/08/CHI-2020-AI-Literacy-Paper-Camera-Ready.pdf
Luo, X., Tong, S., Fang, Z., & Qu, Z. (2019). Frontiers: Machines vs. humans: The impact of artificial intelligence chatbot disclosure on customer purchases. Marketing Science, 38(6), 937–947. https://doi.org/10.1287/mksc.2019.1192
Marsh, H. W. (1990). The structure of academic self-concept: The Marsh/Shavelson model. Journal of Educational Psychology, 82(4), 623–636. https://doi.org/10.1037/0022-0663.82.4.623
Matheos, K., & Archer, W. (2004). From distance education to distributed learning: Surviving and thriving. Online Journal of Distance Learning Administration, 7(4), 1–13.
Metelskaia, I., Ignatyeva, O., Denef, S., & Samsonowa, T. (2018). A business model template for AI solutions. In Proceedings of the International Conference on Intelligent Science and Technology (pp. 35–41). Association for Computing Machinery.
Mollman, S. (2022). ChatGPT gained 1 million users in under a week. https://www.yahoo.com/video/chatgpt-gained-1-million-followers-224523258.html?
Mühlenbrock, M., Tewissen, F., & Hoppe, U. (1998). A framework system for intelligent support in open distributed learning environments. International Journal of Artificial Intelligence in Education, 9, 256–274.
Norman, D. (2013). The design of everyday things: Revised and expanded edition. Basic Books.
Poria S, Cambria E, Bajpai R & Hussain A (2017) A review of affective computing: From unimodal analysis to multimodal fusion, Information Fusion, 37, 98-125. http://doi.org/10.1016/j.inffus.2017.02.003
Rosling, A., & Littlemore, K. (2011). Improving student mental models in a new university Information setting. In Digitisation Perspectives (pp. 89–101). Brill.
Russell, S. J., & Norvig, P. (2010). Artificial intelligence: A modern approach. Pearson.
Salmela‐Aro, K., & Upadyaya, K. (2014). School burnout and engagement in the context of demands–resources model. British Journal of Educational Psychology, 84(1), 137–151. DOI: 10.1111/bjep.12018
Seligman, M. E. P., Ernst, R. M., Gillham, J., Reivich, K., & Linkins, M. (2009). Positive Education: Positive psychology and classroom interventions. Oxford Review of Education, 35(3), 293–311. DOI:10.1080/03054980902934563
Stembert, N., & Harbers, M. (2019). Accounting for the human when designing with AI: Challenges identified. In CHI’19-extended abstracts, Glasgow, Scotland UK—May 04-09, 2019.
Suldo, S. M., Shaunessy, E., & Hardesty, R. (2008). Relationships among stress, coping, and mental health in high-achieving high school students. Psychology in the Schools, 45(4), 273–290. https://doi.org/10.1002/pits.20300
Tao, J., & Tan, T. (2005). Affective computing: A review. In International Conference on Affective Computing and Intelligent Interaction (pp. 981–995). Springer.
Tarafdar, M., Beath, C. M., & Ross, J. W. (2019, June 11). Using AI to enhance business operations. MIT Sloan Management Review. https://sloanreview.mit.edu/article/using-ai-to-enhance-business-operations/
Terra, M., Baklola, M., Ali, S., & El-Bastawisy, K. (2023). Opportunities, applications, challenges and ethical implications of artificial intelligence in psychiatry: A narrative review. Egyptian Journal of Neurology, Psychiatry and Neurosurgery, 59(1), 80–90. https://doi.org/10.1186/s41983-023-00681-z
Vossen, G., & Hagemann, S. (2010). Unleashing Web 2.0: From concepts to creativity. Elsevier.
Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behavior and Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929X.2022.2072768
Wang, Y. Y., & Wang, Y. S. (2022). Development and validation of an artificial intelligence anxiety scale: An initial application in predicting motivated learning behavior. Interactive Learning Environments, 30(4), 619–634. https://doi.org/10.1080/10494820.2019.1674887
Wladawsky-Berger, I. (2017, February 22). The emerging, unpredictable age of AI. MIT Initiative on the Digital Economy. http://ide.mit.edu/news-blog/blog/emergingunpredictable-age-ai
Yeager, D. S., & Dweck, C. S. (2012). Mindsets that promote resilience: When students believe that personal characteristics can be developed. Educational Psychologist, 47(4), 302–314. https://doi.org/10.1080/00461520.2012.722805
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons Attribution 4.0 International Licence. The copyright of all content published in IRRODL is retained by the authors.
This copyright agreement and use license ensures, among other things, that an article will be as widely distributed as possible and that the article can be included in any scientific and/or scholarly archive.
You are free to
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms below:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
