Socio Technical Perspectives on Implementing Artificial Intelligence for Formative Assessment in Culturally Diverse Educational Institutions
DOI:
https://doi.org/10.61132/ijets.v2i4.468Keywords:
Artificial Intelligence, Cultural Diversity, Educational Technology, Formative Assessment, Socio Technical FactorsAbstract
The integration of Artificial Intelligence (AI) into educational settings, particularly in formative assessments, offers significant benefits in terms of personalized learning, real time feedback, and increased efficiency. However, the successful implementation of AI driven formative assessments depends not only on technological capabilities but also on socio cultural and organizational factors that shape its adoption. This study explores the socio technical factors influencing the use of AI in formative assessments, emphasizing the importance of considering cultural diversity, institutional culture, and educators' beliefs. AI technologies, while powerful in automating grading and providing personalized assessments, often face limitations in addressing complex student responses that require human judgment. Furthermore, cultural factors, such as students' prior exposure to technology and different cultural attitudes towards AI, play a critical role in the acceptance and effectiveness of these tools. Organizational factors, including leadership support, digital literacy, and the readiness of institutions to adopt AI, are also key determinants in the successful implementation of AI systems in education. Teachers’ beliefs about assessment influence their acceptance and use of AI tools, highlighting the need for professional development and training to ensure that AI enhances pedagogical goals rather than replacing human expertise. The study concludes that the alignment of technology, culture, and assessment beliefs is essential for the effective use of AI driven formative assessments in educational settings. Recommendations for educational institutions include adopting a socio technical approach to AI integration, with a focus on providing resources, training, and fostering a culture of innovation. Future research directions should focus on expanding studies to diverse educational contexts, conducting longitudinal research on AI’s impact on learning outcomes, and exploring additional socio technical frameworks to guide AI adoption in education.
References
Aldaghri, A. A., & Alshraah, S. M. (2025). Sociocultural perspectives on artificial intelligence in English language learning: Insights from Saudi university students. World Journal of English Language, 15(8), 110–121. https://doi.org/10.5430/wjel.v15n8p110
Ali, R., & Bahrami, M. R. (2025). AI in educational assessment, applications, and implications: A survey. Smart Innovation, Systems and Technologies, 406, 383–390. https://doi.org/10.1007/978-981-97-6469-3_33
Amjad, A. I. (2025). Redesigning AI for inclusion: University students' experiences with cultural exclusion in AI learning systems. https://doi.org/10.4018/979-8-3373-4217-7.ch006
Barrot, J. S. (2026). Generative artificial intelligence for automated essay scoring: Exploring teacher agency through an ecological perspective. Assessing Writing, 67. https://doi.org/10.1016/j.asw.2025.100990
Bonito-Caimiñague, G., Apolo-Buenaño, D., & Hermann-Acosta, A. (2025). Artificial, collective, and connected intelligence in education: A review of criticisms of its dynamics in the context of posthumanity. Izquierdas, 54.
Deroncele-Acosta, A., Bellido-Valdiviezo, O., Sánchez-Trujillo, M. de los Á., Palacios-Núñez, M. L., Rueda-Garcés, H., & Brito-Garcías, J. G. (2024). Ten essential pillars in artificial intelligence for university science education: A scoping review. SAGE Open, 14(3). https://doi.org/10.1177/21582440241272016
Dockens, A. L., & Shelton, K. (2025). AI for formative and summative assessment: A balanced approach. https://doi.org/10.4018/979-8-3373-5102-5.ch013
Donovan, S. J. (2025). Humanizing assessment foundations and framework. https://doi.org/10.4324/9781003587262-1
Dubey, P. K., Crevar, A. R., & Rischard, M. K. (2025). Relevance of artificial intelligence in assessment: A balanced approach. https://doi.org/10.4018/979-8-3373-2397-8.ch016
Ghannam, Y. P. (2024). Crafting a winning workplace culture: Understanding organizational dynamics using AI tools. https://doi.org/10.4018/979-8-3693-6447-5.ch002
Hopfenbeck, T. N., Zhang, Z., Sun, S. Z., Robertson, P., & McGrane, J. A. (2023). Challenges and opportunities for classroom-based formative assessment and AI: A perspective article. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1270700
Ivanović, M., et al. (2022). Current trends in AI-based educational processes—An overview. Learning Analytics and Intelligent Systems, 29, 1–15. https://doi.org/10.1007/978-3-031-04662-9_1
Khlaif, Z., Odeh, A., & Bsharat, T. R. K. (2024). Generative AI-powered adaptive assessment. https://doi.org/10.4018/979-8-3693-6397-3.ch007
Kim, S.-W., & Lee, Y. (2024). Investigation into the influence of socio-cultural factors on attitudes toward artificial intelligence. Education and Information Technologies, 29(8), 9907–9935. https://doi.org/10.1007/s10639-023-12172-y
Kumar, P., & Kumar, S. (2025). Influence of socio-technical factors of AI-enabled ICTs in governance. Smart Innovation, Systems and Technologies, 121, 359–369. https://doi.org/10.1007/978-981-96-6254-8_27
Leuba, V., & Piricz, N. (2024). AI adoption in healthcare: Addressing challenges and change management. In Proceedings of the IEEE 24th International Symposium on Computational Intelligence and Informatics (CINTI 2024) (pp. 283–288). https://doi.org/10.1109/CINTI63048.2024.10830852
López-Pastor, V., & Sicilia-Camacho, A. (2017). Formative and shared assessment in higher education: Lessons learned and challenges for the future. Assessment & Evaluation in Higher Education, 42(1), 77–97. https://doi.org/10.1080/02602938.2015.1083535
Lu, W., & Lin, C. (2025). Meta-analysis of influencing factors on the use of artificial intelligence in education. Asia-Pacific Education Researcher, 34(2), 617–627. https://doi.org/10.1007/s40299-024-00883-w
Mamane, A., & Naidoo, R. (2026). AI-enabled cybersecurity implementation: A case study of critical success factors in a South African state-owned entity. Communications in Computer and Information Science, 2784, 405–420. https://doi.org/10.1007/978-3-032-11733-5_25
Merhi, M. I. (2023). An evaluation of the critical success factors impacting artificial intelligence implementation. International Journal of Information Management, 69. https://doi.org/10.1016/j.ijinfomgt.2022.102545
Murire, O. T. (2024). Artificial intelligence and its role in shaping organizational work practices and culture. Administrative Sciences, 14(12). https://doi.org/10.3390/admsci14120316
Naidu, K., & Sevnarayan, K. (2025). Culturally relevant assessment and generative AI: A co-creation framework for pre-service teachers. Journal of Applied Learning and Teaching, 8(2), 132–142. https://doi.org/10.37074/jalt.2025.8.2.20
Nguyen, T. A. (2025). Cultural considerations in AI-based ELT assessments: A case study of Van Lang University. https://doi.org/10.4018/979-8-3693-8317-9.ch005
Pan, Y., Wang, L., & Zhu, Y. (2024). Strategic questioning for formative assessment in TEFL: Insights from blended synchronous learning environments. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-04086-y
Qian, Z. (2021). Applications, risks and countermeasures of artificial intelligence in education. In Proceedings of the 2nd International Conference on Artificial Intelligence and Education (ICAIE 2021) (pp. 89–92). https://doi.org/10.1109/ICAIE53562.2021.00026
Sultana, S. K. S., Renugadevi, R., Bhargavi, M., & Biyabani, S. A. (2025). AI-driven evaluation techniques: Revolutionizing student practices. https://doi.org/10.1201/9781003470304-1
Tao, W. (2024). Fostering inspirational learning through AI-enhanced formative assessment: Strategies and challenges in higher education. https://doi.org/10.4018/979-8-3693-6351-5.ch008
Tomaževič, N., Murko, E., & Aristovnik, A. (2024). Organisational enablers of artificial intelligence adoption in public institutions: A systematic literature review. Central European Public Administration Review, 22(1), 109–138. https://doi.org/10.17573/cepar.2024.1.05
Tuncer, T. T., & Varoglu, A. K. (2025). Empowering organizations with AI: Strategies, challenges, and future directions. https://doi.org/10.4018/979-8-3373-2523-1.ch002
Tvenge, N., Martinsen, K., & Holtskog, H. (2019). Learning factories as laboratories for socio-technical experiments. In Procedia Manufacturing (pp. 337–342). https://doi.org/10.1016/j.promfg.2019.03.053
Ul Haq, F., Asim, M., Suki, N. M., Zakaria, N., & Hussain, S. (2025). AI adoption and educational effectiveness in emerging higher education institutions: The moderating role of digital literacy and institutional support. Journal of Information and Knowledge Management. https://doi.org/10.1142/S021964922550090X
Yavuz, M., & Kayali, B. (2025). Artificial intelligence-supported formative and summative assessment approaches in blended learning environments. https://doi.org/10.4018/979-8-3373-3815-6.ch006
Zöll, A., Eitle, V., & Hendriks, P. (2024). Uncovering cultural differences in organizational readiness for artificial intelligence: A comparison between Germany and the United States. In Proceedings of the Annual Hawaii International Conference on System Sciences (pp. 787–796).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 International Journal of Educational Technology and Society
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
