Scopus

A Comprehensive Survey on AI-based Student Behavior Recognition in Classrooms: Datasets, Models, and Practi-cal Challenges

Năm XB 2026 Tạp chí / Hội thảo Advances in Information and Communication Technology: Proceedings of the 4th International Conference, ICTA 2025, Volume 1 Volume 1, pp. 95-104 Đơn vị ICTU DOI / Link https://link.springer.com/chapter/10.1007/978-3-032-18316-3_12 ↗

Tác giả

Tóm tắt

Detecting student behavior using Artificial Intelligence is an important research direction aimed at improving classroom management and personalizing education. This paper reviews terminology, definitions, methods, datasets, and edge models for student behavior recognition in classrooms. It analyzes image-based, audio-based, and multimodal approaches, evaluates common datasets, and highlights practical challenges related to data, models, ethics, and privacy, with attention to Vietnam-specific datasets and responsible AI use.

Tài liệu tham khảo

[1] Smuha, N.A.: From a ‘race to AI’ to a ‘race to AI regulation’: regulatory competition for artificial intelligence. Law Innov. Technol. 13(1), 57–84 (2021)

[2] Peter, N., Intelligence, R.S.A.: A Modern Approach. Pearson Education, USA (2021)

[3] Duong, N.T., Pham Thi, T.D., Pham, V.K.: A Comparative Study on AI-Based Learning Behaviors: Evidence from Vietnam. Int. J. Hum.-Comput. Interact. 1–17 (2024)

[4] Liu, Q., Jiang, X., Jiang, R.: Classroom behavior recognition using computer vision: a systematic review. Sensors 25(2), 1–22 (2025)

[5] Lin, F.C., Ngo, H.H., Dow, C.R., Lam, K.H., Le, H.L.: Student behavior recognition system for the classroom environment based on skeleton pose estimation and person detection. Sensors 21(16) (2021)

[6] Yang, F.: SCB-dataset: a dataset for detecting student classroom behavior. arXiv preprint arXiv:2304.02488 (2023)

[7] Zhao, J., Zhu, H.: Cbph-net: A small object detector for behavior recognition in classroom scenarios. IEEE Trans. Instrum. Meas. 72, 1–12 (2023)

[8] Fu, R., et al.: Learning behavior analysis in classroom based on deep learning. In: Proc. 10th Int. Conf. on Intelligent Control and Information Processing (ICICIP), pp. 206–212. IEEE, Nanchang (2019)

[9] Zheng, R., Jiang, F., Shen, R.: Intelligent student behavior analysis system for real classrooms. In: Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), pp. 9244–9248. IEEE, Barcelona (2020)

[10] Zhou, H., Jiang, F., Si, J., Xiong, L., Lu, H.: Stuart: Individualized classroom observation of students with automatic behavior recognition and tracking. In: Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5. IEEE, Rhodes (2023)

[11] Zhang, K., Ling, W.: Joint Motion Information Extraction and Human Behavior Recognition in Video Based on Deep Learning. IEEE Sens. J. 20(20), 11919–11926 (2020)

[12] Yang, F.: A spatio-temporal attention-based method for detecting student classroom behaviors. arXiv preprint arXiv:2310.02523 (2023)

[13] Sümer, Ö., Goldberg, P., D’Mello, S., Gerjets, P., Trautwein, U., Kasneci, E.: Multimodal engagement analysis from facial videos in the classroom. IEEE Trans. Affect. Comput. 14(2), 1012–1027 (2021)

[14] Ahuja, K., et al.: EduSense: Practical classroom sensing at scale. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3(3), 1–26 (2019)

[15] Ahuja, K., et al.: Classroom digital twins with instrumentation-free gaze tracking. In: Proc. CHI Conf. on Human Factors in Computing Systems, pp. 1–9. ACM, Yokohama (2021)

[16] Hsu, S.C., Chuang, C.H., Huang, C.L., Teng, R., Lin, M.J.: A video-based abnormal human behavior detection for psychiatric patient monitoring. In: Int. Workshop on Advanced Image Technology (IWAIT), pp. 1–4. IEEE, Chiang Mai (2018)

[17] Lin, F.C., Ngo, H.H., Dow, C.R., Lam, K.H., Le, H.L.: Student behavior recognition system for the classroom environment based on skeleton pose estimation and person detection. Sensors 21(16), 5314 (2021)

[18] Vanneste, P., et al.: Computer vision and human behaviour, emotion and cognition detection: A use case on student engagement. Mathematics 9(3), 287 (2021)

[19] Pabba, C., Kumar, P.: An intelligent system for monitoring students’ engagement in large classroom teaching through facial expression recognition. Expert. Syst. 39(1), e12839 (2022)

[20] Zheng, R., Jiang, F., Shen, R.: Intelligent student behavior analysis system for real classrooms. In: ICASSP 2020 – 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9244–9248. IEEE (2020)

[21] Zhang, Y., Liu, J., Wang, J., Dai, L., Guo, F., Cai, G.: Federated learning for cross-domain data privacy: a distributed approach to secure collaboration. In: 2025 8th International Symposium on Big Data and Applied Statistics (ISBDAS), pp. 824–828. IEEE (2025)

Ghi chú

Source ID: 67; Author classification: ICTU - CoAuthor; First listed author: Le Truong Giang; Contact author: Le Truong Giang, Dang Trong Hop; Total authors: 6; Springer matched from provided ICTA 2025 volumes