Scopus

A CNN Approach in Building EEG-Based Emotion Recognition System for AIoT Applications

Năm XB 2024 Tạp chí / Hội thảo Intelligence of Things: Technologies and Applications (ICIT 2024) LNDECT, volume 230, pp 123–133 Đơn vị CNTT DOI / Link https://doi.org/10.1007/978-3-031-75596-5_12 ↗

Tác giả

Tóm tắt

In practice, when deploying AIoT applications for emotion recognition based on EEG signals, the devices not only need to be mobile and wireless but often have a small number of electrodes to ensure portability, compactness, and energy efficiency. Additionally, the classification blocks using deep learning networks also need to be adjusted to achieve architectures with fewer parameters while maintaining effective recognition capabilities. Therefore, improvements to the deep learning architecture are necessary to meet these criteria. In this paper, we propose an architecture named EEG_MCIS, which is a 1D-CNN enhanced with Inception and Squeeze and Excitation blocks to suit the EEG data collected from devices with a small number of electrodes. The Inception block divides the 1D-CNN into two branches. The first branch with small kernel size aims to extract local features from the data, and the other with a larger kernel size to enable the model to perceive features over a wider range and capture relationships between more distant data points along the time axis. Meanwhile, the Squeeze and Excitation block leverages information about the importance of each channel, optimizing the classification process for compact EEG-based emotion recognition applications.

Tài liệu tham khảo

[1] Erat, K., Şahin, E.B., Doğan, F., et al.: Emotion recognition with EEG-based brain-computer interfaces: a systematic literature review. Multimed. Tools Appl. (2024). https://doi.org/10.1007/s11042-024-18259-z

[2] Mahmoud, A., Amin, K., Al Rahhal, M.M., Elkilani, W.S., Mekhalfi, M.L., Ibrahim, M.: A CNN approach for emotion recognition via EEG. Symmetry 15(10), 1822 (2023). https://doi.org/10.3390/sym15101822

[3] Samal, P., Hashmi, M.F.: Role of machine learning and deep learning techniques in EEG-based BCI emotion recognition system: a review. Artif. Intell. Rev. 57, 50 (2024). https://doi.org/10.1007/s10462-023-10690-2

[4] Aldawsari, H., Al-Ahmadi, S., Muhammad, F.: Optimizing 1D-CNN-based emotion recognition process through channel and feature selection from EEG signals. Diagnostics 13(16), 2624 (2023). https://doi.org/10.3390/diagnostics13162624

[5] Mahboobeh, J., et al.: Emotion recognition in EEG signals using deep learning methods: a review. Comput. Biol. Med. 165(n.d.), 107450 (2023). https://doi.org/10.1016/J.COMPBIOMED

[6] Ding, Y., Robinson, N., Zhang, S., Zeng, Q., Guan, C.: TSception: capturing temporal dynamics and spatial asymmetry from eeg for emotion recognition. IEEE Trans. Affect. Comput. 14(3), 2238–2250 (2023). https://doi.org/10.1109/TAFFC.2022.3169001

[7] Isuru, J., Michael, C., Senaka, A.: Person identification from EEG using various machine learning techniques with inter- hemispheric amplitude ratio. PLoS ONE 15, 1–24 (2020). https://doi.org/10.1371/journal.pone.0238872

[8] Martina, Ž.: Visual and auditory stimuli response, measured by emotive insight headset. In: MATEC Web of Conferences, vol. 292, p. 01024 (2019). https://doi.org/10.1051/matecconf/201929201024

[9] Mai, T.D.T., Phung, T.N.: Evaluating the performance of some deep learning model for the problem of emotion recognition based on EEG signal. In: Nghia, P.T., Thai, V.D., Thuy, N.T., Son, L.H., Huynh, VN. (eds.) Advances in Information and Communication Technology. ICTA 2023. LNNS, vol. 847. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-49529-8_19

[10] Raveendrababu, V., Lakhan, S.: A systematic review on automated human emotion recognition using electroencephalogram signals and artificial intelligence. Results Eng. 18, 101027 (2023). https://doi.org/10.1016/j.rineng

[11] Christian, S., et al.: Going deeper with convolutions. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9 (2015). https://doi.org/10.1109/CVPR.2015.7298594

[12] Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7132–7141. Salt Lake City, UT, USA (2018). https://doi.org/10.1109/CVPR.2018.00745

[13] Sander, K., & et al.: DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3, 18–31 (2011). https://doi.org/10.1109/T-AFFC.2011.15

[14] Katsigiannis, S., Ramzan, N.: DREAMER: a database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. Zenodo (2017). https://doi.org/10.1109/JBHI.2017.2688239 (2017)

[15] Dar, M.N., Akram, M.U., Khawaja, S.G., Pujari, A.N.: CNN and LSTM-based emotion charting using physiological signals. Sensors 20(16), 4551 (2020). https://doi.org/10.3390/s20164551

[16] Miranda-Correa, J.A., Abadi, M.K., Sebe, N., Patras, I.: AMIGOS: a dataset for affect, personality and mood research on individuals and groups. IEEE Trans. Affect. Comput. 12(2), 479–493 (2021). https://doi.org/10.1109/TAFFC.2018.2884461

[17] Akter, S., Prodhan, R.A., Pias, T.S., Eisenberg, D., Fresneda, F.J.: M1M2: deep-learning-based real-time emotion recognition from neural activity. Sensors 22(21), 8467 (2022). https://doi.org/10.3390/s22218467

[18] Acharya, D. et al.: Multi-class emotion classification using EEG signals. In: Garg, D., Wong, K., Sarangapani, J., Gupta, S.K. (eds.) Advanced Computing. IACC 2020. Communications in Computer and Information Science, vol. 1367. Springer, Singapore IACC (2020). https://doi.org/10.1007/978-981-16-0401-0