TY - GEN
T1 - Emotion Recognition and Understanding Using EEG Data in A Brain-Inspired Spiking Neural Network Architecture
AU - Alzhrani, Wael
AU - Doborjeh, Maryam
AU - Doborjeh, Zohreh
AU - Kasabov, Nikola
PY - 2021/9/20
Y1 - 2021/9/20
N2 - This paper is in the scope of emotion recognition by employing a brain-inspired recurrent spiking neural network (BI-SNN) architecture for modelling, mapping, learning, classifying, visualising, and understanding of spatio-temporal Electroencephalogram (EEG) data related to different emotional states. It further explores, develops, and applies a methodology based on the NeuCube BI-SNN, that includes methods for EEG data encoding, data mapping into a 3-dimensional BI-SNN model, unsupervised learning using spike-timing dependent plasticity (STDP) rule, spike-driven supervised learning, output classification, network analysis, and model visualisation and interpretation. The research conducted to model different emotional subtypes through mapping both space (brain regions) and time (brain dynamics) components of EEG brain data into brain-inspired SNN architecture. Here, a benchmark EEG dataset was used to design an empirical study that consisted of different experiments for classification of positive emotions (calmness and happiness) and negative emotions (fear and anger). The obtained accuracy of 94.83% for EEG classification of four types of emotions was superior when compared with traditional machine learning techniques, such as Multiple Linear Regression (MLR), Multi-Layer Perceptron (MLP), and Radial Basis Function (RBF). The BI-SNN models not only detected the brain activity patterns related to positive and negative emotions with a high accuracy, but also revealed new knowledge about the brain areas activated in relation to different emotions. The research confirmed that neural activation increased in the frontal sites of brain (F7, F3, AF4) associated with positive emotions, while in the case of the negative emotions, connectivity strength was concentrated in the frontal (F4, AF3, F7, F8) and parietal sites of the brain (P7, P8). The experiments also confirm the suitability of the BI-SNN for emotion recognition using EEG data.
AB - This paper is in the scope of emotion recognition by employing a brain-inspired recurrent spiking neural network (BI-SNN) architecture for modelling, mapping, learning, classifying, visualising, and understanding of spatio-temporal Electroencephalogram (EEG) data related to different emotional states. It further explores, develops, and applies a methodology based on the NeuCube BI-SNN, that includes methods for EEG data encoding, data mapping into a 3-dimensional BI-SNN model, unsupervised learning using spike-timing dependent plasticity (STDP) rule, spike-driven supervised learning, output classification, network analysis, and model visualisation and interpretation. The research conducted to model different emotional subtypes through mapping both space (brain regions) and time (brain dynamics) components of EEG brain data into brain-inspired SNN architecture. Here, a benchmark EEG dataset was used to design an empirical study that consisted of different experiments for classification of positive emotions (calmness and happiness) and negative emotions (fear and anger). The obtained accuracy of 94.83% for EEG classification of four types of emotions was superior when compared with traditional machine learning techniques, such as Multiple Linear Regression (MLR), Multi-Layer Perceptron (MLP), and Radial Basis Function (RBF). The BI-SNN models not only detected the brain activity patterns related to positive and negative emotions with a high accuracy, but also revealed new knowledge about the brain areas activated in relation to different emotions. The research confirmed that neural activation increased in the frontal sites of brain (F7, F3, AF4) associated with positive emotions, while in the case of the negative emotions, connectivity strength was concentrated in the frontal (F4, AF3, F7, F8) and parietal sites of the brain (P7, P8). The experiments also confirm the suitability of the BI-SNN for emotion recognition using EEG data.
KW - Emotion recognition
KW - EEG
KW - Classification
KW - Spiking Neural Networks
KW - NeuCube
U2 - 10.1109/IJCNN52387.2021.9533368
DO - 10.1109/IJCNN52387.2021.9533368
M3 - Conference contribution
SN - 978-1-6654-4597-9
SP - 1
EP - 10
BT - Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN)
PB - IEEE Computational Intelligence Society
T2 - International Joint Conference on Neural Networks
Y2 - 18 July 2021 through 22 July 2021
ER -
