Manuscript accepted on :March 19, 2018
Published online on:
Classification of Emotional States in Parkinson’s Disease Patients using Machine Learning Algorithms
Rejith K. N1 and Kamalraj Subramaniam2
1Research scholar, Karpagam university, Coimbatore India.
2Faculty of Engineering, Karpagam University, India.
Corresponding Author E-mail: firstname.lastname@example.org
Individuals with Parkinson’s disease have been stressed and shown difficulty in various emotion recognition. In recent years, numerous studies have been conducted in emotion recognition of Parkinson’s disease (PD). EEG signals helps to find out the connections between emotional condition and its brain activities. In this paper, classification of EEG based emotion recognition in Parkinson’s disease was analyzed using four features and two classifiers. Six emotional EEG stimuli such as happiness, sadness, fear, anger, surprise, and disgust were used to categorize the PD patients and healthy controls (HC). For each EEG signal, the alpha, beta and gamma band frequency features are obtained for four different feature extraction methods (Entropy, Energy-Entropy, Spectral Entropy and Spectral Energy-Entropy). The extracted features are then associated to different control signals and two different models (Probabilistic Neural Network and K-Nearest Neighbors Algorithm) have been developed to observe the classification accuracy of these four features. The proposed combination feature, Energy–Entropy feature performs evenly for all six emotions with accuracy of above 80% when compared to other features, whereas different features with classifier gives variant results for few emotions with highest accuracy of above 95%.
Cognitive Deficit; Electroencephalogram; Emotion; Emotional Deficits; Non-Linear Methods; Parkinson’s DiseaseDownload this article as:
|Copy the following to cite this article:
Rejith K. N, Subramaniam K. Classification of Emotional States in Parkinson’s Disease Patients using Machine Learning Algorithms. Biomed Pharmacol J 2018;11(1).
|Copy the following to cite this URL:
Rejith K. N, Subramaniam K. Classification of Emotional States in Parkinson’s Disease Patients using Machine Learning Algorithms. Biomed Pharmacol J 2018;11(1). Available from: http://biomedpharmajournal.org/?p=19602
Electroencephalogram (EEG) signals or brain signals are used widely to diagnose epilepsy, sleep disorders, depth of anesthesia, coma, encephalopathy, and brain death and also for detecting tumors, stroke and other focal brain disorders as front line method. Other applications like developing brain machine interface using motor signals and Parkinson’s individual’s emotional recognition were researched diversely in recent years. In patients, emotional processing with disorder were analyzed using neuroimaging techniques such as functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) and these techniques helps to identify the specific region of emotional functions . In previous research works, emotional processing in patients with disorder were analyzed using neuroimaging techniques such as functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) and these techniques helps to identify the specific region of emotional functions . It is also noted that the right hemisphere is involved with positive emotions such as happiness and surprise and the left hemisphere is involved with negative emotions such as sad, anger, fear, and disgust . Various researchers have shown their interest on motor and cognitive impairments in neurological disorder people. Later on, researchers have focused on investigating the emotional conditions in people with neurological disorders .
In the previous study, researchers have focused emotional investigations in various neurological disorders such as Parkinson’s disease, Stroke, Huntington’s disease, and Alzheimer’s disease. In this article, we focused and reviewed on emotional recognition of Parkinson’s disease individuals. Patients with Parkinson’s disease (PD) have central nervous system disorder which affects motor system with low voluntary muscle controls, sleep issues and behavior problems. Such people lead to depression and anxiety with high emotional behavior. PD individual’s emotional states and their abilities in recognition of emotion were analyzed in this study.
In PD emotion investigation, researchers have used various analyzing techniques based on EEG signals using visual stimuli, audio stimuli, audio-visual stimuli and speech prosody analysis. In early stage of PD emotion analysis, various researches were conducted on analyzing right-hemisphere disease (RHD) individuals and left-hemisphere disease (LHD) individuals [5, 6].Later five distinct emotional studies were conducted such as happiness, (pleasant) surprise, anger, disgust, and sadness and emotional data were recorded using unfamiliar face expressions [8, 9,11,15]. Further few researchers analyzed on six emotional studies (happiness, sadness, fear, anger, surprise, and disgust) on PD and HC individuals [13, 17,18]. The rest of the paper is organized as follows: Section II describes the data collection and feature extraction method. Section III illustrates the designed network model and its performances. Section IV and V presents the results and conclusion, showing the results of Emotional EEG signals.
Protocol and Data Collection
Database of twenty non-demented PD patients and 20 healthy controls viewed emotional stimuli with fourteen-channel EEG recording were used in this study . Twenty non-demented PD patients (10men and 10women) and 20 healthy controls (9 men and 11 women) matched for age (range from 40 to 65 years), education level, and gender participated in the study. The PD patients were recruited through the Neurology Unit outpatient service at the Department of Medicine of the Hospital University Kebangsaan Malaysia (HUKM) medical center in Kuala Lumpur, Malaysia. All of them had been diagnosed with Idiopathic PD by a neurologist. Patients who had coexisting neurological disturbances (e.g., epilepsy, stroke) or who had undergone deep brain stimulation were not included in the study. The HC participants were recruited through the hospital community and/or from relatives of PD patients. Multimodal stimulus (combination of audio and visual) was used to evoke the emotions. To classify the EEG-based emotional states and visualize the changes of emotional states over time, this paper compares four kinds of EEG features for emotional state classification.
Feature Extraction Process
In this section, feature extraction processes using spectral features are described and carried out. Four features namely Entropy, Energy-Entropy, Spectral Entropy and Spectral Energy-Entropy were proposed and analyzed based on the statistical approach . First the raw EEG data was preprocessed and then feature extraction was performed. The recorded signals were segmented into number of frames with a overlapping of 75% . Each frame has 1280 samples (corresponding to 10 second). The segmented signals were then filtered using pass band elliptic filters and the alpha (7 to 14 Hz), beta (14 to 21 Hz) and gamma (21 to 34 Hz) from all the 14 channels [1, 11] were obtained.
Entropy (EN) value is calculated using the Shannon entropy. From the filtered values, the entropy feature is calculated using the Equation (1),
Energy- Entropy (EEN) value is calculated using the power values of Shannon entropy. From the filtered values, the EEN feature is calculated using the Equation (2),
For Spectral Entropy (SEN) feature extraction process, from the filtered values, x(q) were first Fourier transformed to using the Equation (3),
is the complex exponential and N is the total number of data in the filtered signal. From the Fourier transformed signal Y (m), the SEN value is calculated using Equation (4),
Where N = 128, is the number of samples.
Then the Spectral Energy- Entropy(EEN) value is calculated using the power values of Spectral entropy. From the filtered values, the EEN feature is calculated using the Equation (5),
Similarly, the features corresponding to the PD and HC performed by all the twenty subjects (for all trials) were extracted using fourteen channels. Each frame has 42 (14 channels x 3 bands) feature values and it is given as input to the network model.
K-Nearest Neighbor Algorithm
In pattern recognition, the k-nearest neighbor algorithm (KNN) is a non-parametric method used for classification and regression. In k-NN classification, the output is a class membership. An object is classified by a majority vote of its neighbors, with the object being assigned to the class most common among its k nearest neighbors (k is a positive integer, typically small). If k = 1, then the object is simply assigned to the class of that single nearest neighbor. For this KNN model same 42 input values were given and the accuracy results of each emotion (happiness-E1, sadness-E2, fear-E3, anger-E4, surprise-E5, and disgust-E6) and the corresponding smoothing parameter (K) ranges from 1 to 10 are tabulated in Table 1a, 1b, 1c and 1d.
Table 1a: Results of SpectralEntropy feature using KNN classifier
Table 1b: Results of Entropy feature using KNN
Table 1c: Results of Energy Entropy feature using KNN
Table 1d: Results of Spectral Energy-Entropy feature
Probabilistic Neural Network
To discriminate the PD and HC for six different emotions, probabilistic neural network (PNN) has been developed. PNN is a supervised neural network proposed by Donald F. Specht [19, 20] and it is a kind of radial basis network suitable for classification problems. The PNN is a direct continuation of the work based on Bayesian classification and classical estimators for probability density function. The only factor that needs to be selected for training is the smoothing factor/spread factor which affects the classification accuracy. The network structure of PNNs is similar to that of back propagation [12,13]; the primary difference is that uses exponential activation function instead of sigmoid activation function and also the training time is lesser compared to multi-layer feed forward network trained by back propagation algorithm.
The probabilistic neural net consists of four types of units, namely, input units, pattern units, summation units, and an output unit. The pattern unit computes distances from the input vector to the training input vectors. when an input is presented, it produces a vector whose elements indicate how close the input is to a training input. The summation unit sums these contributions for each class of inputs to produce as its net output a vector of probabilities. Finally, a complete transfer function on the output of the second layer picks the maximum of these probabilities, and produces a 1 for that class and a 0 for the other classes. Furthermore, the shape of the decision surface can be made as complex as necessary, or as simple as desired, by choosing an appropriate value of the smoothing parameter. In this paper, PNN architecture and the feature extraction process are constructed and analysed using MATLAB software. This problem requires 42 input neurons. The accuracy results of each emotion and the corresponding best smoothing parameter (K) ranges from 0.55 to 0.65 are tabulated in Table 2a, 2b, 2c and 2d.
Table 2a: Results of Entropy feature using PNN classifier
Table 2b: Results of Spectral Entropy feature using PNN
Table 2c: Results of Spectral Energy-Entropy feature using PNN classifier
Table 2d: Results of Energy-Entropy feature using PNN classifier
Results and Discussion
To discriminate PD and HC for each emotion, PNN and KNN models have been developed. In this case, two class classifications were carried out using PNN and KNN to categorize these different emotions. The overall classification accuracies of four features for each emotion using two models were tabulated and shown in the figure (A) and (B). While comparing the classification accuracy of four features, it can be observed that EEN feature performs evenly well for all six emotions. But for emotion E1, maximum accuracy of 96.8 is obtained using SEEN with PNN and second highest accuracy of 95.97 using SEN with PNN. For emotion E2, maximum accuracy of 90.81 is obtained using EN with KNN and second highest accuracy of 90.74 using EEN with KNN. For emotion E3, maximum accuracy of 95.07 is obtained using SEEN with KNN and second highest accuracy of 87.97 using EEN with PNN. For emotion E4, maximum accuracy of 88.65 is obtained using EN with KNN and second highest accuracy of 87.16 using SEEN with KNN. For E5, maximum accuracy of 94.53 is obtained using SEEN with KNN and second highest accuracy of 88.04 using SEN with KNN. For E6, maximum accuracy of 87.43 is obtained using EN with KNN and second highest accuracy of 87.03 using EN with PNN.
|Figure 1: Overall Results of En, Een, Sen and Seen Features Using Pnn
From the figure (A), it could be observed that, the highest classification accuracy of 90.68% (for emotion E2) and the lowest classification accuracy of 56.49% (for emotion E1) were obtained for EN feature using PNN. Then the highest classification accuracy of 87.97% (for emotion E3) and the lowest classification accuracy of 80.07% (for emotion E1) were obtained for EEN feature using PNN. For SEN using PNN, the highest classification accuracy of 95.97% (for emotion E1) and the lowest classification accuracy of 67.69% (for emotion E3) were obtained. Then for SEEN using PNN, the highest classification accuracy of 96.8% (for emotion E1) and the lowest classification accuracy of 64.2% (for emotion E3) were obtained for SEEN feature using PNN.
|Figure 2: Overall Results of En, Een, Sen and Seen Features Using Knn.
From the figure (B), it could be observed that, the highest classification accuracy of 90.81% (for emotion E2) and the lowest classification accuracy of 58.65% (for emotion E1) were obtained for EN feature using KNN. Then the highest classification accuracy of 90.74% (for emotion E2) and the lowest classification accuracy of 81.15% (for emotion E1 & E4) were obtained for EEN feature using KNN. For SEN using KNN, the highest classification accuracy of 90.2% (for emotion E2) and the lowest classification accuracy of 80.68% (for emotion E4) were obtained. Then for SEEN using PNN, the highest classification accuracy of 95.07% (for emotion E3) and the lowest classification accuracy of 58.85% (for emotion E1) were obtained for SEEN feature using KNN.
The extracted features were associated to their respective emotions and models were developed successfully. The performance of the two models were tabulated and compared. In this paper, the time domain features EN & EEN and the frequency domain features SEN &SEEN features were extracted from the PD and HC EEG signals and the results were analyzed. From the analysis, it has been clearly observed that the proposed energy-entropy combination feature using PNN and KNN in time domain performs evenly well (above 80.07% to 90.74%) for all emotions. Whereas other features gives lower accuracy values of below 60% for few emotions. But for E1 highest accuracy of 96.8% using PNN and for E3 highest accuracy of 95.07% using KNN were observed in proposed energy-entropy feature in frequency domain only. Hence, the proposed energy-entropy features may perform even much better in time-frequency domain with suitable classifier model.
- Davidson and W. Irwin, “The functional neuro- anatomyof emotion and affective style,” Trends in Cognitive Sciences, vol. 3, pp. 11-21, 1999.
- TottoAlves, S. S. Fukusima, and J. A. Aznar-Casanova, “Models of brain asymmetry in emotional processing,” Psychology& Neuroscience, vol. 1, pp. 63-66, 2008.
- Bevilacqua, D. D’Ambruoso, G. Mandoline, and M. Suma, “A new tool to support diagnosis of neurological disorders by means of facial expressions,” IEEE International Workshop on Medical Measurements and Applications Proceedings (MeMeA), pp. 544-549, 2011
- Teplan, “Fundementals of EEG measurement”, Measurement Science Review, Volume 2,Section 2, 2002.
- Steven T. Dekosky, Kenneth m. Heilman, Dawn Bowers, and Edward Valenstein,”Recognition and Discrimination of Emotional Faces and Pictures”, Brain and Language 9, 206-214, 1980.
- ErichMohr,JorgeJuncos,ChristianeCox,IreneLitvan,PaulFedio,Thomas N Chase,”Selective deficits in cognition and memory in high-functioning parkinsonian patients,Journal of Neurology,Neurosurgery and psychiatry 1990;53:603-606
- Mare Pell ,”On the receptive prosodic loss in Parkinson’s disease,Cortex(1996)32,693-704.
- Shunan Zhao, Frank Rudzicz, Leonardo G. Carvalho, C´esar M´arquez-Chin, Steven Livingstone, “Automatic Detection of Expressed Emotion In Parkinson’s Disease”,
- Marc D. Pella, Carol L. Leonardb,” Facial expression decoding in early Parkinson’s disease”, Cognitive Brain Research 23 (2005) 327– 340, 2005.
- Dawn Bowers ,Kimberly Miller,Ania Mikos,Lindsey Kirch Darrow,Utaka springer,Hubert Fernandez,Kelly Foote and Michael Okun,”Startling facts about emotion in Parkinson’s disease:blunted reactivity to aversive stimuli”,Brain(2006)129,3356-3365.
- Thomas Baumgartner, Michaela Esslen, Lutz Jancke,”From emotion perception to emotion experience:Emotions evoked by pictures and classical music,Internationaljournal of psychophysiology 60(2006) 34-43.
- Christinem Schroder, Janine Mobes, Martin Schutze, Friedemann Szymanoo Nager, Marc Bangewski, Wido NAGER, Marc Bangert, Thomas Frank, Munte and Reinhard Dengler,”Perception of Emotional speech in parkinson’s disease”, Movement disorders,Vol 21,No.10,2006.
- Murugappan, R.Nagarajan, and Sazali Yaacob, “Comparison of Different Wavelet Features from EEG Signals for Classifying Human Emotions”, IEEE Symposium on Industrial Electronics and Applications (ISIEA 2009), October 4-6, 2009.
- Paul raj M P,Sazali Bin Yaccoob,Abdul Hamid Bin Adom,Kamalraj Subramaniam,Hema C R,”EEG based hearing threshold classification using fractal feature and neural networks”, 2012 IEEE Student conference on research and development.
- Chun-Xiao Han, Jiang Wang, Guo-Sheng Yi, Yan-Qiu Che, “Investigation of EEG abnormalities in the early stage of Parkinson’s disease”, Cogn Neurodyn (2013) 7:351–359, 2013.
- Yuvaraj, M. Murugappan, Norlinah Mohamed Ibrahim, Kenneth Sundaraj,MohdIqbal Omar, KhairiyahMohamad, R. Palaniappan, “Detection of emotions in Parkinson’s disease using higher order spectral features from brain’s electrical activity”, Biomedical Signal Processing and Control 14 (2014), 108–116,2014.
- Yuvaraj, M. Murugappan, Norlinah Mohamed Ibrahim, Mohd Iqbal Omar, Kenneth Sundaraj, Khairiyah Mohamad, R. Palaniappan‡ and M. Satiyan, “Emotion classification in Parkinson’s disease by higher-order spectra and power spectrum features using EEG signals: A comparative study”, Journal of Integrative Neuroscience, Vol. 13, No. 1 (2014) 1–32, 2014
- Yuvaraja, M. Murugappanb, U. Rajendra Acharyac, Hojjat Adelid, Norlinah Mohamed Ibrahime, Edgar Mesquitaf, “Brain functional connectivity patterns for emotional state classification in Parkinson’s disease patients without dementia”, Behavioural Brain Research, 298 (2016) 248–260, 2016.
- Palaniappan, P. Raveendran, S. Nishida and N. Saiwaki, “Fuzzy ARTMAP classification of mental tasks using segmented and overlapped EEG Signals”, Proceedings of IEEE Region 10 Conference (TENCON), Kuala Lumpur, Malaysia, pp. 388-391, vol. 2, 25-27 September, 2000.
- N.Sivanandam, M.Paulraj, “Introduction to Artificial Neural Networks”, Vikas Publishing House, India. 2003.
- Laurene Fausett, “Fundamentals of Neural Network”, Prentice Hall, New Jersey, USA, 1994
- Specht, D. F, “Probabilistic Neural Networks”, Neural Networks, Vol.3, pp.109–118, 1990.
- Rajamanickam Yuvaraj, Murugappan Murugappan, Norlinah Mohamed Ibrahim, Mohd. Iqbal Omar, Kenneth Sundaraj, Khairiyah Mohamad, Ramaswamy Palaniappan, Edgar Mesquita and Marimuthu Satiyan,”On the analysis of EEG power, frequency and asymmetry in Parkinson’s disease during emotion processing”, Behavioral and Brain Functions, 2014.