{"id":31272,"date":"2020-03-28T10:14:51","date_gmt":"2020-03-28T10:14:51","guid":{"rendered":"http:\/\/biomedpharmajournal.org\/?p=31272"},"modified":"2020-04-22T12:35:47","modified_gmt":"2020-04-22T12:35:47","slug":"a-deep-learning-based-approach-towards-the-automatic-diagnosis-of-pneumonia-from-chest-radio-graphs","status":"publish","type":"post","link":"https:\/\/biomedpharmajournal.org\/staging\/vol13no1\/a-deep-learning-based-approach-towards-the-automatic-diagnosis-of-pneumonia-from-chest-radio-graphs\/","title":{"rendered":"A Deep Learning Based Approach towards the Automatic Diagnosis of Pneumonia from Chest Radio-Graphs"},"content":{"rendered":"<p><strong>Introduction<\/strong><\/p>\n<p>Pneumonia is a one of the common acute respiratory lung disease. Children under the age of 5 years easily get infected with this disease. The WHO estimate that around 1.4 millions of children lost their life due to the failure of detecting this lung disease at its early stage[1].\u00a0 Viral pneumonia and the bacterial pneumonia are the two major type that can cause severe damages to the human respiratory system Different types of clinical management is required for the cure of these infection.\u00a0 Antibiotics are used to recover the bacterial infected pneumonia while viral infected patient need the different medication and supportive care for recovery of the diseases. Chest X-ray (CXR) analysis is the chosen as one of the most preferably for the medical practitioner for\u00a0\u00a0\u00a0 diagnosing the pneumonia disease [2]. Accurately identifying and categorizing the pneumonia subtypes is an important and challenging clinical task, and automated methods can be used to save time and reduce error.\u00a0 Deep learning techniques can be used to recognize and identify the type of pneumonia infection in the patient and proper clinical treatment can be provided towards making the patient cure from this kind of respiratory infection. Deep Siamese based CNN method can be associated with the radiographic examination towards detecting the particular type of pneumonia [12].<\/p>\n<p>Despite of several advantages of X-ray imaging, still in some cases it is not possible to identify the correct region of interest in the radiographic image for detecting the diseases.\u00a0 It is also observed that as the diagnostic accuracy of automated method reach the human level. This makes researchers to develop automated methods for detection of diseases through radiography imagery. Automated detection method provides an add on support to the clinical experts towards a\u00a0 ease of diagnosing the disease.\u00a0 For all the aforementioned reasons, we have developed a robust CNN based method to identify the different types of pneumonia diseases identification with X-ray imaging.<\/p>\n<p>Convolutional neural networks (CNNs) belong to a class of Deep Learning models that are highly used in the field of computer vision [3]. These models have multiple processing layers to learn hierarchical feature representations from the input pixel data. It helps in learning the model for extracting the features and then infers or construct the object for classifying the task.\u00a0 Commonly used CNN architecture are SegNet [5], CardiacNet [6] and U-Net [9]. These architecture are profoundly used in the classification task of medical imagining data. All these model having large number of decision parameter which can be used by the developers towards resolving the real time problem.\u00a0 In the current research work, we proposed a deep Siamese based method towards predicting the CNN model in classifying the chest X ray to detect the different types of pneumonia infection. DSN basically\u00a0 use the symmetric structure of image\u00a0 that learn useful data descriptor to compare the inputs of the respective sub networks.\u00a0 Each\u00a0 CXR image\u00a0 is segmented into two region that is left and right segment and then pass through each of the sub network\u00a0 of DSN for predicting the amount of white substance that spread across these region.\u00a0 Correct identification of the region and the amount of the thickness of the substance on the ROI is the main criteria of visualizing the class type\u00a0 of pneumonia.<strong>\u00a0<\/strong><\/p>\n<p><strong>Related Work<\/strong><\/p>\n<p>With the recent development of\u00a0 deep learning CNN model, many work has been carried out\u00a0 in the field of medical imaging such as skin diseases classification, Automated\u00a0 knee arthritis detection, diabetic retinopathy detection[14], Automated diagnoses of Chest\u00a0 disease with radiography,\u00a0 arrhythmia detection [13] etc. One of the common threat to human health is the pulmonary problem. Diseases like tuberculosis, pneumonia and lung cancer if not detected in the earlier stage then it may create a major threat to human health. Reviewing all the medical imaging problem with deep learning methodology is out of scope of this paper. However, We have briefly discuss some of the important methodology detecting the pneumonia disease with chest radiography[7-10]. Khobragade et al.[11], proposes artificial neural netwok based classification method that\u00a0 use lung segmentation to detect various lung related disease.\u00a0 Lakhani et al[1], proposes the classification of pulmonary tuberculosis diseases using CNN model with x-ray imaging.\u00a0 S.Rajaraman et al. [12] developed a CNN based segmentation method\u00a0 towards classifying the different kinds of pneumonia diseases in pediatric patient.<\/p>\n<p>CNN has been choosen as the one of the best technique\u00a0 towards\u00a0 detecting diseases such as brain cancer, colorectal cancer etc. Lisowska et al.[4] contributed, a 3D based CNN model for the detection\u00a0 of\u00a0 brain stoke. This model uses the contralateral feature and atlas information\u00a0 for the classification of a stroke.\u00a0 Ponzio et al[10] developed a deep learning technique based on Convolutional Neural Networks to differentiate adenocarcinomas from healthy tissues and benign lesions.<\/p>\n<p>Wang et al[13] developed a Chest-Xray8 database with text-mined eight disease image labels from radiological reports using natural language processing. Kerman etal[14] uses the CNN model for classifying the different kinds of pneumonia infection for the pediatrics patient. Their approach based on V3 inception model that extract the fixed features and use\u00a0 area under curve(AUC) as the measuring tool to\u00a0\u00a0 classify the viral and bacterial\u00a0 pneumonia.\u00a0 Santosh et al13] has proposed method to detect the pulmonary abnormalities using the comparison of symmetric structure of the lung region from the chest X-ray.\u00a0 Rajaraman et al[8] also use the simple VGG16 model for the pneumonia detection from the pediatric chest x-ray image. \u00a0The main objective of this paper is to build a model based on convolution neural network in order to recognize the pneumonia from the\u00a0 X-ray image\u00a0 and then classify to its particular type.<\/p>\n<p><strong>Materials and Methods<\/strong><\/p>\n<p><strong>Description of the Dataset<\/strong><\/p>\n<p>We have used the Kaggle dataset for the training and testing the diseases. This dataset contains 5,528 number of X-ray image. In the preprocessing stage, poor quality X-ray image were found and those images are preprocessed and trained in order to classify it correctly. Furthermore each X-ray image is divided into two segments that is right and left region. In the proposed work our main intention is to identify pneumonia and then classify into its particular type that is either viral pneumonia or the bacterial\u00a0 pneumonia.\u00a0 Figure 1 shows a case study of\u00a0\u00a0 bacterial and viral pneumonia X-ray image.\u00a0\u00a0 In the radiography image, bacterial\u00a0\u00a0 pneumonia, the alveoli become filled with secretion of the white inflammatory fluid while in the viral pneumonia, left most part of the chest is infected with the white spot. From the state of the art, it is found that\u00a0\u00a0 AUC parameter can be\u00a0 used\u00a0 to classify the pneumonia type on the basis of the\u00a0 amount of white fluid infected the chest.\u00a0 In the proposed work, the dataset is organized into 3 folders mainly training, testing and validation and contains sub-folders for each image category. We trained all our models for identifying the pneumonia as well as the type of pneumonia infection.\u00a0 As shown in the Figure 2, in the training phase, each of the sample image is first segmented into left and right segment and then the segmented image is normalized to process it for classification.\u00a0 To tune the classification parameter and to reduce the over fitting problem, training model is feed to the validation process.\u00a0\u00a0 Network validation is used and further more to validate the model, cross-validation of k-fold is used, which consists of dividing the images into two sets i,e\u00a0 testing\u00a0 and training. The method is repeated for 5 times, changing the test and training images after the calculation of k.<\/p>\n<table style=\"width: 70%;\" border=\"1\" cellpadding=\"5\">\n<tbody>\n<tr>\n<td><img decoding=\"async\" class=\"alignnone size-thumbnail wp-image-31283\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig1-150x150.jpg\" alt=\"Figure 1: X-ray image of Normal. Bacterial and Viral pneumonia patient\" width=\"150\" height=\"150\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig1-150x150.jpg 150w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig1.jpg 633w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td>\n<td><strong>Figure 1:\u00a0 X-ray image of Normal. Bacterial and Viral pneumonia patient<\/strong><\/p>\n<p><a href=\"http:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig1.jpg\" target=\"_blank\"><span style=\"font-family: inherit; font-size: inherit;\">Click here to View Figure<\/span><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><strong>Network Architecture<\/strong><\/p>\n<p>We have used Deep Siamese CNN architecture for our proposed classification problem. The original application of this architecture was to learn a similarity metric between pairs of images.\u00a0 Left\u00a0 segmented region of the CXR image is flipped vertically, required for the semantic analysis of the two portion of the chest region. Usually, the whole network consists of two branches, where each one corresponds to each input image. Our model consists of two step. In the first step we have identified two region of the image and train the model to compare with the normal X-ray image. Followed to this in the 2nd step, we compare the Symantec visibility region of left and right segmented region of the chest X-ray image. This comparison revels the amount of thickness and spreading of the white substance which leads to the identification of the particular type of\u00a0\u00a0 pneumonia infection.<\/p>\n<p>As shown in the Figure 2, left and right segment of the image is separated and then passes through the network. Left patch of the segregated image is flipped horizontally, These segmented image patch are then input to the two network branches, which contains different blocks employed for different layer of CNN such as convolution layer, pooling\u00a0 Relu layer and soft max layer. each branch again pass through the five convolutional layer\u00a0 and one fully connected layer. Convolution (Conv), rectified linear unit (ReLU) layers and the batch normalization (BN) is represented with the blue block . Grey coloured circles represent the\u00a0 max-pooling 2 \u00d7 2. Light-red blocks consist of Conv-BN-ReLU layers followed by the global average pooling. The output of two network branch is concatenated and then fed to the softmax layer and this layer is used to find out the prediction rate for classifying the pneumonia\u00a0\u00a0 type.\u00a0 Details of each layer of convolution neural network\u00a0 are explained below.<\/p>\n<table style=\"width: 70%;\" border=\"1\" cellpadding=\"5\">\n<tbody>\n<tr>\n<td>\u00a0<img decoding=\"async\" class=\"alignnone size-thumbnail wp-image-31284\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig2-150x150.jpg\" alt=\"Figure 2: Schematic representation of the proposed Siamese network\u2019s architecture.\" width=\"150\" height=\"150\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig2-150x150.jpg 150w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig2-256x256.jpg 256w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig2.jpg 752w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td>\n<td><strong>Figure 2: <\/strong><strong>Schematic representation of the proposed Siamese network\u2019s architecture.<\/strong><\/p>\n<p><a href=\"http:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig2.jpg\" target=\"_blank\"><span style=\"font-family: inherit; font-size: inherit;\">Click here to View Figure<\/span><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>Convolution Operation Layer<\/strong><\/p>\n<p>The first step of the CNN is the convolution layer where each input is undergoes a learning process.\u00a0 This layer mainly consists of series filter known as the kernels. Kernal generally expressed as rectangular\u00a0 matrix, consisting of set of values known as the weights. These weights are learned from the input data[16] and\u00a0 are calculated automatically by an error back propagation algorithm [17a].\u00a0 As shown in the Figure 3, each filter is convolved with the input data and their by producing the feature map.<\/p>\n<table style=\"width: 70%;\" border=\"1\" cellpadding=\"5\">\n<tbody>\n<tr>\n<td>\u00a0<img decoding=\"async\" class=\"alignnone size-thumbnail wp-image-31285\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig3-150x150.jpg\" alt=\"Figure 3: Convolution Operation of input matrix convoluted on Kernel\" width=\"150\" height=\"150\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig3-150x150.jpg 150w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig3-256x256.jpg 256w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig3.jpg 517w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td>\n<td><strong>Figure 3: Convolution Operation of input matrix convoluted on Kernel<\/strong><\/p>\n<p><a href=\"http:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig3.jpg\" target=\"_blank\"><span style=\"font-family: inherit; font-size: inherit;\">Click here to View Figure<\/span><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Each term of the feature map of the convolution layer can be described as<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31277\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ1.jpg\" alt=\"Vol13No1_Adee_Anu_Equ1\" width=\"444\" height=\"72\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ1-300x49.jpg 300w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ1.jpg 444w\" sizes=\"(max-width: 444px) 100vw, 444px\" \/><\/p>\n<p>Here, \u2297\u00a0represents the convolutional operator,<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31286\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img1.jpg\" alt=\"Vol13No1_Adee_Anu_Img1\" width=\"46\" height=\"31\" \/><\/p>\n<p>represent the weight of the kernel in the <em>i<\/em><sup>th<\/sup>\u00a0layer.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31287\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img2.jpg\" alt=\"Vol13No1_Adee_Anu_Img2\" width=\"52\" height=\"36\" \/><\/p>\n<p>is the input feature map of channel c and<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31288\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img3.jpg\" alt=\"Vol13No1_Adee_Anu_Img3\" width=\"24\" height=\"34\" \/><\/p>\n<p>is the bias of the\u00a0<em>k<\/em><sup>th<\/sup> group filter in the\u00a0<em>i<\/em><sup>th<\/sup> layer. If C = 3, it represents the input feature map, a 3-channel array such as a color picture with three Red-Green-Blue channels. We used a stack of 3 \u00d7 3 convolutional filters instead of the larger ones. In order to keep the input size constant and to build a deep network, zero padding is not used for 3X3 filter in the proposed work.<\/p>\n<p><strong>Activation (ReLu) Layer<\/strong><\/p>\n<p>Followed to the convolution layer is the Relu layer. In this layer a\u00a0 non linear activation function is applied on the output of the convolution layer. Relu activation also helpful in preventing the gradient disappearance problem and the over-fitting problem which are usually arises in the deep neural network.\u00a0\u00a0 Equation (1) can be rewritten as follows after adding the activation function:<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31278\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ2.jpg\" alt=\"Vol13No1_Adee_Anu_Equ2\" width=\"471\" height=\"66\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ2-300x42.jpg 300w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ2.jpg 471w\" sizes=\"(max-width: 471px) 100vw, 471px\" \/><\/p>\n<p>where \u0192(.) is the activation function and<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31289\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img4.jpg\" alt=\"Vol13No1_Adee_Anu_Img4\" width=\"27\" height=\"38\" \/><\/p>\n<p>is the\u00a0<em>k<\/em><sup>th<\/sup>\u00a0output feature map after a nonlinear transformation by the activation layer.<\/p>\n<h4>Pooling Layer<\/h4>\n<p>The pooling layer is used for down-sampling or reducing the dimensionality of the feature map.\u00a0 Two types of methods used in the pooling that is either max pooling or the average pooling. Mathematically, pooling can be expressed as [18]\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31279\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ3.jpg\" alt=\"Vol13No1_Adee_Anu_Equ3\" width=\"446\" height=\"76\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ3-300x51.jpg 300w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ3.jpg 446w\" sizes=\"(max-width: 446px) 100vw, 446px\" \/><\/p>\n<p>where<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31290\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img5.jpg\" alt=\"Vol13No1_Adee_Anu_Img5\" width=\"60\" height=\"30\" \/><\/p>\n<p>describes\u00a0 value of t<sub>x,y<\/sub>th pixel value present in the\u00a0 in the\u00a0<em>i<\/em><sup>th <\/sup>\u00a0layer and the size of the pooling\u00a0 window considered as S\u00d7H<em>.<\/em>\u00a0In the proposed method we have considered the max pooling technique with convolution stride of\u00a02 in the first layer.<\/p>\n<p><strong>Fully Connection Layer<\/strong><\/p>\n<p>Last stage of the CNN is the Fully connection layer, this layer is used as the final learning phase. Normally this layer is used extract the features of the output data of CNN and also to connect the feature extraction stages with the Softmax classifier. A fully connected CNN is normally consists of 2 to 3 layers and connected to a feed forward neural network. The final output of the fully connected layer is transformed from 2-D array to 1-D array. Each element of this 1-D array is the parameter for the determination of class type of an input image.\u00a0 Mathematically, FCN layer can be written as<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31280\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ4.jpg\" alt=\"Vol13No1_Adee_Anu_Equ4\" width=\"273\" height=\"42\" \/><\/p>\n<p>where\u00a0W,X,B denotes the weight, input and the bias\u00a0 of the fully connected network layers respectively. The softmax activation function[20] is very much use full for the probabilistic distribution of the input image belong to each of the classes in which the network was trained. Probability distribution of the input image <strong>x<\/strong> is measured as<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31281\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ5.jpg\" alt=\"Vol13No1_Adee_Anu_Equ5\" width=\"480\" height=\"67\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ5-300x42.jpg 300w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ5.jpg 480w\" sizes=\"(max-width: 480px) 100vw, 480px\" \/><\/p>\n<p>Where M is the no of models or the branches and here it is 2, k is the number of class level that is 3 and<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31291\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Img6.jpg\" alt=\"Vol13No1_Adee_Anu_Img6\" width=\"92\" height=\"36\" \/><\/p>\n<p>is the probability distribution.<\/p>\n<p>In order to minimize\u00a0 the training time and to restrict the\u00a0 over fitting problem, we have\u00a0 used dropout training skill with the fully connected\u00a0 layer, <em>i.e<\/em> in each iteration, a certain percentage of neuron of a layer from the training set id added and then using the ADAM optimization function[15],weights of the each neuron are updated.<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-31282\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ6.jpg\" alt=\"Vol13No1_Adee_Anu_Equ6\" width=\"377\" height=\"59\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ6-300x47.jpg 300w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Equ6.jpg 377w\" sizes=\"(max-width: 377px) 100vw, 377px\" \/><\/p>\n<p>As mentioned above, we learned the same convolution and batch normalization weights for both sides of the chest image. Finally, we concatenated the outputs of these two branches and used a final fully connected layer to make the prediction for classification.<\/p>\n<p><strong>Implementation Details<\/strong><strong>\u00a0<\/strong><\/p>\n<p>We have used\u00a0 PyTorch,\u00a0 python based computing package that support the GPU environment. Entire experimental work is implemented in Nvidia GTX1080 cards system with 8 GB memory support system. For our model, first we rescaled the input image of 130X130 mm region into a image of 300 X 300 pixel. This image is then cropped into two rectangular segments. Left segmented image of the CXR is flipped vertically. As cited earlier, Siamase network act on two different input at a time to compute the output. As shown in the figure3, the two segmented image of each CXR\u00a0 is\u00a0 feed into the\u00a0 model and then undergoes the following series of operation for training the model such as convolution layer, batch normalization, ReLu layer, max pooling and then finally the fully connected layer with soft max dense operation. Furthermore in order to reduce the dimension of extracted feature, Adam Optimizer and the cross entropy loss function are used. \u00a0To avoid over fitting, we include a drop out layer with a drop out ratio of 0.2 after the last convolutional\u00a0 layer and a drop out layer with a drop out ratio of 0.5 after the fully connected layer (fc5).<\/p>\n<p><strong>Performance Evaluation<\/strong><\/p>\n<p><strong>Cross Validation<\/strong><\/p>\n<p>One of the measuring parameter for the evaluation of the performance is the cross validation. One of the popular validation methods is the k-fold validation in which the selected sample from the dataset is divided equally into k number of groups. Treat the 1<sup>st<\/sup> group as the validation set and the remaining (k-1) as the training data.\u00a0 Although this method of measuring the performance is quite complex but still it is one of the better approach as it takes the full advantage of analyzing the entire data.<\/p>\n<p><strong>Confusion Matrix<\/strong><\/p>\n<p>Confusion Matrix is used towards measuring the prediction correctness. Prediction correctness of the algorithm is expressed in this 2D array. Here we consider the multi class classification problem. Three classes generally identified as normal or bacterial infected or the viral infected pneumonia patient.<\/p>\n<table style=\"width: 95%;\" border=\"1\" cellspacing=\"0\" cellpadding=\"4\">\n<tbody>\n<tr>\n<td style=\"text-align: center;\" rowspan=\"5\" width=\"25\"><strong>T<\/strong><br \/>\n<strong>r<\/strong><br \/>\n<strong>u<\/strong><br \/>\n<strong>e<\/strong><br \/>\n<strong>L<\/strong><br \/>\n<strong>a<\/strong><br \/>\n<strong>b<\/strong><br \/>\n<strong>e<\/strong><br \/>\n<strong>l<\/strong><\/td>\n<td style=\"text-align: center;\" width=\"90\">Viral Pneumonia<\/td>\n<td style=\"text-align: center;\" width=\"78\">86.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">14.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">0.0<\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center;\" width=\"90\">Bacterial Pneumonia<\/td>\n<td style=\"text-align: center;\" width=\"78\">7.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">89.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">4.0<\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center;\" width=\"90\">Normal<\/td>\n<td style=\"text-align: center;\" width=\"78\">2.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">4.0<\/td>\n<td style=\"text-align: center;\" width=\"78\">94.0<\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center;\" width=\"90\"><\/td>\n<td style=\"text-align: center;\" width=\"78\">Viral Pneumonia<\/td>\n<td style=\"text-align: center;\" width=\"78\">Bacterial Pneumonia<\/td>\n<td style=\"text-align: center;\" width=\"78\">Normal<\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: center;\" colspan=\"4\" width=\"324\">Predicted Label<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In the above table, we have used two sections which contain the true or the actual classification against the predicted classification section.<\/p>\n<p><strong>AUC -ROC Curve<\/strong><\/p>\n<p>Towards checking or visualizing the performance of the multi &#8211; class\u00a0 problem, we use AUC (Area Under The Curve) curve and\u00a0 ROC (Receiver Operating Characteristics) curve. Current work is a multiclass problem and the AUC and ROC parameter plays a measure role.\u00a0 ROC curve is conceptually equivalent to a curve that shows the relationship between the power of the test and the probability of error, with the variation of the cutoff value of a statistical test. Therefore, the ROC curve compares classifier performance across the full range of class distributions, offering an assessment, covering a wide range of operating conditions [19].\u00a0 Figure 4 shows the\u00a0\u00a0 performance of the\u00a0 ROC-curve along with the AUC value for the two case i.e normal vs pneumonia and viral vs bacterial pneumonia.<\/p>\n<table style=\"width: 70%;\" border=\"1\" cellpadding=\"5\">\n<tbody>\n<tr>\n<td><img decoding=\"async\" class=\"alignnone size-thumbnail wp-image-31293\" src=\"https:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig4-150x150.jpg\" alt=\"Figure 4: ROC curve representing the performance of the proposed model\" width=\"150\" height=\"150\" srcset=\"https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig4-150x150.jpg 150w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig4-256x256.jpg 256w, https:\/\/biomedpharmajournal.org\/staging\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig4.jpg 772w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td>\n<td><strong>Figure 4: ROC curve representing the performance\u00a0<\/strong><\/p>\n<p><a href=\"http:\/\/biomedpharmajournal.org\/wp-content\/uploads\/2020\/03\/Vol13No1_Adee_Anu_Fig4.jpg\" target=\"_blank\"><span style=\"font-family: inherit; font-size: inherit;\">Click here to View Figure<\/span><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>Conclusions<\/strong><\/p>\n<p>In this paper we have demonstrated a novel approach to identify and classify the various types pneumonia disease. We have used the kaggle dataset and specific features are used relevant to the diseases. Compared to the earlier approaches ,we have trained our model for both the right and left part of chest\u00a0 X-ray that makes the process robust towards better classification.\u00a0 Overall our approach has provide the add on benefits to inexperienced practitioner in towards diagnosing the specific\u00a0 type of pneumonia in the early\u00a0 stage.<\/p>\n<p><strong>Acknowledgements<\/strong><\/p>\n<p>The author is very thankful to all the associated personnel in any reference that contributed in\/for the purpose of this research.<\/p>\n<p><strong>Funding source<\/strong><\/p>\n<p>There is no funding source for the current research work.<\/p>\n<p><strong>Conflict of Interest<\/strong><\/p>\n<p>There is no conflict of interest.<\/p>\n<p><strong>Reference<\/strong><\/p>\n<ol>\n<li>Lakhani and B. Sundaram, \u201cDeep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks,\u201d <em>Radiology<\/em>, vol. 284, no. 2, pp. 574\u2013582, 2017.<\/li>\n<li>D. Demner, M. D. Kohli, M. B. Rosenman et al., \u201cPreparing a collection of radiology examinations for distribution and\u00a0 retrieval,\u201d <em>Journal of the American Medical Informatics Association<\/em>, vol. 23, no. 2, pp. 304\u2013310, 2015.<\/li>\n<li>S, Rajaraman, S. Candemir, Kim,\u00a0 G. Thoma, and S. Antani, \u201cVisualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs.\u201d<em>Applied Sciences, 8(10). <\/em><\/li>\n<li>Lisowska, E. Beveridge, K. Muir, and I. Poole, \u201cThrombus detection in ct brain scans using a convolutional neural network.\u201d, <em>In BIOIMAGING, 2017 pages 24\u201333.<\/em><\/li>\n<li>Abe, H.Macmahon, J. Shiraishi, Q. Li, \u201cEngelmann, R.; Doi, K. Computer-aided diagnosis in chest radiology.\u201d <em>Semin. Ultrasound CT MR 2004, 25, 432\u2013437.<\/em><\/li>\n<li>[6]M. Giger, H.MacMahon, \u201cImage-processing &amp; computer-aided diagnosis.\u201d <em>Radiologic Clinics of North America.<\/em> 1996, 34, 565\u2013596.<\/li>\n<li>Monnier-Cholley, H. MacMahon, S. Katsuragawa, J. Morishita, T.Ishida, K. Doi, \u201cComputer-aided diagnosis for detection of interstitial opacities on chest radiographs.\u201d <em>AJR Am. J. Roentgenol. 1998, 171, 1651\u20131656. <\/em><\/li>\n<li>S. Kermany, M.Goldbaum, W. Cai, C.C,S Valentim, H. Liang, S.L Baxter, A.McKeown,\u00a0 G. Yang, X.\u00a0 Wu, F. Yan,\u00a0 et al. \u201cIdentifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning.\u201d <em>Cell 2018, 172, 1122\u20131131.<\/em><\/li>\n<li>L.G Oliveira, S.A.E Silva, L.H.V Ribeiro, R.M\u00a0 De Oliveira, C.J. Coelho, A.L.S\u00a0 Ana L\u00facia, \u201cComputer-Aided Diagnosis in Chest Radiography for Detection of Childhood Pneumonia.\u201d <em>International\u00a0 Journal of\u00a0 Medicine and Information\u00a0 2008, 77, 555\u2013564.\u00a0\u00a0 <\/em><\/li>\n<li>Ponzio, E. Macii, E. Ficarra, and S.Di Cataldo, \u201cColorectal cancer classification using deep convolutional networks\u201d, <em>In Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies<\/em> ,\u00a0 Volume 2 BIOIMAGING, 58-66, 2018, Funchal, Madeira, Portugal<\/li>\n<li>M Le Roux, L. Myer, M.P Nicol,\u00a0 \u201cIncidence and severity of childhood pneumonia in the first year of life in a South African birth cohort\u201d, <em>\u00a0The Drakenstein Child Health Study. Lancet Glob. Health 2015, 3, e95\u2013e103<\/em>.<\/li>\n<li>Cherian, E.K Mulholland, J.B\u00a0 Carlin, H.\u00a0 Ostensen, R. Amin, M. De Campo, D. Greenberg, R. Lagos, \u201cLucero, M.; Madhi, S.A.; et al. Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies\u201d,\u00a0 <em>Bull. World Health Organ. 2005, 83, 353\u2013359.<\/em><\/li>\n<li>C Santosh, S. Antani, \u201cAutomated chest x-ray screening: Can lung region symmetry help detect pulmonary abnormalities\u201d, <em>IEEE Transactions on Medical Imaging, 2018, <\/em>37(5):1168\u20131177.<\/li>\n<li>[14]A. Krizhevsky, Sutskever, G.E\u00a0 Hinton, \u201cImagenet classification with deep convolutional neural networks\u201d , <em>In Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA, <\/em>3\u20136 December 2012; pp. 1097\u20131105.<\/li>\n<li>P. Kingma, J. Ba, A. Adam: A method for stochastic optimization. CoRR, abs\/1412.6980, 2014.<\/li>\n<li>Goodfellow, Y. Bengio, A. Courville, \u00a0<em>Deep Learning<\/em>, MIT Press: Cambridge, MA, USA, 2016<\/li>\n<li>Xia, T. Li,L. Xu, L. Liu, C.W de Silva, \u201cFault-diagnosis for rotating machinery using multiple sensors and convolution neural networks\u201d.\u00a0<em>IEEE\/ASME Trans. Mech.<\/em>\u00a02018,\u00a0<em>23<\/em>, 101\u2013110.<\/li>\n<li>[18] W. Zhang, G. Peng, C. Li, \u201cBearings fault diagnosis based on convolutional neural networks with 2-D representation of vibration signals as input\u201d, <em>In Proceedings of the 2016 the 3rd International Conference on Mechatronics and Mechanical Engineering (ICMME 2016),<\/em> Shanghai, China, 21\u201323 October 2016; pp. 1\u20135.<\/li>\n<li>Brzezinski, J. Stefanowski, \u201c Prequential auc: properties of the area under the roc curve for data streams with concept drift\u201d, <em>\u00a0Knowledge and Information Systems, <\/em>52(2):531\u2013562.<\/li>\n<li>Peng, J. Li, Y. Song, Y. Liu, \u201c Incrementally learning the hierarchical soft max function for neural language models\u201d,\u00a0 In AAAI, 2017,pages 3267\u20133273.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Introduction Pneumonia is a one of the common acute respiratory  [&#8230;]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[75],"tags":[],"class_list":["post-31272","post","type-post","status-publish","format-standard","hentry","category-vol13no1"],"_links":{"self":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/31272","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/comments?post=31272"}],"version-history":[{"count":5,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/31272\/revisions"}],"predecessor-version":[{"id":32046,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/posts\/31272\/revisions\/32046"}],"wp:attachment":[{"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/media?parent=31272"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/categories?post=31272"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/biomedpharmajournal.org\/staging\/wp-json\/wp\/v2\/tags?post=31272"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}