Manuscript accepted on :06-09-2022
Published online on: 03-11-2022
Plagiarism Check: Yes
Reviewed by: Dr. Nishu Raina
Second Review by: Dr. Hind Shakir
Final Approval by: Dr. H Fai Poon
1Department of ECE, UBDTCE, Davangre, India
2Automation Anywhere, Bangalore, India.
Corresponding Author E-mail: ataulla@gmail.com
DOI : https://dx.doi.org/10.13005/bpj/2557
Abstract
The most consecutive malignant growth in the body is skin disease. Every time, more than individualities on the world are determined to have skin malicious growth. The operation of this malice is greatly impressed by early discovery. A new optimum and automatic channel strategy for diagnosing this complaint using dermoscopy images is proposed in this paper. Before processing, the approach comprises a noise reduction process to exclude the disturbances. The BRISQUE score is a quality index that's used to assess different denoising techniques. Filters like anisotropic diffusion and a bilateral are employed for subjective judgment.
Keywords
Anisotropic Diffusion Filter; Bilateral Filter; Blind/‘Referenceless’ Image Spatial Quality Evaluator; Degree of smoothing; Non Local Means
Download this article as:Copy the following to cite this article: Reshma M, Ataulla S. H. Preprocessing of Skin Cancer Images using Non-Local Means (Nlm) Filter. Biomed Pharmacol J 2022;15(4). |
Copy the following to cite this URL: Reshma M, Ataulla S. H. Preprocessing of Skin Cancer Images using Non-Local Means (Nlm) Filter. Biomed Pharmacol J 2022;15(4). Available from: https://bit.ly/3fyHuzF |
Introduction
Melanoma is known as the everyday most cancers in women and men. There were approximately 300,000 new instances in 20181. Dermascopy is a primary tool for the diagnosis of melanoma. In the dermoscopy images, there is a small amount of noise. During sharpening and contrast improvement, the noise may be enhanced. The additional noise may impair the efficacy of edge-based segmentation algorithms used to extract the borders of skin lesions2,3 .As a result, denoising is an important step in the automated analysis of dermoscopy images. 4,5. For denoising of dermoscopy images, the Non-Local Means (NLM) filter is employed. For contrast enhancement, the ‘Robust Image Contrast Enhancement (RICE)’ method is used 6. For sharpening, Unsharp Masking is usedA transmittance estimation-based method is used to remove reflections7. For virtual shaving, a phase congruency-based approach is applied. The diagrammatic representation of the procedures included in the preprocessing of dermoscopy images is illustrated in Figure. 1.
Figure 1: Schematic of the preprocessing pipeline. |
Method and Material
NLM filter
In NLM, for computing the denoised pixel value, the pixel values close to the current pixel within the whole noisy image are taken into account, instead of the pixels geometrically/spatially near to the current pixel[8]. The term ‘non-local’ in the name of the NLM filter reflects the above concept. For computing, the objective similarity between the current pixel to be denoised and an arbitrary pixel in the input image, a block of pixels around both of them are considered. In denoising techniques 9 like the bilateral filter, individual pixels are compared instead of comparing the complete block of pixels around the current pixels and the pixel being compared. Consequently, the way of computing the objective similarity is more robust, compared to the way adopted in other denoising techniques like the bilateral filter. The procedure of taking the entire pixels into account for computing each denoised pixel value will increase the time complexity of the NLM filter, uncontrollably. In practice, for estimating the denoised pixel value, only the pixels inside the block of a considerably large radius around the pixel to be denoised are considered10.
Objective quality metrics
One objective quality metric is used in this paperthatis Blind/‘Referenceless’ Image Spatial Quality Evaluator (BRISQUE)11,12. BRISQUE score is used to compare different denoising schemes. This quality metric is utilized to objectively determine the value of the degree of smoothing for the NLM filter.
Image dataset
Dermoscopy photos arise from different independent benchmark datasets. The International Skin Imaging Collaboration (ISIC) archive13 is the first benchmark dataset. The second benchmark dataset is publically available PH2 repository 14. The ISIC archive comprises a total of 1279 dermoscopy images.
Results and Discussion
Validation of NLM filter
This section looks at the perceived and objective effects of Degree of Smoothening (DoS) on the NLM filter’s denoising quality. The BRISQUE score is used for objective evaluation[15]. Figure 2 illustrates the test photographs. The test images are denoised using the NLM filter with DoS values ranging from 1 to 15, and the results are shown in Figures 3–5.
The smoothing impact on the images grows as the value of the DoS varies from 1 to 15, as seen in Figure. 3 – Figure. 5. For DoS values 1,2 and 3 denoising effect is very less as visible in Figure. 3(a) – Figure. (c), Figure. 4(a) – Figure.4(c) and Figure.5(a) – Figure.5(c). Smoothening is more effective when DoS values increase beyond 3 as evident inFigure.3(d) – Figure. 3(o), Figure.4(d) – Figure. 4(o) and Figure.5(d) – Figure. 5(o).When the DoS value exceeds 10, however, images become excessively smoothed. This weakens the lesions present in the images as observed in Figure. 3(j) – Figure.3(o), Figure.4(j) – Figure.4(o) and Figure.5(j) -Figure.5(o). As a result, the range of Degree Of Smoothening (DoS) between 6 and 9 is reported to be suitable for dermoscopy images based on the perceived quality of processed images.
Figure 2: Representative test images with noise (a) Image1 (b) Image 2 (c) Image 3. |
For objective evaluation of the quality of images smoothed by NLM, the variations of BRISQUE for various values of DoS is plotted and depicted in Figure.6.The minimum value of the BRISQUE score is appreciable for good quality images16,17. The value of BRISQUE decreases as DoS increases from 1 to 8.When DoS is between 8 and 10, BRISQUE has low scores, as shown in the graph. As the DoS rises above 10, the BRIQUE score for all three images increase as well.
Figure 3: Output images produced by NLM filter for different values of DoS for test image 1. |
This is in agreement with the inferences drawn by inspecting the perceived quality of the resulting images (Figure.3 – Figure.5) for various values of DoS. The NLM filter is compared qualitatively and quantitatively to two other denoising options, namely the anisotropic diffusion filter18 and the bilateral filter19. Output images of the above said algorithms for three input images are illustrated in Figure. 7 to Figure.9.An ideal denoising technique should smoothen the background without fading the boundary of the lesions. Bilateral filter (Figure. 7 (c), Figure. 8 (c) and Figure. 9 (c)) excessively smooths the image. The clarity of the denoised image is considerably reduced as a result, and the lesions’ borders fade. The images denoised by anisotropic diffusion filter are illustrated in Figure. 7(b), fig .8 (b) and Figure.9(b). The lesions’ boundaries are not well retained in these images. The textural artifact is also visible in the background of the denoised images. The output images of the NLM filter are displayed in. Figure. 7(d), Figure. 8(d) and Figure.9(d).The NLM filter is better than the anisotropic diffusion filter in denoising the image while maintaining the lesions’ boundaries.
Figure 4: Output images produced by NLM filter for different values of DoS for test image 2. |
Information loss is also minimal when compared to bilateral filter. In subjective evaluation, the images denoised by NLM seem to be equally good in smoothing and maintaining the boundary of the lesions than anisotropic diffusion filter and bilateral filter
Figure 5: Output images produced by NLM filter for different values of DoS for test image 3. |
Figure 6: Variation of BRISQUE score against DoS |
Figure 7: Output images produced by different denoising algorithms for test image 1 . |
Figure 8: Output images produced by different denoising algorithms for test image 2. |
Figure 9: Output images produced by different denoising algorithms for test image 3. |
The BRISQUE scores obtained for anisotropic diffusion filter, bilateral filter and NLM for 1279 images are given in Table 1. The bar graph of the BRISQUE scores is shown in Figure.10. Table 1 shows that the NLM filter produces the lowest value of BRISQUE when compared to other techniques. This supports the inferences drawn from the subjective quality evaluation of the images denoised by different schemes.
Table 1: BRISQUE scores shown by various denoising algorithms
Method | BRISQUE scores |
Anisotropic diffusion filter | 52.9745±2.9132 |
Bilateral filter | 41.9123±4.1011 |
NLM filter | 34.1123±2.1256 |
Figure 10: Bar graph of the BRISQUE. |
Conclusions
The preprocessing of dermoscopy pictures is acted in this paper. The initial step of preprocessing is denoising. The Non-Local Means (NLM) channel is applied for denoising of dermoscopy pictures. NLM channel displays the most minimal Blind/’Referenceless’ Image Spatial Quality Evaluator (BRISQUE) score, contrasted with other denoising plans like anisotropic dissemination channel and respective channel. The result pictures delivered by the NLM channel have insignificant commotion contrasted with that of the bilateral filter and anisotropic diffusion filter.
Conflict of Interest
There is no conflict of interest.
Funding Sources
There is no funding sources.
References
- Mattiuzzi and G. Lippi,(2020) “Cancer statistics: a comparison between world health organization (WHO) and global burden of disease (GBD),” European Journal of Public Health, vol. 30, no. 5, pp. 1026-1027.
CrossRef - P.G, et al., (2019), “A Customized Nonlocal Restoration Scheme with Adaptive Strength of Smoothening for MR images”, Biomedical Signal Processing and Control, Vol. 49, pp. 160-172.
CrossRef - Navid, A. Mohsen, K. Maryam et al.,(2020) “Computer-aided diagnosis of skin cancer: a review,” Current Medical Imaging, vol. 16, no. 7, pp. 781–793.
CrossRef - M (2019), “Local Edge-Enhanced Active Contour for Accurate Skin Lesion Border Detection”, BMC Bioinformatics, Vol. 20, No. 91, pp. 87-97
CrossRef - Xu, F. R. Sheykhahmad, N. Ghadimi, and R. Navid(2020), “Computer-aided diagnosis of skin cancer based on soft computing techniques,” Open Medicine, vol. 15, no. 1, pp. 860–871. 2020.
CrossRef - X (2020), “Effect of image noise on the classification of skin lesions using deep convolutional neural networks”, Tsinghua Science and Technology, Vol. 25, No. 3, pp. 425-434.
CrossRef - P.R, Shenoy. M.M, and Shekar. B.H (2017), “Noise Removal in Dermoscopic Images Using a Novel Software”. Indian dermatology online journal, Vol. 8, No. 6, pp. 513.
CrossRef - S (2013), “Efficient Contrast Enhancement using Adaptive Gamma Correction with Weighting Distribution”, IEEE Transactions on Image Processing, Vol. 22, No. 3,pp. 1032-1041
CrossRef - R (2012), “Computer-Aided Diagnosis of Melanoma Using Border and Wavelet-Based Texture Analysis”, IEEE Transactions on Information Technology in Biomedicine, Vol. 16, No. 6, pp. 1239-1252.
CrossRef - Salmon, R. Willett, and E. Arias-Castro,(2012) “A two-stage denoising filter: the preprocessed Yaroslavsky filter,” in 2012 IEEE Statistical Signal Processing Workshop (SSP), pp. 464–467, Ann Arbor, MI, USA. 2012.
CrossRef - A (2012), “No-Reference Image Quality Assessment in the Spatial Domain”, IEEE Transactions on Image Processing, Vol. 21, No. 12, pp. 4695-4708.
CrossRef - Horé. A and Ziou. D (2010), “Image Quality Metrics: PSNR Vs. SSIM”, 20th International Conference, Pattern Recognition, Istanbul, Turkey, pp. 2366-2369
CrossRef - D (2016), “Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)”, IEEE 15th International Symposium Biomedical Imaging (ISBI 2018), Washington, DC, pp. 168-172.
- Mendonça. T, et al. (2013), “PH 2 – A dermoscopic image database for research and benchmarking”, Proc. 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp. 5437-5440, IEEE
CrossRef - Razmjooy, V. V. Estrela, and H. J. Loschi, (2020) “Entropy-based breast cancer detection in digital mammograms using world cup optimizationalgorithm,” International Journal of Swarm Intelligence Research (IJSIR), vol. 11, no. 3, pp. 1–18. 2020.
CrossRef - Sugiarti, J. Na’am, D. Indra, and J. Santony, (2019) “An artificial neural network approach for detecting skin cancer,” TELKOMNIKA Telecommunication Computing Electronics and Control, vol. 17, no. 2, pp. 788–793. 2019.
CrossRef - T (2009), “A Histogram Modification Framework and Its Application for Image Contrast Enhancement”, IEEE Transactions on Image Processing, Vol. 18, No. 9,pp. 1921-1935.
- D (2018), “Edge Probability and Pixel Relativity-Based Speckle Reducing Anisotropic Diffusion”, IEEE Transactions on Image Processing, Vol. 27, No. 2, pp. 649-664.
CrossRef - Gavaskar. R.G and Chaudhury. K.N (2019), “Fast Adaptive Bilateral Filtering”, IEEE Transactions on Image Processing, Vol. 28, No. 2, pp. 779-790
CrossRef