ISSN: 2229-371X

All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.

HYBRID MODELS FOR DENOISING ULTRASONIC IMAGES

Dr. (Mrs). S.N Geethalakshmi *1 and J.Suguna2
  1. Associate Professor, Avinashilingam Deemed University for Women, Coimbatore-641043, India
  2. Research scholar, Avinashilingam Deemed University for Women, Coimbatore-641043, India
Corresponding Author: Dr. (Mrs). S.N Geethalakshmi, E-mail: sngeethalakshmi@yahoo.com
Related article at Pubmed, Scholar Google

Visit for more related articles at Journal of Global Research in Computer Sciences

Abstract

The influence and impact of digital images on modern society is tremendous and is considered as a critical component in variety of application areas including pattern recognition, computer vision, industrial automation and healthcare industries. Medical imaging is concerned with the development of the imaging devices that help to identify different aspects of the tissue and organs based on various properties and reveal new properties of the tissue and internal structure. Examples of such devices / equipments include x-ray devices, CT / MRI scanners, electron microscope, etc. All these devices introduce, an unwanted signal, called noise. This paper considers a special kind of noise introduced by ultra sonographic devices is called 'speckle'. Speckle appears as interference of back-scattered wave from many microscopic diffused reflection. They spread through internal organs and make it more difficult for the observer to discriminate fine detail of the images in diagnostic examinations. In this paper, hybrid models are designed for speckle removal by combining anisotropic diffusion based on 4th order PDE with the three conventional linear filters, kaun, lee and frost. Experiments were conducted with various ultrasound images. From the results, it was found that all the three hybrid methods performed denoising operation in a superior fashion and produce images that are of good visual quality.

Keywords

Denoising, ultrasonic images, hybrid models, kaun, lee, frost

INTRODUCTION

Various medical imaging devices like x-ray, CT / MRI scanners and electron microscope produce high-resolution images, which play a vital role in disease diagnosis. Out of these devices, medical sonography (ultrasonography) is an ultrasound-based diagnostic medical imaging technique used to visualize muscles, tendons, and many internal organs, to capture their size, structure and any pathological lesions with real time tomographic images. Ultrasound has been used by sonographers to image the human body for at least 50 years and has become one of the most widely used diagnostic tools in modern medicine. The technology is relatively inexpensive and portable when compared with other techniques such as magnetic resonance imaging (MRI) and computed tomography (CT). Ultrasound is also used to visualize fetuses during routine and emergency prenatal care. Such diagnostic applications used during pregnancy are referred to as obstetric sonography. Medical sonography is used in the study of many different systems like cardiology, gastroenterology, gynecology, neurology, obstetrics, urology and cardiovascular systems (Tso and Mather, 2009). Images produced by these devices can be displayed, captured, and broadcast through a computer using a frame grabber to capture and digitize the analog video signal. The captured signal can then be postprocessed on the computer itself. Ultrasonogrpahy is widely used by practitioners as they have no long-term side effects and has the added advantage that it is non-intrusive to the patients (Hangiandreou, 2003). The device provides live images, where the operator can select the most useful section for diagnosing thus facilitating quick diagnoses (Sudha et al., 2009). However, imperfect acquisition instruments, transmission errors often distort the visual signals obtained. These distortions in ultrasound images are referred as ‘Speckle Noise’ and are considered as undesirable feature that often lead to incorrect diagnosis.
Speckle is a complex phenomenon and it significantly degrades image quality. Speckle appears interference of back-scattered wave from many microscopic diffused reflection which passing through internal organs and makes it more difficult for the observer to discriminate fine detail of the images in diagnostic examinations. Thus, it is important that to remove or reduce this noise to the maximum extent before using them (Raman and Himanshu, 2010). The goal of any speckle removal algorithm should be to enhance the corrupted images by maintaining the quality of the image.
In this paper, the applicability of anisotropic diffusion filter, also called Perona–Malik diffusion, to speckle denoise ultrasound images is consider. Anisotropic diffusion filter is a frequently used filtering technique in digital images (Fu et al., 2006). Anisotropic diffusion is a technique aiming at reducing image noise without removing significant parts of the image content, typically edges, lines or other details that are important for the interpretation of the image (Perona and Malik 1987; 1990; Sapiro, 2001). In spite of its popularity, it faces the following problems.
1. they cause blocky effects in images
2. they destroy structural and spatial neighbourhood information (Pitas and Venetsanopoulos, 1990) and
3. they are slow in reaching a convergence stage.
Attempts made to solve these disadvantages include the development of hybrid varieties (Ling and Bovik, 2002; Rajan and Kaimal, 2006a; 2006b). Eventhough, these hybrid models produce excellent results when compared with stand-alone anisotropic diffusion and other filtering techniques, they come with the defect of removing finer details of an image like edges, sharp corners, thin lines (Hamza et al., 1999).
Rajan et al. (2009) developed a hybrid method to remove noise from molecular images. The method combined anisotropic diffusion filter with 2D PDE (Partial Differential Equation) with a relaxed median filter (Wang and Zhang, 1999). This method was successful in removing molecular noise and had less blocking and artifacts in the denoised image. However, when applied to speckle noise removal, the noises were not fully removed and it had the serious flaw of slow convergence. The slow convergence is because of 2D PDE used and the failure in noise removal might be because of the relaxed median filter. The relaxed median filter, eventhough is very popular in reducing other types of noises, is not suitable for speckle noise.
Motivated by the work of Rajan et al. (2009), the present research work proposes to combine anisotropic diffusion filter with conventional speckle noise denoising filters, namely, Kaun, Lee and Frost. Normally, the anisotropic functions are based on 2nd order PDE (Partial Differential Equation) functions. In the present research work, a fourth order PDE is used with the conventional basic anisotropic model. The combination of anisotropic diffusion function with 4th order PDE and conventional despeckling filter is proposed to reduce the speckle noise from ultrasonic images, which while denoising, preserves the edges, avoids staircase artifacts and converges in a fast manner.
The paper is organized as below. Section 1 provided a brief overview to the topic under discussion. The second section gives an overview to Speckle noise. Section 3 explains the concepts of the techniques used in the proposed hybrid models. Section 4 presents the proposed methodology and the results of experiments conducted are presented in Section 5. Section 6 presents a short conclusion with future research directions.

SPECKLE NOISE

Speckle is a random, deterministic, interference pattern in an image formed with coherent radiation of a medium containing many sub-resolution scatterers. Speckle has a negative impact on ultrasound imaging. The presence of speckle noise in images shows a reduction of lesion detectability of approximately a factor of eight. This radical reduction in contrast resolution is responsible for the poorer effective resolution of ultrasound compared to x-ray and MRI. Presence of speckle noise prevents Automatic Target Recognition (ATR) and texture analysis algorithm to perform efficiently and gives the image a grainy appearance. Hence, despeckling is considered as a critical preprocessing step in medical imaging systems. Speckle noise follows a gamma distribution and is given as in Equation (1).
image
where variance is a�� and g is the gray level. On an image, speckle noise (with variance 0.05) looks as shown in Figure 1a and the corresponding gamma distribution is given in Figure 1b.
image

ROPOSED HYBRID FILTERS

This paper proposes a new variant of base model, which replaces the median filter with a filter that is more suitable to remove speckle noise. The filters considered to replace median filters are (i) Kaun filter, (ii) Lee filter and (iii) Frost filter. All the three filters selected have been successfully exploited to remove speckle noise. The disadvantage of using it directly on ultrasonic images is that it produces artifacts as a side effect after removal. In order to improve anisotropic diffusion filter, traditional speckle noise removal filters and RHM model, anisotropic diffusion filter is modified to use a 4th order PDE, followed by any one of the three speckle noise removal techniques. Thus, three new hybrid models are proposed, as listed below and Figure 2 shows the methodology adopted. The techniques and algorithms used are explained in this section.
1. 4th Order PDE based Anisotropic Diffusion Filter + Kaun Filter (ADFK Model)
2. 4th Order PDE based Anisotropic Diffusion Filter + Lee Filter (ADFL Model)
3. 4th Order PDE based Anisotropic Diffusion Filter + Frost Filter (ADFF Model)
image

A. Anisotropic diffusion

In anisotropic diffusion, the main motto is to encourage smoothening with in the region in preference to the smoothening across the edges. This is achieved by setting the conduction coefficient as 1 within the region and as 0 near edges, however, the main problem involved in this is the detection of the presence and absence of edges. This is done by analyzing the conduction coefficient as a function of magnitude of the gradient. A general expression (Acton et al., 2003) for anisotropic diffusion can be written by Equation (3).
image
image
A planar image obviously satisfies (Rajan and Kaimal, 2006a), hence is a global minimum of E(u). Planar images are the only global minimum of E(u) if f ''(s) ³ 0 for all s ³ 0 because the cost functional E(u) is convex under this condition (Rajan and Kaimal, 2006b). Therefore, the evolution of Equation (9) is a process in which the image is smoothed more and more until it becomes a planar image. But in the case of second order anisotropic diffusion, ƒ”(s) may not be greater than zero for all s, which results in a stepping blocking artifact effect in the resultant image.

D. Speckle Filters

Several researchers have contributed techniques to resolve the despeckling problem. The main challenge is that the process of denoising is irreversible and therefore must be very careful while removing noise regions. Accidental removal of important regions should be avoidedAmong the standard filters, Lee Filter, Frost Filter (Frost et al., 1982), Median Filter and Kaun Filter (Kaun et al., 1985) have been successfully applied to the problem of speckle reduction and are discussed in this section.
Each filter discussed in this section, has a unique reduction approach which is applied to a kernel (square-moving window) and filtering is based on the statistical relationship that exists between the central pixel and its surrounding pixels (Figure 3). The typical size of the kernel has to be odd ranging from 3 x 3 to 33 x 33. The kernel size has to be chosen carefully, as a large size will be computationally expensive and important information might be lost due to over smoothing. Similarly, speckle reduction cannot be applied to a very small kernel. Most of the works use a 3 x 3 or 7 x 7 kernel size.
image
Filtering is based on either local statistical data or on the estimation of local noise variance of the kernel. The variance thus obtained is then used to determine the amount of smoothening needed for each speckle image. The noise variance determined from the local filter window is more applicable if the intensity of an area is constant or flat while ENL is suitable if there are difficulties determining if an area of the image is flat.

• Lee Filter

The Lee filter uses the least-squares approach to estimate the true signal strength of the center cell in the filter window from the measured value in that cell, the local mean brightness of all cells in the window, and a gain factor is calculated from the local variance and the noise standard deviation. The filter assumes a Gaussian (normal) distribution for the noise values, and calculates the local noise standard deviation for each filter window. The Lee filter calculation produces an output value close to the local mean for uniform areas and a value close to the original input value in higher contrast regions. Lee filters are more affective in uniform areas and can maintain edges and other fine detail. The Lee filter has no user-defined parameters. The mathematical background of the lee filter is given below.
The Lee filter is based on the approach where smoothing is performed when the variance over an area is low or constant, otherwise, that is, if the variance is high (e.g. near edges), smoothing will not be performed. The Lee filter assumes that the speckle noise is multiplicative and can be approximated by a linear model given in Equation (12).
image
image

EXPERIMENTAL RESULTS

To evaluate the proposed models, eight performance metrics were used. They are, Noise Mean Value, Noise Standard Deviation, Mean Square Difference, Equivalent Number of Looks, Deflection Ratio and Figure of Merit, Peak Signal to Noise Ratio (PSNR) and Denoising time. The explanation of the first six parameters are given in Mastriani and Giraldez (2006). Four ultasound images were selected for testing the proposed models. All the proposed models were executed on a Pentium IV machine with 512 MB RAM and were developed in MATLAB 7.3. The test original images used are given in Figure 4 and 20% speckle noise was introduced in all these images. The performance of the proposed hybrid models, namely, ADFK, ADFL and ADFF models were judged by comparing the result with the conventional models. The models chosen for comparison are median filter, Kaun Filter, Lee Filter, Frost Filter, SRAD filter and SRAD + Median Filter (Base Model).
image

A. Noise Mean Value

The Noise Mean Value was calculated for all the test images, before and after filtering, for all filters and the results obtained are shown in Table 1.
image
From the Noise Mean Values projected in Table 1, it is clear that all the three proposed hybrid models produce better results than the conventional models. To evaluate the overall model performance, the average value of the four models were calculated. From the Table, it can be seen that among the ten models, ADFF produce better results in all the four images. This was followed by ADFL and ADFK.

B. Noise Standard Deviation (NSD)

The noise standard deviation obtained for the four test noisy images are projected in Table 2.
image
From the results, it could be seen that the ADFF filter again outperforms all the other proposed models and the conventional models. This result is at par with the results of Table 2, which shows that the NSD results are consistent.

C. Mean Square Difference (MSD)

The Mean Square Difference (MSD) obtained for all the three proposed models and the selected six conventional filter models are shown in Table 3.
image
image
image
The high PSNR obtained gives the understanding that the visual quality of the denoised image is good. According to Venkatesan et al. (2008), an improved denoising algorithm is recognized by a high PSNR or a lower MSE. In agreement with this, the results of the proposed systems with high PSNR prove that they are an improved version over existing methods. Similarly, according to the report of Schneier and Abdel-Mottaleb (1996), a PSNR value in the range 30-40 indicates that the resultant image is a very good match to the original image. In accordance with this report, the results of all the three the proposed hybrid algorithms produce PSNR values in the range 40-46dB proving that it is an enhanced version when compared with the conventional algorithms.

H. Despeckling Time

Table 8 shows the time taken by the proposed and conventional filters to perform the denoising operation.
image
While considering the execution time, the ADFF model was the quickest in despeckling the noisy image, which was followed by ADFK and ADFL. This clearly shows that the introduction of 4th order PDE based anisotropic diffusion function combined with knau, lee and frost filters converges quickly, which consequently speeds up the despeckling process.
According to Müldner et al. (2005), PSNR and speed are the two most important performance factors of any denoising algorithm. From the results, it is evident that the speed of the proposed denoising algorithms are faster when compared to the standard algorithms and therefore makes it an attractive option for several advanced applications in the field of medical imaging.
The visual comparison of the denoised image produced by the various conventional and proposed filters is shown in Figure 5 for image UC 1. Similar quality was observed with all other test images also.
image

CONCLUSION

Thus, the various results of the experiments conducted clearly indicate that the images produced by the proposed despeckling algorithm are of good visual quality and therefore can be applied to most of the image medical processing systems. The three hybrid models can be combined with wavelet shrinkage function to improve the convergence time. The three shrinkage functions, VisuShrink, BayesShrink and PureShrink can be applied and the performance can be compared. The present work focused on producing despeckling algorithms which reduces the noise from the noisy image. The work has not considered the memory efficiency and computation complexity, which can be analyzed in future.

References

  1. Acton, S.T., Molloy, J.A. and Yu, Y. (2003) Three- Dimensional Speckle Reducing Anisotropic Diffusion, IEEE Conference Record of the 37th Asilomar Conference on Signals, Systems and Computers, Vol.2, Pp. 1987- 1991
  2. Frost, V.S. , Stiles, J.A., Shanmugam, K.S. and Holtzman, J.C. (1982) A model for radar image & its application To Adaptive digital filtering for multiplicative noise, IEEE Transaction on pattern analysis and machine intelligence, Vol. PMAI-4, Pp.175-16-1982.
  3. Fu, S., Ruan, Q., Wang, W. and Li, Y. (2006) Adaptive Anisotropic diffusion for ultrasonic image denoising and edge enhancement, International Journal of Information Technology, Vol. 2, No. 4, Pp. 284-292.
  4. Greer, J.B. and Bertozzi, A.L. (2004) Travelling Wave Solutions of Fourth Order PDEs for Image Processing, SIAM Journal on Mathematical Analysis, Vol. 36, Pp. 38- 68.
  5. Grieg, G., Kubler, O., Kikinis, R. and Jolesz, F.A. (1992) Nonlinear Anisotropic Filtering of MRI Data, IEEE Transactions on Medical Imaging, Vol. 11, No. 2, Pp. 221- 232.
  6. Hamza, A. B., Escamilla, P. L., Aroza, J. M. and Roldan, R. (1999) Removing Noise and Preserving Details withRelaxed Median Filters, Journal of Mathematical Imaging and Vision, Pp 161-177.
  7. Hangiandreou, N.J. (2003) Physics Tutorial for Residents: Topics in US: B-mode US: Basic Concepts and New Technology – Hangiandreou, Radiographics, Vol. 23, No.4, P. 1019.
  8. Kaun, D.T., Sowchauk, T.C. and Chavel, S.P. (1985) Adaptive noise smoothing filters for signal dependent Noise, IEEE Transaction on pattern analysis and machine intelligence, Vol. PMAI -7, Pp.165-177.
  9. Ling, J. and Bovik, A.C. (2002) Smoothing Low-SNR Molecular Images Via Anisotropic Median Diffusion, IEEE Trans. on Medical Imaging, Vol. 21, Pp.21-24.
  10. Lysaker, M., Lundervold, A. and Tai, X.C. (2003) Noise Removal Using Fourth – Order Partial Differential Equation With Applications to Medical Magnetic Resonance Images in Space and Time, IEEE Trans. Image Processing, Vol. 12, Pp 1579-1590.
  11. Mastriani, M. and Giraldez, A.E. (2006) Kalman’s Shrinkage for Wavelet-Based Despeckling of SAR Images, International Journal of Intelligent Systems and Technologies, Vol.1, No.3, Pp.190-196.
  12. Min, L. and Xiangchu, F. (2007) Image restoration using total variation and anisotropic diffusion equation, Frontiers of Electrical and Electronic Engineering in China, Higher Education Press, co-published with Springer-Verlag GmbH, Vol. 2, No. 4, Pp. 400-403
  13. Mrazek, P., Weickert, J. and Steidl, G. (2003) Correspondence between Wavelet Shrinkage and Nonkinear Diffusion, Scale-Space 2003, LNCS 2695, Pp. 101-116.
  14. Müldner, T., Leighton, G. and Diamond, J. (2005) Using XML compression for WWW communication, Proceedings of the IADIS WWW/Internet 2005 Conference, 2005.
  15. Perona, P. and Malik, J. (1990) Scale-space and edge detection using anisotropic diffusion, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 12, Pp 629- 639.
  16. Perona, P. and Malik, J. (1987) Scale-space and edge detection using anisotropic diffusion, Proceedings of IEEE Computer Society Workshop on Computer Vision,. Pp. 16– 22.
  17. Pitas, I. and Venetsanopoulos, A.N. (1990) Nonlinear Digital Filters: Principles and Applications, Kluwer Academic Publishers, 1990.
  18. Rajan, J. and Kaimal, M.R. (2006a) Image Denoising using Wavelet Embedded Anisotropic Diffusion (WEAD), Proceedings of IET International Conference on Visual Information Engineering Pp 589-593.
  19. Rajan, J. and Kaimal, M.R. (2006b) Speckle reduction in Images with WEAD & WECD”, Computer Vision, Graphics and Image Processing, Lecturer Notes in Computer Science (LNCS) 4338, Springer –Verlag, Pp 184-193.
  20. Rajan, J., Kannan, K. and Kaimal, M.R. (2009) An Improved Hybrid Model for Molecular Image Denoising, Journal of Mathematical Imaging and Vision, Vol. 31 No. 1, Pp. 73–79.
  21. Raman, M. and Himanshu, A. (2010) A Novel Technique for Speckle Noise Reduction on Medical Images, International Journal of Applied Engineering Research, Vol. 5, No. 1, Pp. 16-23.
  22. Sapiro, G. (2001) Geometric partial differential equations and image analysis, Cambridge University Press. P. 223.
  23. Schneier, M. and Abdel-Mottaleb, M. (1996) Exploiting the JPEG compression scheme for image retrieval, IEEE Trans. Pattern Anal. Mach. Intell., Vol.18, No. 8, Pp. 849–853.
  24. Sudha, S., Suresh, G.R. and Sukanesh, R. (2009a) Comparative Study on Speckle Noise Suppression Techniques for Ultrasound Images, International Journal of Engineering and Technology Vol. 1, No. 1, Pp. 1793-8236.
  25. Sun, X. and Song, G. (2007) A New Anisotropic Diffusion Equation with Adaptive Fidelity Term, International Conference on Computational Intelligence and Security (CIS 2007), Pp. 330-334.
  26. Torkamani-Azar, F. and Tait, K.E. (1996) Image recovery using the anisotropic diffusion equation, IEEE Transactions on Image Processing, Vol. 5, Issue 11, Pp. 1573-1578. [27] Tso, B. and Mather, P. (2009) Classification Methods for Remotely Sensed Data (2nd ed.), CRC Press. Pp. 37–38.
  27. Venkatesan, M., MeenakshiDevi, P., Duraiswamy, K. and Thyagarajah, K. (2008) Secure Authentication Watermarking for Binary Images using Pattern Matching, IJCSNS International Journal of Computer Science and Network Security, Vol.8, No.2, Pp. 241-250.
  28. Wang, Z. and Zhang, D. (1999) Progressive switching Median filter for the removal of impulse noise from highly corrupted images, IEEE Transaction on circuits and Systems – II, Analog and Digital Signal Processing, Vol. 46, No 1, Pp. 1-8.
  29. Wei. G.W. (1999) Generalized Perona-Malik equation for image processing, IEEE Signal Processing Letters,Vol 6, Pp 165-167.
  30. You, Y.L. and Kaveh, M. (2000) Fourth-Order Partial Differential Equations for Noise Removal, IEEE Trans. Image Processing, Vol. 9, Pp 1723-1730.
  31. Yu, Y. and Acton, S.T. (2002) Speckle Reducing Anisotropic Diffusion”, IEEE Transactions on Image Processing, Vol. 11, Pp.1260- 1270.