ISSN: 2229-371X
Aqsa RashidM1*, Muhammad Khurrum Rahim2 1Department of Computer Science and Information Technology, The Islamia University of Bahawalpur, Rahim Yar Khan, Pakistan 2Department of Electrical Engineering, National University Computer and Emerging Sciences, Islamabad, Pakistan, aqsarashid2@gmail.com |
Corresponding Author: Aqsa Rashid, Department of Computer Science and Information Technology, The Islamia University of Bahawalpur, Rahim Yar Khan, Pakistan |
Related article at Pubmed, Scholar Google |
Visit for more related articles at Journal of Global Research in Computer Sciences
Focal intention of this paper is to emphasize the appliance of the basic image statics for image restoration, de-blurring, de-noising, enhancement, edge detection, edge sharpening, finding edge position and many more root level appliances of image processing and computer vision. For the evaluation and study of restoration, de-blurring and de-noising, some noise molds are discussed and then for the estimation of the results of statistics, some amount of different types of noise have been added to the image and then the process of filtration is performed for scrutiny the effect. For scrutiny of enhancement some de-enhanced or low contrast image are used. Some image quality measures i.e, Mean Square Error, Peak Signal to Noise Ratio Discussion and conclusions drawn from the experimental results are the comparative study of these appliances of image processing. This paper provide the detail study of selected appliances of image processing and computer vision experimentally, evaluate the performance, compare result on literature and give trend what can be done for new and better loom.
Keywords |
||||||||||||||||||||||||||||||||||
Digital image, Restoration, De-noising, Enhancement, Edge detection, Gaussian, Gamma, Exponential, Salt & pepper, Uniform, Min, Max, Mean, Midpoint, Median, Standard deviation, Variance, Covariance | ||||||||||||||||||||||||||||||||||
INTRODUCTION |
||||||||||||||||||||||||||||||||||
The studies to gather, systematize, scrutinize, and deduce numerical information from data is known as statistics. Min, max, mean, mode, midpoint, median, variance, standard deviation, covariance, histogram etc are the important image statistics used in various root level field of image processing and computer vision like Image enhancement [1-3], image restoration [2,3], image de-blurring [2], image de-noising [2], edge detection etc. | ||||||||||||||||||||||||||||||||||
The main causes of noise in digital images arise during image acquisition and/or transmission. The recital of imaging feeler is affected by a miscellany of causes, such as environmental circumstances during image gaining, or by the excellence of the sensing elements themselves. For occasion, in gaining images with a Charge-Coupled Devices (CCD) camera, light echelon and feeler temperature are main causes affecting the amount of noise in the resultant image. Images are degraded during transmission mainly due to intrusion in the channel used for transmission. For example, an image broadcast using wireless network might perhaps be degraded as a consequence of lightning or other atmospheric disorder. | ||||||||||||||||||||||||||||||||||
In image Enhancement, the main objective of the restoration method is to recover an image in some predefined sense. Although there is vicinity of overlie, image enhancement is principally a subjective procedure, while image restoration is for the majority part an objective procedure. Restoration endeavours to recuperate an image that has been corrupted by using a previous acquaintance of the degradation occurrence. By distinction, enhancement methods principally are heuristic methods designed to maneuver an image in order to take advantage of the physiological facets of the human visual system. For example, contrast stretching is measured as an enhancement method because it is based principally on the pleasing feature it might present to the spectator, whereas elimination of image blurs by applying a de-blurring function is measured as a restoration method. | ||||||||||||||||||||||||||||||||||
The rest of the paper is arranged as second section includes the important image noise molds which are used in experiments, third section includes the definition and explanation of basic image statistics, fourth section include experimental results and discussion, fifth section gives conclusions and references are included in the last section of the paper. | ||||||||||||||||||||||||||||||||||
TYPICAL IMAGE NOISE MODELS [2-7] |
||||||||||||||||||||||||||||||||||
This section discuss some noise models that are added in images for analyzing and comparing the effect of different restoration filters based on image statics. The noise models gives probability density function (PDF), mean and variance of the considered noises. | ||||||||||||||||||||||||||||||||||
Gaussian noise |
||||||||||||||||||||||||||||||||||
Gaussian noise is also named as amplifier noise, normal noise and random variation impulse noise. Primary cause of Gaussian noise in digital images occurs at some stage in acquisition. It is additive noise in nature. The noise probability density function (PDF) of Gaussian noise is defined as: | ||||||||||||||||||||||||||||||||||
(2.1) | ||||||||||||||||||||||||||||||||||
Where Z= grey level, = μ= Mean of Z and σ = Standard deviation | ||||||||||||||||||||||||||||||||||
A plot of this function is shown in Figure 1. | ||||||||||||||||||||||||||||||||||
Plot of Figure 1 and equation (2.1) shows that for 70%, the value of z will be in the range of [( -σ) ( +σ)] and for 95% it will be [( -2σ) ( +2σ)]. | ||||||||||||||||||||||||||||||||||
Gamma noise |
||||||||||||||||||||||||||||||||||
This noise is also named as Erlang noise. The probability density function (PDF) of this noise is defined as | ||||||||||||||||||||||||||||||||||
(2.2) | ||||||||||||||||||||||||||||||||||
Where a>0 and b is a positive integer. Mean and Variance are defined as μ= mean= b/a and σ2=b/a and σ2= b/a2 | ||||||||||||||||||||||||||||||||||
A plot of this function is shown in Figure 2. | ||||||||||||||||||||||||||||||||||
Exponential noise |
||||||||||||||||||||||||||||||||||
The probability density function of exponential noise is defined as | ||||||||||||||||||||||||||||||||||
(2.3) | ||||||||||||||||||||||||||||||||||
Where a > 0, mean and variance for this PDF are μ= 1/a and σ2= 1/a2 respectively. | ||||||||||||||||||||||||||||||||||
A plot of this function is shown in Figure 3. This is a special case of Erlang probability density function, with b=1. | ||||||||||||||||||||||||||||||||||
Uniform |
||||||||||||||||||||||||||||||||||
The probability density function of exponential noise is defined as | ||||||||||||||||||||||||||||||||||
(2.4) | ||||||||||||||||||||||||||||||||||
Mean and variance for this PDF μ= a+b/2 and σ2=(b-a)2/10 are respectively. A plot of this function is shown in (Figure 4). | ||||||||||||||||||||||||||||||||||
Salt and pepper noise |
||||||||||||||||||||||||||||||||||
Salt and pepper noise is also known as spike, random or independent noise. Black and white dots, which are black and white pixels, appear on the image as a result of this noise. The PDF of this function is defined as: | ||||||||||||||||||||||||||||||||||
(2.5) | ||||||||||||||||||||||||||||||||||
If b>a, then intensity b will appear as black dot in the image, otherwise it will be black. If Pa or Pb zero, then salt and pepper noise will be called unipolar. A plot of this function is shown in Figure 5. | ||||||||||||||||||||||||||||||||||
IMAGE STATISTICAL MEASURES AS FILTER [8] |
||||||||||||||||||||||||||||||||||
If RI is the restored image, CI is the corrupted image, W is the sliding window, NxM is the size of sliding window, (x,y) represents the coordinates of RI image and (I,j) are the coordinates of the sliding window then basic image statistical measures can be defined and explain as following: | ||||||||||||||||||||||||||||||||||
Min [8] |
||||||||||||||||||||||||||||||||||
Min is the darkest point or pixel value in the image. In min filter, the minimum value from the sliding window W of size NxM of the input corrupted image CI will placed in central location of the sliding window of the restored image RI. Mathematically it is defined as: | ||||||||||||||||||||||||||||||||||
(2.6) | ||||||||||||||||||||||||||||||||||
Max [8] |
||||||||||||||||||||||||||||||||||
Max is the brightest point or pixel value in the image. In max filter, the maximum value from the sliding window W of size NxM of the input corrupted image CI will placed in central location of the sliding window of the restored image RI. Mathematically this can be expressed as: | ||||||||||||||||||||||||||||||||||
(2.7) | ||||||||||||||||||||||||||||||||||
Midpoint |
||||||||||||||||||||||||||||||||||
The midpoint is the average of highest and lowest value of the image. While filtering, it computes the average of max and min value of the sliding window and put it in the resultant location. It mathematical definition is: | ||||||||||||||||||||||||||||||||||
Mean |
||||||||||||||||||||||||||||||||||
It is the most common and basic of all the statistical measure. Extensive series of this appraise has been urbanized for this reason. It includes the following: | ||||||||||||||||||||||||||||||||||
Arithmetic mean |
||||||||||||||||||||||||||||||||||
Arithmetic mean is simply the averaging of all the pixel values. In arithmetic mean filter simply the average value of the sliding window W of size NxM of the image is replaced with the pixel value of the restored image. Mathematically this can be expressed as: | ||||||||||||||||||||||||||||||||||
(2.9) | ||||||||||||||||||||||||||||||||||
Geometric mean |
||||||||||||||||||||||||||||||||||
This is a variation of variation of arithmetic mean filter. Mathematically it is expressed as: | ||||||||||||||||||||||||||||||||||
(2.10) | ||||||||||||||||||||||||||||||||||
Harmonic mean |
||||||||||||||||||||||||||||||||||
This is just another variation of the arithmetic mean filter defined as: | ||||||||||||||||||||||||||||||||||
(2.11) | ||||||||||||||||||||||||||||||||||
Contra-harmonic mean |
||||||||||||||||||||||||||||||||||
This filter yields a restored image RI by the expression: | ||||||||||||||||||||||||||||||||||
(2.12) | ||||||||||||||||||||||||||||||||||
In equation (2.3), Q is known as the order of the filter. It could be positive, negative or zero. | ||||||||||||||||||||||||||||||||||
Median [9-12] |
||||||||||||||||||||||||||||||||||
It is a ranked based filter. It simply replaces the value of pixel by the median of the neighbourhood picture element. Its mathematical form is: | ||||||||||||||||||||||||||||||||||
(2.13) | ||||||||||||||||||||||||||||||||||
Alpha trimmed |
||||||||||||||||||||||||||||||||||
Assume that if d/2 lowest and d/2 highest pixel intensity values of the corrupted image are deleted, then CIr represents the remaining pixels of the corrupted image. A filter by averaging the CIr is what we call the alpha trimmed filter. Mathematically defines as: | ||||||||||||||||||||||||||||||||||
(2.14) | ||||||||||||||||||||||||||||||||||
Standard deviation [13,14] |
||||||||||||||||||||||||||||||||||
Standard deviation is the most widely used measure for computing the variation from the mean or expected value in image processing. A low value of standard deviation means that the set of point are very close to the mean and inverse is true for the fact that data set will be far from the mean value. Its mathematical form is as: | ||||||||||||||||||||||||||||||||||
(2.15) | ||||||||||||||||||||||||||||||||||
Variance [13,14] |
||||||||||||||||||||||||||||||||||
Variance computes that how far the set of numbers spread out. It is expressed mathematically as: | ||||||||||||||||||||||||||||||||||
(2.16) | ||||||||||||||||||||||||||||||||||
Covariance [13,14] |
||||||||||||||||||||||||||||||||||
This is a measure in statistics that evaluate that how the two random variables change together. This shows the linear relationship between two variables. It is defined as: | ||||||||||||||||||||||||||||||||||
(2.17) | ||||||||||||||||||||||||||||||||||
In equation (2.3), μ represent the mean value | ||||||||||||||||||||||||||||||||||
EXPERIMENTAL RESULTS AND DISCUSSION |
||||||||||||||||||||||||||||||||||
For measuring the performance of the results of different filter, some well-known measures such as Mean Square Error (MSE), Peak Signal to Noise Ratio (PSNR), Universal image Quality Index (UIQI) and Structural Similarity Index Measures (SSIM) are computed between the noisy image and filtered image. Formal mathematical definitions of these measures are: | ||||||||||||||||||||||||||||||||||
1and | ||||||||||||||||||||||||||||||||||
are the pixel pattern of the input image II and the reference image RI, N×M represent the dimensions of input and reference image, μII is the mean of input image, μRI is the mean of the reference image, σII is the standard deviation of input image, σRI is the standard deviation of the reference image, σ2 ΙΙ is the variance of the input image, σ2 RI is the variance of the reference image, σRIII is the covariance between input and reference image and HII and HIR are the value of bin of histogram of input image and reference image respectively. Then image quality measures can be defined as following: | ||||||||||||||||||||||||||||||||||
Experimental results and discussion |
||||||||||||||||||||||||||||||||||
Figure 6 shows the Barbara original image and Barbara image after adding different type noise. Figure 6 (a) is the original Barbara grayscale image. (b) is the image with Gaussian noise. Mean of the Gaussian noise is 0 and variance is 1. (c) Shows the Barbara image with Gamma noise having mean 2 and variance 5. (d) shows the Barbara image with exponential noise having mean and variance 1. (e) shows the image with uniform noise having mean 0 and variance 1. (f) Shows the image with salt and pepper noise having mean and variance 0.05. | ||||||||||||||||||||||||||||||||||
Figure 7 shows the result of arithmetic mean filter. In Figure 7, (a) is the arithmetic mean filter of Figure 6(b), (b) is the arithmetic mean filter of Figure 6(c), (c) is the arithmetic mean filter of Figure 6(d), (d) is the arithmetic mean filter of Figure 6(e) and (e) is the arithmetic mean filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 6 it is clear that although this filter removes the noise but it creates blurring effect in the output restored image. This blurring effect is proportional to the window size. As the size of the sliding window increased the blurring effect also increased. | ||||||||||||||||||||||||||||||||||
Figure 8 shows the result of Geometric mean filter. In Figure 8, (a) is the Geometric mean filter of Figure 6(b), (b) is the Geometric mean filter of Figure 6(c), (c) is the Geometric mean filter of Figure 6(d), (d) is the Geometric mean filter of Figure 6(e) and (e) is the Geometric mean filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 8 it is clear that in the presence of Gaussian noise this filter does not gives good results, in the presence of gamma and exponential noise the result are good as compare to that of Gaussian noise, for uniform noise although some noise have been reduced but not all and in the presence of salt and pepper noise it shows a different variation in terms that this filter removes the salt noise and increase the pepper noise. | ||||||||||||||||||||||||||||||||||
Figure 9 shows the result of harmonic mean filter. In Figure 9, (a) is the harmonic mean filter of Figure 6(b), (b) is the harmonic mean filter of Figure 6(c), (c) is the harmonic mean filter of Figure 6(d), (d) is the harmonic mean filter of Figure 6(e) and (e) is the harmonic mean filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 9 it is clear that in the presence of Gaussian noise this filter does not gives good results, in the presence of gamma and exponential noise the result are good as compare to that of Gaussian noise, for uniform noise although some noise have been reduced but not all and in the presence of salt and pepper noise it shows a different variation in terms that this filter removes the salt noise and increase the pepper noise. | ||||||||||||||||||||||||||||||||||
Figure 10 shows the result of Contra-harmonic mean filter when Q=-ve. In Figure 10, (a) is the contra-harmonic mean filter of Figure 6(b), (b) is the contra-harmonic mean filter of Figure 6(c), (c) is the contra-harmonic mean filter of Figure 6(d), (d) is the contra-harmonic mean filter of Figure 6(e) and (e) is the contra-harmonic mean filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 10 it is clear that in the presence of Gaussian noise this filter does not gives good results, in the presence of gamma and exponential noise the result are good as compare to that of Gaussian noise, for uniform noise although some noise have been reduced but not all and in the presence of salt and pepper noise it shows a different variation in terms that this filter removes the salt noise and increase the pepper noise. | ||||||||||||||||||||||||||||||||||
Figure 11 shows the result of Contra-harmonic mean filter when Q=+ve. In Figure 11, (a) is the contra-harmonic mean filter of Figure 6(b), (b) is the contra-harmonic mean filter of Figure 6(c), (c) is the contra-harmonic mean filter of Figure 6(d), (d) is the contra-harmonic mean filter of Figure 6(e) and (e) is the contra-harmonic mean filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 10 it is clear that in the presence of Gaussian noise this filter does not gives good results, in the presence of gamma, exponential and uniform noise the result are poor as it increase the white noise and in the presence of salt and pepper noise it shows a different variation in terms that this filter removes the pepper noise and increase the salt noise. | ||||||||||||||||||||||||||||||||||
Figure 12 shows the result of Median filter. In Figure 12, (a) is the median filter of Figure 6(b), (b) is the median filter of Figure 6(c), (c) is the median filter of Figure 6(d), (d) is the median filter of Figure 6(e) and (e) is the median filter of Figure 6(f). For this filter the size of the sliding window is 3×3. From Figure 12 it is clear that in the presence of Gaussian noise this filter does not gives good results, in the presence of gamma and exponential noise it shows good result, for uniform noise the result are quite good and for salt and pepper it removes the noise. | ||||||||||||||||||||||||||||||||||
Figure 13 shows the result of Max filter. In Figure 13, (a) is the max filter of Figure 6(b), (b) is the max filter of Figure 6(c), (c) is the max filter of Figure 6(d), (d) is the max filter of Figure 6(e) and (e) is the max filter of Figure 6(f). For this filter the size of the sliding window is 3×3. Figure 13 shows that in the presence of Gaussian noise the results are not good, for gamma, exponential and uniform the results are very poor as there is increase in white pixels and for the salt and pepper noise the result shows the removal of pepper noise and increase in salt noise. | ||||||||||||||||||||||||||||||||||
Figure 14 shows the result of Min filter. In Figure 14, (a) is the min filter of Figure 6(b), (b) is the min filter of Figure 6(c), (c) is the min filter of Figure 6(d), (d) is the min filter of Figure 6(e) and (e) is the min filter of Figure 6(f). For this filter the size of the sliding window is 3×3. Figure 14 shows that in the presence of Gaussian noise the results are not good, for gamma, exponential and uniform the results are quite good and for the salt and pepper noise the result shows the removal of salt noise and increase in pepper noise. | ||||||||||||||||||||||||||||||||||
Figure 15 shows the result of Midpoint filter. In Figure 15, (a) is the midpoint filter of Figure 6(b), (b) is the midpoint filter of Figure 6(c), (c) is the midpoint filter of Figure 6(d), (d) is the midpoint filter of Figure 6(e) and (e) is the midpoint filter of Figure 6(f). For this filter the size of the sliding window is 3×3. Figure 15 shows that the results are very poor in all the cases. | ||||||||||||||||||||||||||||||||||
Figure 16 shows the result of Alpha-trimmed filter. In Figure 16, (a) is the alpha-trimmed filter of Figure 6(b), (b) is the alphatrimmed filter of Figure 6(c), (c) is the alpha-trimmed filter of Figure 6(d), (d) is the alpha-trimmed filter of Figure 6(e) and (e) is the alpha-trimmed filter of Figure 6(f). For this filter the size of the sliding window is 3×3. Figure 16 shows that the results are very poor in all the cases. The reason is that this filter works well in the presence of multiple types of noise. | ||||||||||||||||||||||||||||||||||
Figure 17 shows the effect of standard deviation, covariance and variance. Figure 17(a) is the original Lena image; (b) is the Lena image after applying standard deviation filter and it detect the edges; (c) is the Lena image after covariance filter and it sharpen the edges and (d) is the Lena image after variance filter and it shows the edge position. | ||||||||||||||||||||||||||||||||||
CONCLUSION |
||||||||||||||||||||||||||||||||||
This paper provides the detail study and experimental scrutiny of common image noise molds, important image statistical measures, use of image statistical measures in image processing and computer vision applications and demonstrate the effect of all the filter experimentally. Conclusions are based on the experimental results which are performed on almost 50 standard images. Image statistical measures are very important for the image restoration, image de-noising, image de-blurring, image enhancement, find edge position, edge sharpening, edge detection etc. Experimental results shows that: Mean filter reduce many types of noise but it works most excellent for image restoration in the presence of Gaussian, uniform or Erlang noise and it creates blurring effect in the image which is proportional to the window size. Geometric mean filter works well for the Gaussian noise. Restoration process by harmonic mean filter works well in the presence of Gaussian and salt noise. Contraharmonic mean filter is best for salt or pepper noise. Median filter works best for the salt and pepper noise. Min filter works well for salt noise and max filter gives good result for pepper noise. Standard deviation, covariance and variance are very important and useful for edge detection, edge sharpening and to find edge position. Image restoration, enhancement, de-noising and de-blurring are the fundamental and pre-processing step in almost all the applications of image processing and computer vision. All this analysis is a very supportive and useful guide for all those who want to work in the field of digital image processing and computer vision. This experimental scrutiny will also provide the guidelines to the researcher to project new and better approaches in this field. | ||||||||||||||||||||||||||||||||||
ACKNOWLEGDEMENT |
||||||||||||||||||||||||||||||||||
Special thanks to the “The USC-SIPI Image Database” for providing the images for research and experiments. | ||||||||||||||||||||||||||||||||||
Figures at a glance |
||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||
References |
||||||||||||||||||||||||||||||||||
|