• Users Online: 342
  • Print this page
  • Email this page

 Table of Contents  
Year : 2016  |  Volume : 6  |  Issue : 4  |  Page : 231-236

Barrett's mucosa segmentation in endoscopic images using a hybrid method: Spatial fuzzy c-mean and level set

1 Department of Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan University of Medical Science, Isfahan, Iran
2 Department of Biomedical Engineering, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
3 Department of Internal Medicine, Faculty of Medicine, Isfahan University of Medical Science, Isfahan, Iran

Date of Web Publication17-Sep-2019

Correspondence Address:
Hossein Rabbani
Department of Biomedical Engineering, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan
Login to access the Email id

Source of Support: None, Conflict of Interest: None

DOI: 10.4103/2228-7477.195087

Rights and Permissions

Barrett's mucosa is one of the most important diseases in upper gastrointestinal system that caused by gastro-esophagus reflux. If left untreated, the disease will cause distal esophagus and gastric cardia adenocarcinoma. The malignancy risk is very high in short segment Barrett's mucosa. Therefore, lesion area segmentation can improve specialist decision for treatment. In this paper, we proposed a combined fuzzy method with active models for Barrett's mucosa segmentation. In this study, we applied three methods for special area segmentation and determination. For whole disease area segmentation, we applied the hybrid fuzzy based level set method (LSM). Morphological algorithms were used for gastroesophageal junction determination, and we discriminated Barrett's mucosa from break by applying Chan-Vase method. Fuzzy c-mean and LSMs fail to segment this type of medical image due to weak boundaries. In contrast, the full automatic hybrid method with correlation approach that has used in this paper segmented the metaplasia area in the endoscopy image with desirable accuracy. The presented approach omits the manually desired cluster selection step that needed the operator manipulation. Obtained results convinced us that this approach is suitable for esophagus metaplasia segmentation.

Keywords: Adenocarcinoma, algorithms, Barrett's mucosa, cardia, endoscopy, esophagogastric junction, fuzzy logic, gastroesophageal reflux, metaplasia, segmentation

How to cite this article:
Yousefi-Banaem H, Rabbani H, Adibi P. Barrett's mucosa segmentation in endoscopic images using a hybrid method: Spatial fuzzy c-mean and level set. J Med Signals Sens 2016;6:231-6

How to cite this URL:
Yousefi-Banaem H, Rabbani H, Adibi P. Barrett's mucosa segmentation in endoscopic images using a hybrid method: Spatial fuzzy c-mean and level set. J Med Signals Sens [serial online] 2016 [cited 2022 Jun 28];6:231-6. Available from: https://www.jmssjournal.net/text.asp?2016/6/4/231/195087

  Introduction Top

Upper gastrointestinal endoscopy is one of the most frequent medical procedures; evaluating patients with gastro-esophageal reflux disease (GERD) makes a large proportion of these procedures all over the world. This disorder is quite frequent but may less likely be erosive esophagitis and rarely be a clinically significant medical problem, i.e., mucosal change into specified intestinal metaplasia that is called Barrett's mucosa that consequently may change into cancer.

In diagnostic esophagogastroduodenoscopy of GERD cases, a physician looks for (a) finding and grading erosive esophagitis (b) searching possible etiology including sliding hiatal hernia and its size, and (c) detecting and measuring abnormal mucosa in gastro-esophageal junction (GEJ), i.e., Barrett mucosa.

To reach each of the goals of scopy in GERD, there is a need for measurement of the length or width of parts of image that a physician observes during the procedure considering baseline and landmarks, for the purpose of (i) detecting anatomical GEJ or Z line (ii) marking highest border of red-colored mucosa and (iii) considering its irregular or broken shape traditionally called breaks and tongues.

In the current study as a pilot investigation, we tried to map endoscopically suspected Barrett's mucosa especially its upper border considering its possibly broken-line shape; this may then facilitate further measurements according to clinically accepted classifications of erosive esophagitis (i.e., Los Angles) and Barrett mucosa (i.e., Prague).[1] Our study showed that very few image analysis methods have been performed in this area. Hence, we were motivated to do research on Barrett's mucosa in endoscopic images.

Medical image segmentation is challenging due to weak resolution and poor contrast.[2] The image segmentation algorithms are normally based on some characteristics obtained from an image such as gray level, color, pattern, texture, depth, or motion.[3],[4],[5] One of the most accurate image segmentation methods that is widely used is level set method (LSM) that is numerical techniques which can follow the evolution of interfaces. LSMs can be divided into two main categories, named as edge-based models that use image gradients to detect the boundaries and region-based models that utilize the statistical information to control the evolution of contour to detect boundaries. LSMs fail to achieve desired segmentation when an image contains several blocks with gradual variations in pixel intensities.[4]

One of the most popular clustering algorithms, fuzzy c-means (FCMs) algorithm, is an unsupervised technique which has been successfully used in many fields such as clustering and segmentation. However, there are some deficiencies in FCM algorithm. Therefore, several modifications have been proposed to improve the performance of FCM algorithm.[5]

Due to complexity in medical image segmentation especially in esophagus endoscopic images neither LSM nor FCM algorithm alone can be relied upon to obtain a perfect result. Some hybrid intelligent systems have used fuzzy clustering to facilitate level set segmentation. Rastgarpour et al. used hybrid method to segment brain tumor, brain tissue, with inhomogeneous intensity.[6] Anitha and Peter used fuzzy based level set to detect mammogram mass.[7] Li et al. used fuzzy based level set for different medical image segmentation such as brain white and gray matter, liver and tumors.[8] Balla-Arabé proposed a robust combined level set and fuzzy clustering for inhomogeneous image segmentation.[9] Although an LSM based on FCM clustering can suppress problems such as noise sensitivity and poor boundaries but the operators still have to select initial boundary manually and set proper parameters for optimal segmentation.[8],[10] Hence, we proposed combined fuzzy based LSM to segment the esophagus endoscopic images. In this method first, we applied spatial FCM (SFCM) on the given image and then obtained result served as an initial contour for LSM to obtain more accurate segmentation of the image.

In this paper, we improve the FCM based level set segmentation algorithm for full automatic medical image segmentation especially for Barrett's mucosa endoscopy image segmentation.

  Materials and Methods Top

Patient geometric data were selected from a set of several 24-bit esophagus endoscopy image series of patients that had endoscopy procedure in one of the author's clinic. Selected images have resolution of 240 × 320 × 3 pixels. The implemented MATLAB program runs in a computer with dual-core 2.53 GHz CPU and 4G of RAM. The graphical block diagram of the proposed approach has been showed in [Figure 1].
Figure 1: The graphical block diagram of proposed Barrett's mucosa segmentation method

Click here to view


Before applying the automatic combined method for image segmentation, an enhancement procedure was performed. Since the obtained images are represented by close contrast values, so the histogram equalization method was applied to enhance the image contrast globally. However, because of the nature of color image, the color space was converted from RGB to LAB, and only luminance (L) channel was used for equalization without changing other channels (because L contains information about lightness and A and B are color-opponent dimensions). The enhanced image was fed to the segmentation algorithm.

Spatial fuzzy C-mean algorithm

FCM clustering is an unsupervised method that the centroid and domain of each sub-clusters are estimated iteratively to minimize the predefined cost function. The main goal behind this method is to distribute the data into clusters that minimizes the dissimilar properties in each cluster. The FCM algorithm has been widely applied for medical image processing such as image segmentation, image enhancement.[11],[12] The FCM algorithm classifies pixels of data sets into clusters using a distance function. For an FCM clustering with Euclidian distance function, with c clusters, the FCM cost function is defined as follows:[13],[14],[15]

where xj is the specific image pixel and uij represents the membership of jth pixel in the ith cluster, vi is the centroid of ith cluster, ||·|| denote a norm metric, and m is a parameter that controls the fuzziness of the obtained segmentation results. The membership function represents the probability of belonging of a pixel to a specific cluster that satisfies this condition . The membership P value of a pixel is dependent on the distance between the pixel and centroid of its cluster. Membership function and centroid of clusters are updated iteratively as below:

in an image, neighboring pixels have high correlation with each other. Therefore, if we applied a method that uses the spatial information, so we can utilize neighboring pixels information to suppress noise and artifact effect. In the SFCM algorithm, using spatial information, the algorithm is robust to noise and disturbance. Chuang et al. proposed an SFCM algorithm that uses spatial information in fuzzy membership directly by:[14],[16]

where h contains spatial information and p and q are parameters that control the importance of u and h. The spatial information h can be defined as:

where NB (xj) denotes a local window centered on image pixel xj.

Level Set Method

The LSM is a powerful numerical method for tracking interfaces and boundaries that use the PDE equations. This method originally presented by Osher and Sethian to track sliding interfaces.[17] It has been used quite widely in signal and image processing fields such as image segmentation.[16] The benefit of the LSM is performing numerical computation including curves and surfaces on a Cartesian grid. The LSM against FCM starts with an initial curve or surface and push it perpendicular to itself at a defined speed. In the LSM, φ (x, y, t) is the height of the surface at position (x, y) and time t. To find the movement of interface, we first require:

For a general curve, C can be defined as a signed distance function to C

Signed pressure force formulation

Zhang et al. introduced a new region-based signed pressure force (SPF) function to control the zero level set at weak boundaries.[18] The region-based methods have two great advantages. First, region-based methods are less sensitive to image noise and give higher accuracy for images with blurred edges and boundaries. Second, they are not affected by the placement of initial curve. The proposed LSM using SPF formulation is introduced as follows:

c1 and c2 are constants which are the average intensities inside and outside the contour respectively that are defined as:

H(φ) is the Heaviside function.

Chan-vase method

In this section, we shortly explain about the proposed region-based algorithm by Chan and Vese.[19] We use region information in this method to detect objects whose boundaries are not well defined by gradient and edge information. In this method at first, an evolving curve C in Ω (as the boundary of an open subset ω of Ω) has to be defined. Assume that the image I0 is represented by two regions of piecewise constant intensities. Let c0 denote the boundary object; then we have inside the object, and outside the object. Now we can write the energy function as:[19]

where c1 and c2 are defined in LSM, C is any variable curve, α and β are. So the boundary of object is the minimizer of the fitting energy:

for example, if the curve C is outside the object, then F1 (C) > 0 and F2 (C) ≈ 0. On the other hand, if the curve (C) is inside the object, then F1 (C) ≈ 0 and F2 (C) > 0. Finally, the fitting energy is minimized if C ≈ C0. For our purpose, we regularized internal and external energy in a way, boundary evolution stops where it has steep, abrupt changes. Therefore, in this study, we selected α = 2 for more smoothness. This basic remark is showed in [Figure 2].
Figure 2: Basic remark, black line is original curve and the red line is desired curve

Click here to view

Proposed algorithm

The level set and FCM methods can be used for multidimensional image segmentation separately. Recently, new hybrid approaches have been developed, but for final segmentation, we must select the desired cluster manually.[8] In this paper, we propose a new method to segment the Barrett´s mucosa in esophagus endoscopy image. We first converted the original image to a binary one with a proper threshold which was obtained by Otsu method, and then we calculated the correlation coefficient of the FCM output clusters with the binary image:

where are the mean of FCM cluster and binary image, respectively. The cluster with the high correlation coefficient is selected as the desired cluster to feed the LSM as initial contour, and the output of the LSM would be the whole disease area. Parallel to this algorithm, the region based active contour is applied to the original image for determining Barrett's mucosa in the final step. In the final step, to obtain Barrett's mucosa area, the output of region-based active contour is subtracted from the output of LSM.

Finally, for evaluation, we compare our obtained results with manual segmentation results that have been done by gastroenterologist as a gold standard. For quantitative evaluation we compute accuracy of the proposed method.

  Results Top

In this section, we express our experiment results on esophagus endoscopic images. As illustrated above for Barrett's mucosa segmentation we applied a hybrid method. We used two types of LSM, LSM with SPF formulation and Chan-Vase method for all disease segmentation and GEJ detection, respectively. Then we determine break region for further evaluation.

[Figure 3] illustrates the Barrett's mucosa segmentation in endoscopic images. FCM and LSMs fail to segment this type of medical images due to weak boundaries if used separately. In contrast, the hybrid model FCM and SPF formulation LSM with correlation approach have been able to segment the Barrett's mucosa in endoscopic images with acceptable accuracy. Obtained results have been showed below.
Figure 3: Illustration of the automatic method (a) original images, (b) the binary images of the original images, (c) the desired FCM output clusters and (D) the output of the level set method, blue and green contours represent the Barrett's mucosa and base line respectively

Click here to view

In the next step, we used Chan-Vase model to determine the break region in Barrett's mucosa, in this step, we determine the external and internal energy in which way that the model stops in areas with high changes in boundaries. Then the obtained results are subtracted from those ones that were obtained from the hybrid step. The results were shown in [Figure 4].
Figure 4: The Barrett's mucosa esophagus segmentation

Click here to view

For evaluation, we compare the obtained results from proposed method with manual segmentation as a gold standard by calculating dice metric of segmented areas. There was more than 95% agreement between algorithm results and gold standard segmentation. The obtained results have been showed in [Table 1].
Table 1: Barrett's mucosa segmentation performance

Click here to view

  Discussion Top

Analysis and processing of the esophagus endoscopy image is one of the challenging fields in medical image processing due to noise and light reflection. Hence, in the current work, we proposed a full automatic hybrid method for segmentation of the suspicious endoscopic Barrett's mucosa. Since the different endoscopy device images have different features and topologies so model tuning was required at first. We successfully applied combined SFCM with SPF formulation based LSM for dysplasia area segmentation. Furthermore, combination of hybrid approach with Chan-Vase segmentation method segments the break part properly. In Chan-Vase segmentation method, we regularized internal and external energy in a way that boundary stops where it has steep abrupt changes. With this approach first we can introduce break's starting points, second by subtracting Chan-Vase segmentation method from hybrid method break regions are determined. The presented approach omits the manually desired cluster selection step that needed operator manipulation. Obtained results show that this approach can segment Barrette´s mucosa disease images properly and automatically. As have been showed in [Figure 3] this algorithm can segment the disease and determine the baseline for disease progress evaluation. Furthermore, our method could segment the endoscopic Barrett to determine the length and surface of the disease.

A report on single-endoscopist detection of GEJ point showed high accuracy in a small group of patients[20] but when considering esophagitis or Barrett's mucosa we need to calculate the length and a simulation study on a sample of expired and trainee endscopists showed over/underestimation of length in 5/6 of measurements.[21] On the other hand, there is a problem with inter-observer reliability especially in short lengths; a study in Asian gastroenterologist showed ICC values for Barrett's segment <1 cm were as low as 0.18.[22] This shows the need for an automated method of measurement in GEJ endoscopy to detect columnar lined epithelium and erosions with perfection.

We may conclude that this algorithm seems to be proper for GEJ endoscopy image segmentation. There are some potential limitations in current study: First, we focused on upper border of segment and measuring Barrett's mucosa needs perfect setting of GEJ that is defined by upper border of gastric folds as American gastroenterologists do, not the lower limit of palisade esophageal vessels as Japanese doctors do; second, when calculating the length of Barrett's mucosa we need a set of push-in and pull-out images since the height is variable based on which type of image is analyzed.[23] In future works, we want to measure the dimensions of the segment quantitatively to assist the gastroenterologist.

  Conclusion Top

We proposed fuzzy based level set method for segmentation and evaluation of Barrett´s mucosa. In future works, we want to measure the dimensions of the segment quantitatively to assist the gastroenterologis.

Financial support and sponsorship


Conflicts of interest

There are no conflicts of interest.

  References Top

Sharma P, Dent J, Armstrong D, Bergman JJ, Gossner L, Hoshihara Y et al.The development and validation of an endoscopic grading system for Barrett's esophagus:The Prague C &M criteriaGastroenterology200613113929  Back to cited text no. 1
Khodadad D, Ahmadian A, Ay M, Esfahani AF, Banaem HY, Zaidi HB-Spline Based Free Form Deformation Thoracic Non-rigid Registration of CT and PET ImagesProceedings of SPIE20118285  Back to cited text no. 2
Pham DL, Xu C, Prince JLCurrent methods in medical image segmentationAnnu Rev Biomed Eng2000231537  Back to cited text no. 3
Kumar S, Ray SK, Tewari PA hybrid approach for image segmentation using fuzzy clustering and level set methodInt J Image Graph Signal Process201241  Back to cited text no. 4
Zuva T, Oludayo OO, Ojo SO, Ngwira SMImage segmentation, available techniques, developments and open issuesCan J Image Process Comput Vis20112209  Back to cited text no. 5
Rastgarpour M, Shanbehzadeh JA new kernel-based fuzzy level set method for automated segmentation of medical images in the presence of intensity inhomogeneityComput Math Methods Med 20142014978373  Back to cited text no. 6
Anitha J, Peter JDA Spatial Fuzzy Based Level Set Method for Mammogram Mass SegmentationElectronics and Communication Systems (ICECS), 2015 2ndInternational Conference on IEEE2015  Back to cited text no. 7
Li BN, Chui CK, Chang S, Ong SHIntegrating spatial fuzzy clustering with level set methods for automated medical image segmentationComput Biol Med201141110  Back to cited text no. 8
Balla-Arabé S, Gao X, Wang BA fast and robust level set method for image segmentation using fuzzy clustering and lattice Boltzmann methodIEEE Trans Cybern20134391020  Back to cited text no. 9
Suri JS, Liu K, Singh S, Laxminarayan SN, Zeng X, Reden LShape recovery algorithms using level sets in 2-D/3-D medical imagery:A state-of-the-art reviewIEEE Trans Inf Technol Biomed20026828  Back to cited text no. 10
Ho S, Bullitt E, Gerig GLevel-Set Evolution with Region Competition:Automatic 3-D Segmentation of Brain TumorsPattern Recognition 2002 Proceedings 16th International Conference on IEEE2002  Back to cited text no. 11
Suri JSTwo-dimensional fast magnetic resonance brain segmentationIEEE Eng Med Biol Mag2001208495  Back to cited text no. 12
Dunn JCA fuzzy relative of the ISODATA process and its use in detecting compact well-separated clustersJournal of Cybernetics197333257  Back to cited text no. 13
Yousefi-Banaem H, Kermani S, Sarrafzadeh O, Khodadad DAn Improved Spatial FCM Algorithm for Cardiac Image SegmentationFuzzy Systems (IFSC), 2013 13th Iranian Conference on2013August27-29  Back to cited text no. 14
Bezdek JCPattern Recognition with Fuzzy Objective Function Algorithms1981MA, USAKluwer Academic Publishers  Back to cited text no. 15
Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJFuzzy c-means clustering with spatial information for image segmentationComput Med Imaging Graph200630915  Back to cited text no. 16
Osher S, Sethian JAFronts propagating with curvature-dependent speed:Algorithms based on Hamilton-Jacobi formulationsJ Comput Phys1988791249  Back to cited text no. 17
Zhang K, Zhang L, Song H, Zhou WActive contours with selective local or global segmentation:A new formulation and level set methodImage Vis Comput20102866876  Back to cited text no. 18
Chan TF, Vese LAActive contours without edgesIEEE Trans Image Process20011026677  Back to cited text no. 19
Wallner BEndoscopically defined gastroesophageal junction coincides with the anatomical gastroesophageal junctionSurg Endosc20092321558  Back to cited text no. 20
Guda NM, Partington S, Vakil NInter- and intra-observer variability in the measurement of length at endoscopy:Implications for the measurement of Barrett's esophagusGastrointest Endosc2004596558  Back to cited text no. 21
Lee YC, Cook MB, Bhatia S, Chow WH, El-Omar EM, Goto H et al.Interobserver reliability in the endoscopic diagnosis and grading of Barrett's esophagus:An Asian multinational studyEndoscopy201042699704  Back to cited text no. 22
Ishimura N, Amano Y, Kinoshita YEndoscopic definition of esophagogastric junction for diagnosis of Barrett's esophagus:Importance of systematic education and trainingDig Endosc2009212138  Back to cited text no. 23


  [Figure 1], [Figure 2], [Figure 3], [Figure 4]

  [Table 1]

This article has been cited by
1 Tri-Scan: A Three Stage Color Enhancement Tool for Endoscopic Images
Mohammad S. Imtiaz,Shahed K. Mohammed,Farah Deeba,Khan A. Wahid
Journal of Medical Systems. 2017; 41(6)
[Pubmed] | [DOI]


Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
Access Statistics
Email Alert *
Add to My List *
* Registration required (free)

  In this article
   Materials and Me...
   Article Figures
   Article Tables

 Article Access Statistics
    PDF Downloaded34    
    Comments [Add]    
    Cited by others 1    

Recommend this journal