A Multi-Layer MRF Model for Color-Texture Segmentation
Here we present the following supervised color textured image
segmentation results using our multi-layer MRF model:
For additional information, see my
homepage.
Supervised
segmentation results on texture mosaics
The following 14 images were composed using MIT's
VisTex
textured image dataset.
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
0.940000 sec |
0.360000 sec |
154.590000 sec |
154.590000 sec |
154.590000 sec |
Misclassification Rate
|
|
11.3708% |
1.7944% |
3.0518% |
0.0244% |
0.1038% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
1.380000 sec |
0.610000 sec |
210.550000 sec |
210.550000 sec |
210.550000 sec |
Misclassification Rate
|
|
7.4097% |
8.7769% |
3.4607% |
0.8118% |
1.1902% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
0.930000 sec |
0.550000 sec |
271.810000 sec |
271.810000 sec |
271.810000 sec |
Misclassification Rate
|
|
17.7002% |
1.9775% |
3.6621% |
0.4944% |
0.6958% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
2.100000 sec |
0.330000 sec |
267.980000 sec |
267.980000 sec |
267.980000 sec |
Misclassification Rate
|
|
12.3596% |
0.3052% |
3.241% |
0.0854% |
0.1587% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
0.920000 sec |
0.680000 sec |
324.500000 sec |
324.500000 sec |
324.500000 sec |
Misclassification Rate
|
|
22.7722% |
8.7769% |
6.5308% |
2.6245% |
2.9907% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
0.930000 sec |
0.610000 sec |
162.920000 sec |
162.920000 sec |
162.920000 sec |
Misclassification Rate
|
|
13.1348% |
9.4971% |
4.718% |
2.2034% |
2.5757% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
1.150000 sec |
0.540000 sec |
221.480000 sec |
221.480000 sec |
221.480000 sec |
Misclassification Rate
|
|
12.8662% |
7.5195% |
4.2969% |
1.1719% |
1.5747% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
4 |
5 |
4 |
5 |
5 |
Segmentation Time
|
|
1.550000 sec |
1.390000 sec |
94.300000 sec |
94.300000 sec |
94.300000 sec |
Misclassification Rate
|
|
18.0115% |
1.8616% |
5.0964% |
1.0986% |
1.3123% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
4 |
5 |
4 |
5 |
5 |
Segmentation Time
|
|
2.240000 sec |
1.000000 sec |
118.180000 sec |
118.180000 sec |
118.180000 sec |
Misclassification Rate
|
|
15.1733% |
1.0742% |
3.186% |
0.4517% |
0.4028% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
4 |
5 |
4 |
5 |
5 |
Segmentation Time
|
|
3.040000 sec |
1.400000 sec |
252.790000 sec |
252.790000 sec |
252.790000 sec |
Misclassification Rate
|
|
10.6567% |
7.5195% |
3.5522% |
1.3123% |
1.0864% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
1.510000 sec |
0.970000 sec |
106.190000 sec |
106.190000 sec |
106.190000 sec |
Misclassification Rate
|
|
32.0679% |
4.5166% |
4.3701% |
0.6531% |
0.9766% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
1.740000 sec |
1.210000 sec |
109.470000 sec |
109.470000 sec |
109.470000 sec |
Misclassification Rate
|
|
17.1448% |
2.5635% |
3.3752% |
0.4517% |
0.7507% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
7.120000 sec |
1.590000 sec |
347.890000 sec |
347.890000 sec |
347.890000 sec |
Misclassification Rate
|
|
18.8965% |
6.189% |
5.4688% |
1.5991% |
2.1667% |
Supervised
segmentation results on real scenes
The following are some real scene
images. Note that the misclassification rates for the segmented images
are higher than what they should be because we measure the
misclassification based on training regions (which are only part of the
images) instead of real groundtruth images (which is a perfect
segmentation result with 0 misclassfication rate).
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
4 |
4 |
4 |
4 |
3 |
Segmentation Time
|
|
1.680000 sec |
0.920000 sec |
554.970000 sec |
554.970000 sec |
554.970000 sec |
Misclassification Rate
|
|
4.4721% |
4.8146% |
0.7388% |
2.6617% |
2.647% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
4 |
4 |
4 |
4 |
4 |
Segmentation Time
|
|
6.860000 sec |
3.180000 sec |
1997.080000 sec |
1997.080000 sec |
1997.080000 sec |
Misclassification Rate
|
|
20.2539% |
14.2696% |
12.8763% |
12.0838% |
12.365% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
3 |
3 |
3 |
3 |
3 |
Segmentation Time
|
|
3.890000 sec |
2.010000 sec |
1147.490000 sec |
1147.490000 sec |
1147.490000 sec |
Misclassification Rate
|
|
11.1602% |
2.5799% |
1.4146% |
0.8298% |
1.1334% |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
 |
 |
Number of Classes
|
|
4 |
4 |
4 |
4 |
4 |
Segmentation Time
|
|
0.780000 sec |
0.360000 sec |
132.300000 sec |
132.300000 sec |
132.300000 sec |
Misclassification Rate
|
|
6.2495% |
8.3022% |
0.2518% |
0.0153% |
0.1984% |
Supervised
segmentation results on the test images from M. Mirmehdi
and M. Petrou
The following five images have been
used in the paper by M. Mirmehdi and M. Petrou: Segmentation of Color Textures, IEEE Transactions on Pattern Analysis and
Machine Intelligence, vol 22(2), pp. 142-159, Feb, 2000.
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
4 |
4 |
4 |
4 |
4 |
Segmentation Time
|
|
0.570000 sec |
0.230000 sec |
146.680000 sec |
146.680000 sec |
146.680000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
2 |
2 |
2 |
2 |
2 |
Segmentation Time
|
|
0.130000 sec |
0.050000 sec |
7.900000 sec |
7.900000 sec |
7.900000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
5 |
5 |
5 |
5 |
5 |
Segmentation Time
|
|
1.570000 sec |
0.210000 sec |
464.960000 sec |
464.960000 sec |
464.960000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
4 |
4 |
4 |
4 |
4 |
Segmentation Time
|
|
0.750000 sec |
0.410000 sec |
338.420000 sec |
338.420000 sec |
338.420000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
2 |
4 |
2 |
4 |
4 |
Segmentation Time
|
|
0.280000 sec |
0.400000 sec |
82.640000 sec |
82.640000 sec |
82.640000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
|
Original Image
|
Texture Segmentation
|
Color Segmnetation
|
Multi-layer Segmentation (texture layer)
|
Multi-layer Segmentation (color layer)
|
Multi-layer Segmentation (combined layer)
|
Image
|
 |
 |
 |
 |
|
 |
Number of Classes
|
|
2 |
2 |
2 |
2 |
2 |
Segmentation Time
|
|
0.820000 sec |
0.450000 sec |
156.230000 sec |
156.230000 sec |
156.230000 sec |
Misclassification Rate
|
|
NA |
NA |
NA |
NA |
NA |
Last modified: Fri Jan 25 19:44:47 CET 2008