Abstract: The problem of color segmentation in color map images is studied and a new algorithm is presented in this paper．In this algorithm，we transform the image pixels from RGB color space to the Munsell space by a nonlinear transformation，then after studying the samples of color information，we proceed with segmentation．The characteristic of this algorithm is using the spatial interrelated information，which makes the processed images having better visual effect and reduces the amount of computation．