Abstract: In order to overcome the limitation of Gauss mixture model （GMM）,this article uses the Gibbs theory and the image structure information to construct anisotropic Gibbs random field incorporated into the GMM.The new GMM can reduce the effect of the noise and contain the information of beam structure regions and corner regions.Experiments on the segmentation of brain magnetic resonance images show that better effect in image segmentation can be achieved by the model.