Abstract: A new method for extracting line segments, using the principle of perceptual organization is presented. Its two distinctive features are proposing a new elementary line segment extraction algorithm by utilizing template and taking into account both traits of the lines and the objects'shape during performing line segment grouping. Experiments verified its effectiveness for building recognition in high-resolution remote sensing images.