Abstract: Video segmentation consists of three phases： Motion region identification，motion edge extraction and contour linkage．New algorithms for contour linkage are proposed to track the object’s motion edges as well as detect the disappearance of existing edges of the object in the scene．The proposed method is implemented on a 500MHz Pentium III PC，and the system runs on video streams with a frame size of 320×240pixels captured by a USB video camera．The process of capturing，video segmentation and result showing can reach the speed of 15Hz， which meets the requirement of real-time process．