Abstract: This paper introduces an image-sequence-based interactive 3D modeling system. Given an uncalibrated image sequence or a video, the system can automatically recover the camera motion parameters. After simply drawing strokes or curves along the shape of the scene object on a few frames, the system can analyze the user interactions and help making the correspondences among multiple frames. Then 3D models of the objects in the images can be accurately reconstructed. This system provides reconstruction tools for modeling primitives of points, lines, planes, curves and surfaces, etc. It can meet the requirements of rapidly reconstructing realistic 3D models for real-world complex scenes. Several real-world examples are presented to demonstrate the effectiveness and usefulness of the proposed system.