Abstract: The latest research developments at home and abroad on constructing 3D conceptual models based on gesture are summarized. The gesture-based human-computer interaction and its key technologies are also discussed. At last, future directions of the research are presented.