Abstract: A video-based3D human body motion tracking system is developed under the optimization particle filter framework,which combines multiple cues in multiple cameras environment.By defining the3D body model,camera model and image likelihood model,we can define the tracking object function and resolve it using optimized particle filter.The experiments show that tracking and reconstructing results made by our system are accurate and effective.This system can be applied to several areas such as sporting motion analysis and human animation.