Abstract: Matching Pursuits is an ideal method in very low bit rate video coding application for its larger, more flexible basis set. Energy-based block searching algorithm is used to reduce the complexity of its coding process. To better distinguish video frames with different motion features, an adaptive weighted energy searching algorithm is put forward in the paper, which uses adaptive weight value for different frames and gets ideal coding effects in most video sequences.