Abstract: This paper proposes a novel algorithm,namely moving shadow elimination based on color and gradient features （MSECG）,to detect moving shadow after the foreground detection by combining color with gradient features.In addition,a new quantitative metric F is introduced to assess the detection performance.Experimental results show that our algorithm could achieve a better performance than the benchmark method on outdoor video sequences.