Abstract: A tracking non-rigid objects algorithm based on deformable template is presented in this paper. Two impovements of the original algorithm are proposed: 1) Decreasing influence of occlusion objects on motion objects via suitable prediction methods; 2) Tracking motion objects are restricted in local regions rather than in whole image through selecting suitable characteristic regions. The experiments show that the algorithm has advantages in precision and efficiency in motion tracking.