A novel fast sub-pixel search algorithm is proposed to accelerate sub-pixel search. Based on the features of predicted motion vector (PMV) and texture direction observed, the proposed method effectively filters out impossible points and thus decreases 11 searched points in average during the sub-pixel search stage. A threshold is also adopted to early terminate the sub-pixel search. Simulation results show that the proposed method can achieve up to 4.8 times faster than full sub-pixel motion search scheme (FSPS) with less than 0.025 dB PSNR losses and 2.2% bitlength increases.