Two measurement techniques are investigated to characterize photodetector linearity.A model for the two-tone and three-tone photodetector systems is developed to thoroughly investigate the influences of setup components on the measurement results.We demonstrate that small bias shifts from the quadrature point of the modulator will induce deviation into measurement results of the two-tone system,and the simulation results correspond well to experimental and calculation results.