We have studied the effect of Ga ion irradiation on the controllable hysteretic behavior of graphene field effect transistors fabricated on Si/SO2 substrates. The various densities of defects in graphene were monitored by Raman spectrum. It was found that the Dirac point shifted to the positive gate voltage constantly, while the hysteretic behavior was enhanced first and then weakened, with the dose of ion irradiation increasing. By contrasting the trap charges density induced by dopant and the total density of effective trap charges, it demonstrated that adsorbate doping was not the decisive factor that induced the hysteretic behavior. The tunneling between the defect sites induced by ion irradiation was also an important cause for the hysteresis.