Coherent control of complex many-body systems is critical to the development of useful quantum devices. Fast perfect state transfer can be exactly achieved through additional counterdiabatic fields. We show that the additional energetic overhead associated with implementing counterdiabatic driving can be reduced while still maintaining high target state fidelities. This is achieved by implementing control fields only during the impulse regime, as identified by the Kibble-Zurek mechanism. We demonstrate that this strategy successfully suppresses most of the defects that would be generated due to the finite driving time for two paradigmatic settings: the Landau-Zener model and the Ising model. For the latter case, we also investigate the performance of our impulse control scheme when restricted to more experimentally realistic local control fields.