The rate of energy loss depends on the damping mechanism. Air resistance will be related to the velocity and will be a maximum when the velocity is a maximum. The following graphs show the effect.
Note: The graphs have been made by gently driving the motion to greater ampliudes by hand. The same effect is seen when the motion is damped by air resistance.