What is the chance that the switch plungers were binding on the switch cover? When you tested the switch while disassembled the bind was gone. Now that you put it back together, there still is no bind. Perhaps the second push was necessary to really break a partial contact caused by the first push. Maybe the partial contact let a partial voltage flow which gave the slower speed.
