The springs on the Speed Silvers and Reds are nearly identical, from my experience.
The difference is the leaves in the switches, which actuate earlier on the Speed Silvers.

I would personally go with the Silent Pinks myself, but I prefer the lightest springs available.
The Silent Pinks are nearly identical to the Gateron Whites, in terms of spring weight, actuation distance and linearity.

That being said, a lot of people don't like having the lighter springs for the reasons you mention.
I actually find myself having the opposite problem, where heavier springs cause me to miss characters.
Quite often I push the buttons as hard as I think I should have to, then back off, without actuating the switches.