It is ironic that speed boosters are the most dangerous thing out there, able to easily turn your ship around in a 180 degree angle and send you hurtling back down to earth regardless of your speed. To prevent this from happening, immediately press -down- to cut power once you graze a speed boost incorrectly, and wait for yourself to detach. You shouldn't be thrown around too much.