Fast is fast. You're either fast or you're not fast. If your driving style is making you not fast, but you enjoy it, then don't worry about being fast.
to be honest I think drifting with the ds3 is easier as you can react much faster... I think I got higher scores when playing with the ds3 even though I enjoy drifting with a wheel much more