Driver aids are there to make driving easier and avoid accidents.
Without driving aids there is more challenge for the driver, but also more control (since the aids do not correct the input).
More control allows you to go faster, if you have the ability to do so.
Example:
Traction Control System:
- On it will limit the power to the wheels when you are slipping to avoid losing control.
- Off you will have to limit the power yourself, you are able to slip a little if you believe this is faster.
obviously if you do not control the power well, driving aids off might be slower for you.