Definitely not on par with Rally Sim games like WRC. But the off-road physics in FH5 are as good as they have ever been in Forza.
I do like the rally races int he game, But not a fan of the track designs for Cross Country races, Though there are some good community made Cross country tracks in the Creative Hub.