The whole series has been fun for me, and seems to be a very true representation of rally racing. Dirt is still very much a rally game, but it's not a pure rally game like the Colin McRae Rally games were, and the change really started with CMR 4 and 05 because the WRC license was lost, and going so far as to include the Nissan Dakar truck in CMR 05.
On that, there is more than the WRC that qualifies as rally racing, such as the Dakar and the Baja.
You're right in that. There is a lot more rally than just WRC. As you mention, Dakar, Baja, and to an extend Hill-climb. However, if they were still using the Colin McRae name I'd say they should keep it to stuff Colin was really into and leave out those he-entered-once events.
If the OP is still looking for a good rally game, here's the solution:
Not a car selection in the GT5 numbers, but quality over quantity (8 cars in total, Impreza '03, Impreza '00, 206, Xsara, Corolla, Evo VII, Hyundai, and one more that I've never unlocked myself)
In total 37 long, challenging stages with trees just outside the road (the shortest is 2.2km and the longets a little over 12km.)
More realistic damage, crashing and general physics than GT5 and almost any other racing game (believe me, almost anything on your car can break)
Season mode where you take part in 6 full rallies consisting of 6 stages with in total only 4 service breaks where you can repair and set up your car.
I'd give this game 9.5/10, it's slightly outdated (from 2004) but you can only see it on the car selection (but there's tons of mods with new cars out there) and the graphics are very good too.