I’m inclined to believe this is almost certainly not the reason.
For one thing, the odds of having a design team with no drivers in it are just pretty low. I work in tech, and in every design team I’ve ever been in I was the only non-driver. Most of the world is still too car-centric.
For a second thing, lots of good designers very often design for use cases which they themselves don’t share. You don’t have to be a pilot to design an aeroplane cockpit.