This is true, but I think the bigger deal is that some people actually like driving (maybe not the trafficky daily commute). Some speeders fit this category, but also others who just like being precise on the curves, being in the flow of an uncrowded road, and even expressing their neighborliness to others.

So far, self driving cars drive very clumsily even when they are safe. More scope for embarrassment and frustration than anything else if you identify with the behavior of your car. "Chill mode" for example, chooses the right of a four lane road until the last minute instead of making lane changes when space allows. Awful.

But even if the cars get better at it, some people will miss driving.