Having been doing such pattern recognition exercises for fifty years a realistic view is that current modern deep learning technology can achieve level 5 autonomous driving is a fools errand. The vehicle, each vehicle, needs to interact with the person, each person, intelligently. There is ONLY one way to do that and that is with human natural language. So when the autonomous system needs to ask for help it can, and when the person is concerned he can ask for explanation and direct the reasoning of the autonomous system.
For example, if the weather is getting very bad outside, the autonomous system may say "<your name because it knows who is in the car>, the weather is looking bad, I'm slowing down and will stop if you cannot take over. Can you take over?" or "<your name>, I am contacting your mother to tell her I have to slow down and probably stop because the weather road conditions are getting too dangerous for me to continue driving. Do you want to talk to her to?"
or "I am going to get into a leader line with a leader vehicle that can take us through the next two miles because of the construction, or I can just let you drive it, <your name> which do you prefer?"
The list is very long.
There is ONLY one way to get level 5 and that is through natural language dialogue. That is what the science says. It is the only way two minds can communicate fluidly: using the evolution of human natural language fully.
This is possible, but the stupid engineers they do not think they need it and it is too hard, and they are wrong.
They need the vehicles to understand and communicate the ways humans do so humans can be a part of the transportation solution when they need to be. Otherwise we will have to become the automata and suffer the consequences.
Simple as that.
If you want a deep understanding of what we know how to do and what we do not know how to do, a good book is Terry Sejnowski's "The Deep Learning Revolution." But the best targeted information comes from the computational cognitive neuroscience of lies which explores how one uniquely human brain communicates best with any other (even a proxy one). And there are deadly consequences to getting that wrong.
Without dialogue, the vehicle will necessarily be producing fiat lies at certain times, and ...