Google just filed a new patent application (PA) through Waymo that would enable a car’s autonomous driving system to take over, automatically, if it detects a bad driver behind the wheel. That’s right, if you or your aunt Bessie or little-Johnny-learner’s-permit sufficiently demonstrate that you suck at driving, the car could just assume control itself. We’ve all been behind bad drivers and wished someone would take the wheel for them, and this patent could do exactly that, which could be a boon to safety.
Of course, it could also be a complete nightmare.
First spotted by Motor1, Waymo actually filed this application back in May. It’s only now becoming public and the details are interesting. Waymo titles the invention as “using driving assistance to detect and address aberrant driver behavior.” First, it’s worth noting that, according to Google (the search engine, not the patent language itself), aberrant means “departing from an accepted standard.”
So this patent, in theory, could not just detect bad driving behavior but then it could “address” that behavior. Let’s sort out exactly what the language of the patent application tells us, why it could be a good thing, why it might be horrible, and why it might not matter at all.
Straight from the patent application:
“The technology relates to identifying and addressing aberrant driver behavior. Various driving operations may be evaluated over different time scales and driving distances. The system can detect driving errors and suboptimal maneuvering, which are evaluated by an onboard driver assistance system and compared against a model of expected driver behavior. The result of this comparison can be used to alert the driver or take immediate corrective driving action. It may also be used for real-time or offline training or sensor calibration purposes. The behavior model may be driver-specific, or may be a nominal driver model based on aggregated information from many drivers. These approaches can be employed with drivers of passenger vehicles, busses, cargo trucks, and other vehicles.”
To accomplish this very complex task, the system will go through a set of actions. First, it’ll track the actions of the driver and log that data. As it analyzes that data, it’ll look for what it determines is aberrant (though this isn’t defined in clear hard terms in the patent application), and, if applicable, “select an action from among one or more classes of actions in response.”
While the patent application doesn’t define exactly what it’ll consider aberrant, it does provide some hints. It likely won’t be a single act but several that break away from what it considers the standard model of driving behavior. In addition, it’ll judge based on things like how long one has been driving and how far they’ve gone.
Interestingly the application also mentions the controls the system could engage with, including braking, accelerating, steering, signaling, navigation, and communication systems. In fact, the car could in theory turn itself off if it determined there was reason to do so.
Just imagine sitting in traffic, maybe on your way to Kroger or wherever you go, and watching as a person makes a series of terrible driving decisions. Then, just as you’re losing your hope in humanity, the car pulls its own driver over, stops the car, and calls a relative to help them figure their life out. Who doesn’t want to see that? I know I do.
More likely, this system could in its own robotic way actually train drivers to improve their skills. Waymo even says as much in the filing. Speaking about the data collected from a bad driver, it says “This information may be stored … for instance to … provide training.” Of course, there is a potential downside here. Who is to say the system actually works as described and doesn’t present other problems?
[Editor’s Note: This all sounds similar to an approach to semi-automated driving that I’ve always called “reverse Level 2,” though there are other names, often things that suggest guardian angels or ghosts. It’s where the driver is in control, but the automated system is “watching,” essentially the reverse of Level 2 where the car has control but only under the constant supervision of the human in the driver’s seat. I’m not really sure how this is different, other than the process is laid out in detail. I’ve had conversations with Volvo AV people where they’ve told me this is an approach Volvo favors. – JT]
What happens if someone is trying to rush a loved one to the hospital? What if you’re trying to avoid creepy dudes? In theory, the car has no idea what is going on and could impede the journey. How will it manage things like road construction where road signs and road markings are far from perfect or uniform?
Further, consider just how much data we’re talking about here. People were up in arms when they realized that firms like LexisNexis were tracking their every maneuver, brake engagement, and hard acceleration. How will they feel if cars are not just tracking these things, but actively changing the way they drive? Will this data even be secure? Will this data even be secure? Examples of large, seemingly secure holders of personal data suffering breaches are hardly hard to come by.
Finally, it’s worth saying that as of this writing, this is just a patent application. The USPTO hasn’t granted the patent to Waymo. Even if that time does come, there’s no guarantee that Waymo will use it in public-facing vehicles. Some patents are obtained simply so that the owner can stow the tech away from the light of day.
If fully autonomous driving for all becomes a reality, it would seem that the days of complete car control are limited regardless of this new proposed tech. Frankly, I’m all for taking the wheel out of the hands of negligent and disinterested drivers. Let those of us that care to try and suck less at driving do it ourselves. Let everyone else nap on their way to Kroger.
Topshot base image: Andrey Popov/stock.adobe.com
I hate drunk drivers, etc etc etc…
(They can keep using their breathalyzer equipment in their cars but not force it on everyone like they’re trying to)
…but I also hate all this new BS trying to control the car/driver
I just want to fucking drive my own car w/o anyone or anything controlling or stopping me!
Just STOP w/ all this shit…
I…just…want…to…enjoy…driving
Oh hell no!
No thank you. Finally owning a vehicle with lane keep assist has made me realize how often I deliberately do things that driving nannies don’t like, most notably crossing painted lines in construction zones. If you have a system so good that it can accurately detect bad driving then you have a level 5 AV anyway and don’t need the human to drive. If you’re not at that level then you have no business taking control of the car away from me.
911: “9-1-1, what’s your emergency?”
Me: “Help! I am being pursued by hostile criminals and my car won’t let me drive away!”
We know this idea works. Tons of apps out there already help us monitor our actions and coach us to stand up more, drink more water, eat better foods, be more active, wear ear protection, the list goes on. The mistake of course is that manufacturers and tech companies jumped ahead to self-driving cars, giving people the green light to leave their brains at home every time they get into their cars and very few of those people are going to give that up willingly if they now have to learn to drive all over again.
The real solution, as we all know, is reliable and accessible public transportation.
I love public transportation and think we should funnel bazillions into improving it in the US. But it’s not “the real solution.” It’s “part of the solution.” There will always been some kind of individual vehicles on the road and we should be continually focused on improving their safety and efficiency (while also lobbying to bring back the electric street trolley!).
*goes to a trackday* *google decides you suck at driving and slams the brakes and “behaves”* *3 cars swerve to avoid the “safe” driving AI slamming on the brakes at 120 on the straightaway.*
Yeah, I can see this going to crap pretty quickly.
Wow, this is scary. There’s a stretch of I81S near me (mm146-137) that’s been under construction for some time and is full of old road markings, pavement elevation-changes, and jukin’ & jivin’ between Jersey barriers and narrow bridges that I’m fairly confident would prompt any overseer system to flag even the most competent driver.
No one wants to surrender their keys, but I will do so when loved ones insist it is time. Loved ones; not algorithms. They can go suck a terabyte
If I’m reading your stretch of 81 correctly… my lane keep assist tried to follow the old markings going north past Exit 143 the other day into the left lane. Took me a little by surprise, so yeah – that stretch has already flagged (at least what I consider) a competent driver.
From your username, you’re a Hokie, I take it? Big WUVT fan here.
Yeah: I forgot about the north side as that’s been done for a bit
F google in the ear with an icepick.
Use one long enough so you can skewer zuck and musk too.
Great. Now Google is trying to replace my wife.
There are hookup and porn apps for that.
In 10 years the most popular Altima modification will be removing this
The sensors won’t work though cracked glass, tape holding the bumper on or with the side mirrors busted so the system will automatically be disabled by the most popular Altima mods. No extra work required.
Watch, thei’d add a system where if any if the sensors are bad, the car won’t move.
Plus the vehicle would need more than 3 wheels attached and not be on fire for the system to work correctly.
doughnut spare counts though, right? as long as it’s at half pressure and incorrectly torqued on?
Thank you for calling this a patent application, not a patent like so many other publications often do. The pedantic attorney in me appreciates it. I’ll also note that this application is actually a continuation application from a parent application, which is granted. See, https://patents.google.com/patent/US12005906B2.
Also, “Some patents are obtained simply so that the owner can stow the tech away from the light of day.”
I see what you’re trying to say, but by law all patent applications become public knowledge and accessible from the patent office website. Hardly away from the light of day. What an applicant is often actually trying to do is prevent others from practicing their invention, not hiding the invention from others.
As to the substance of the article, I could see this being implemented by, say, a driving school, or perhaps activated on an elderly person’s car by a concerned relative. Marketing this as a feature to the average rank and file driver would probably actively turn people away from that model/make, at least for the examples you mention, but also because muh freedums.
Agreed on the article calling it an application – though the title calls it a patent.
Instead of getting angry, I like it when companies patent stuff that we might consider stupid or features no one would ever want. A patent gives them the right to exclude others from doing it, so that would mean other companies COULDN’T do the thing that is so awful in the patent.
Exactly what I was thinking. Google has a very long history of trying something out, realizing they don’t make enough money on it, and then throwing it away. (See, e.g., Hangouts, Podcasts, Chromecast, etc.). Then they are left holding the rights to the idea for 20 years, preventing others from legally using it, unless they sell the patent (assuming it is granted, which, since it is a CON, is likely it will be in one form or another).
Thanks again to nathan myhrvold