Autopilot Is A Flawed System: Keep Your Hands On the Wheel

With the rise of automated vehicles like the beloved Tesla, it’s very easy for drivers to take it as an excuse to slack off from behind the steering wheel. Manufacturer’s warnings to always pay attention to the road ahead is not a joke. Even when these systems are capable of relieving you from driving, for the most part, remember that had they been able to replace you completely, manufacturers wouldn’t have given you a steering wheel.

Imperfect

Advanced driver assistance system (ADAS) is no doubt one of the marvelous technological accomplishment in recent years. They not only protect us, but they can reduce significantly driving fatigue while on the road. But since we have yet reached the point where they’re completely fool-proof, and that we - creatures prone to mistakes - made them, don’t fully put you and your passengers’ lives in their hands just yet.

In an experiment conducted recently by Tencent’s Keen Security Lab, the reliability of Tesla’s Autopilot system is put to the test. They tried to trick the automatic lane-keeping system of the vehicle by using strips of reflective stickers. The experiment worked, and the car began to head off the correct course and instead followed the labels.

Tesla's Autopilot system at work, giving the driver the ability to have their hands off of the wheel

You shouldn’t jump the gun and condemn Tesla just yet. Instead, it is rather a problem with the security of common transportation infrastructure when that’s the thing Tesla’s Autopilot relies on to work. However, as long as the driver is aware, the mistake of the system can be corrected with no consequences.

In a statement made to Roadshow, a representative of Tesla spoke up about the test and its results. To protect the reputation of the system, they replied that the test deliberately misled the system through artificial conditions and that it is not a concern that real drivers should worry about. He also advised drivers to prepare themselves to override the Autopilot system when needed by taking control of the steering wheel and brakes. 

Common Problem

Of course, since they more or less work using the same principle, it wasn’t Tesla’s Autopilot that got confused. Cadillac’s Super Cruise system - which, according to consumers, is one of the best automatic driving system available for purchase at the moment - can be fooled by intense blasts of light.

Cadillac Super Cruise in action

Super Cruise has an infrared camera installed on the steering wheel to monitor for the driver’s attention. It allowed the car to drive on its own without inputs from the driver, but at the same time, ensuring that the driver’s attention wouldn’t stray too far from the road ahead.

But when the camera is hit with an intense beam of light - such as harsh sunlight, for example - it can be blinded. Super Cruise will then deactivate itself, entirely confused as to why it can no longer see the driver.

It’s not a new issue ever since the system was rolled out in 2018 it’s already been a known issue. Cadillac is reportedly working on a solution to fix this and will probably roll the patch out in the next iteration of Super Cruise.

The Caveat

So beware, if you own a vehicle, or is planning to own a car that’s equipped with systems the likes of Tesla’s Autopilot or Cadillac’s Super Cruise: Don’t stray too far from the road. The computers need you to monitor it, and when the rare errors did it occur, it’s up to you to immediately fix it. Without you, the consequence can be straight up fatal: And it wouldn’t be the first time.