The Biggest Challenges on the Road to Self-Driving Cars
Autonomous Driving

The Biggest Challenges on the Road to Self-Driving Cars

9 Min. · Published: Jul 12, 2026

Why Fully Autonomous Driving Is Still Years Away

Few topics in the auto industry get hyped as hard as self-driving cars. Robotaxis cruise through San Francisco and Phoenix, automakers throw around terms like "Full Self-Driving," and analysts value the driverless mobility market at hundreds of billions of dollars. Read the headlines and you could easily believe the self-driving car has already arrived. In reality, the gap between marketing language and the actual state of the technology is still enormous.

For anyone who drives an EV today, this isn't just an academic debate. Assistance features like lane-keeping and adaptive cruise control are already standard on many new cars, Level 3 systems such as Mercedes Drive Pilot exist only on a handful of models, and the next steps in this progression will directly shape how, where, and when we charge, park, and travel. Before looking at where the technology is headed, it helps to understand why the final leap to true autonomy is so much harder than everything that came before it. The SAE levels of autonomous driving describe a tidy staircase from Level 0 to Level 5, but between the upper rungs sit technical and legal gaps that can't be closed simply by throwing more training data or faster chips at the problem.

That gap is exactly what Business Insider's documentary series "The Limit" set out to document: test rides in autonomous vehicles, a visit to Waymo's operations yard in San Francisco, and interviews with safety engineers and safety advocates all paint a sober picture of where things actually stand. Below, we break down the key takeaways and put them in context for drivers outside the US as well.

Source: Business Insider: Why Fully Self-Driving Cars Are Almost Impossible | The Limit

The Scaling Problem: From Robotaxi to Mass-Market Car

The Biggest Challenges on the Road to Self-Driving Cars
Billions in investment, robotaxi fleets in US cities, bold promises from automakers, yet no car on the road to

The first major hurdle sounds almost too simple: scaling. A robotaxi fleet like Waymo's isn't "made autonomous" and then sent out to drive anywhere. Instead, every single city is meticulously mapped in advance, every intersection, every traffic-light sequence, every local quirk, before vehicles are allowed to operate there without a safety driver. The result is a system that works extremely well within one city but doesn't automatically transfer to the next one. For Waymo, just preparing a new operating area can take several years of safety-driver test miles before driverless operation is even on the table.

Personal Cars Need to Work Everywhere

A privately owned self-driving car doesn't get that luxury of pre-mapping every rural road, roundabout, or construction zone it might encounter. It has to work in essentially any environment straight out of the factory, from a gravel backroad to a dense downtown grid to a high-speed interstate. That leap from "works in one mapped city" to "works everywhere" is a big reason why automakers such as Tesla, BMW, and Mercedes still stick to driver-assistance features, while specialized robotaxi operators bet on narrow, carefully defined service areas instead. How far along individual automakers actually are differs significantly, as becomes obvious once you compare their current production lineups side by side: some already offer certified Level 3 functions, while others remain squarely in classic driver-assistance territory.

The Sensor Debate: Cameras, Radar, and LiDAR

A second, deeply technical hurdle is the question of which sensors a car should even use to perceive its surroundings in the first place. Tesla has committed to a camera-only approach and deliberately skips LiDAR, largely for cost and scaling reasons. Other companies, including Waymo, combine cameras with radar and LiDAR to build in redundant sources of information.

Physical Limits, Not a Software Problem

The core issue: camera-only systems run into physical limits in fog, heavy rain, or glare that no amount of better software can fix. A camera simply stops "seeing" once visibility is genuinely degraded, no matter how capable the AI behind it is. LiDAR and radar provide extra, more weather-resistant data in exactly those situations. We break down how the different sensor types work together in our guide to LiDAR, radar, and cameras. How Tesla actually markets its camera-only promise, and which features are genuinely unlocked at any given time, becomes clearest by tracking the company's regular software updates, since new capabilities tend to roll out gradually rather than all at once.

This sensor debate is more than a technical footnote: it directly affects whether a system would be reliable enough for approval in regions with frequent fog, heavy rain, or snow, conditions that put camera-only setups under real stress.

The Long Tail: When Rare Situations Become the Big Problem

The Biggest Challenges on the Road to Self-Driving Cars
Billions in investment, robotaxi fleets in US cities, bold promises from automakers, yet no car on the road to

Another central finding of the reporting concerns the so-called "long tail" of rare edge cases. These are situations that almost never come up in everyday traffic but are precisely for that reason extremely hard to train a system for:

These cases only become statistically visible after millions of miles driven, which makes testing extremely slow and expensive. One especially telling real-world example: driverless vehicles have repeatedly struggled to correctly interpret fire trucks and other emergency vehicles on the road, particularly when they stop in unusual spots or when a firefighter gives hand signals that fall outside typical patterns. Edge cases like these show just how heavily a self-driving system depends on machine learning trained on massive amounts of data. We cover how that learning process actually works in our guide on how AI learns to drive.

Regulation and the Gap Between Marketing and Reality

Beyond the technology itself, regulation is slowing progress too. To date, no company anywhere in the world holds full approval to operate genuinely driverless vehicles across an entire public road network. Approvals are almost always limited to specific regions, specific routes, or specific weather conditions. In Germany, with its dense framework of traffic law, liability rules, and vehicle type-approval requirements, this process is even more complex, as detailed in our guide to robotaxi laws in Germany and Europe.

Promises vs. Actual System Limits

That regulatory reality feeds directly into the gap the reporting highlights between marketing and what these systems can actually do: current systems still require human oversight or occasional intervention, which sits in clear tension with the full-autonomy promises made by many automakers. Terms like "Autopilot" or "Full Self-Driving" imply more capability than these systems are technically and legally allowed to deliver. The distinction between driver-assistance systems (ADAS) and true autonomy matters enormously here: ADAS merely supports the human behind the wheel, while true autonomy would take over the driving task, and the legal responsibility that comes with it, entirely, including everything that follows in the event of a crash.

What This Means for the Road Ahead

Despite all these hurdles, progress hasn't stalled, it's just moving slower and more unevenly than announcements often suggest. In Germany, for example, certain vehicles are now allowed to operate under tightly defined Level 3 conditions, such as on highways at speeds up to roughly 60 mph (95 km/h). That's real progress, but it's still far removed from true Level 5 autonomy without any restrictions at all. There's no firm timeline for genuine Level 5 driving: credible forecasts range from the early 2030s to well past mid-century, depending on how quickly sensor technology, regulation, and the industry's handling of the long tail of edge cases all evolve.

The Direct Link to Charging Infrastructure

For anyone focused on EV charging, one piece of this story stands out: autonomous vehicles will, in time, also charge themselves autonomously. Early concepts already show vehicles navigating to the nearest available charger on their own, docking, and driving off again once charging finishes, with no human involved at any point. For robotaxi fleets that operate almost around the clock, dense and reliable charging infrastructure becomes a basic requirement for running a profitable business, since every minute spent waiting at a broken or occupied charger is lost revenue. If you're looking to get up to speed on charging basics, our EV fast charging guide is a good starting point.

Internationally, there's also a clear race underway: the US is pushing ahead with robotaxi operations in cities like San Francisco and Phoenix, China is catching up fast with its own domestic players, while Europe is moving far more cautiously on the regulatory front. These different speeds could ultimately determine where autonomous mobility becomes part of everyday life first, while countries like Germany tend to favor incremental approvals and strict safety standards over rapid rollout.

For drivers today, the practical takeaway is this: fully autonomous personal cars with no restrictions at all remain unlikely for the next several years. A more realistic path is a gradual expansion of assistance features, limited robotaxi pilot programs in individual cities, and a growing overlap between autonomous technology and charging infrastructure that's already being built out today. If you want to track real progress rather than marketing claims, watch three concrete indicators instead: expanding robotaxi service areas, new regulatory approvals, and measurably falling rates of safety-driver intervention.

Additional Video

While the first video breaks down the technical hurdles of full self-driving, this CNBC explainer widens the lens to the business, regulatory, and safety-validation obstacles that have kept fully autonomous cars off mainstream roads for so long.

Source: CNBC – Why Don't We Have Self-Driving Cars Yet?

Frequently Asked Questions

Why are robotaxis further along than personal self-driving cars?

Robotaxis only operate in city areas that have been meticulously pre-mapped, while a personal car has to work everywhere right out of the factory. That kind of universal capability is far harder to achieve than performing well within one narrow, mapped service area.

Why does Tesla skip LiDAR sensors?

Tesla has deliberately chosen a camera-only system to keep costs down and rely on visual data alone. Critics point out that cameras hit physical limits in fog or poor visibility that software improvements alone can't overcome.

Are there any fully self-driving cars on public roads today?

No. In Germany, for instance, only limited Level 3 systems are approved under strict conditions, such as on highways at speeds up to about 60 mph (95 km/h). Nowhere in the world do fully driverless vehicles yet operate across an entire public road network without restrictions.

What does self-driving technology have to do with EV charging?

Autonomous robotaxi fleets run almost continuously, so they depend on especially reliable charging infrastructure. Automakers are also working on vehicles that can drive themselves to the nearest available charger and plug in without any human involved.

Newsletter
New Charging Stations & EV Tips
No spam. Unsubscribe anytime.