Creating the vast digital roadmap will be a living, ongoing process.
How do you create a map showing every road in the United States, with the precise location of every stop sign, all the lane markings, every exit ramp and every traffic light — and update it in real time as traffic is rerouted around construction and accidents?
That’s a challenge that automakers and technology companies are confronting in their race to develop self-driving cars, the kind that someday will let you sit back and read or watch TV on the way to work each morning.
The need for highly detailed, three-dimensional, computerized maps — which pinpoint a car’s location and understand its surroundings — is often overlooked amid all the hype about autonomous vehicles. The chatter tends to focus more on the various sensors that enable cars to “see” the road and any obstacles in front of them. Those sensors include radar, cameras and a laser-based kind of radar known as lidar.
But digital maps are an equally critical piece of the puzzle.
“If we want to have autonomous cars everywhere, we have to have digital maps everywhere,” says Amnon Shashua, chief technology officer at Mobileye, an Israeli company that makes advanced vision systems for automobiles.
Creating them, however, is a monumental task. There are more than 4 million miles of roads in the United States. And compared with the maps used by GPS and navigation systems, the level of precision must be much greater. Navigational maps typically locate a car’s position within several yards. Digital maps for autonomous cars must know the locations of cars, curbs and other objects within about 4 inches.
So far the drive to create digital maps has been slow. Google’s former self-driving car division — now a company called Waymo — has created maps for roads around its headquarters in Mountain View, California, and a handful of other cities, including Austin, Texas, and Kirkland, Washington.
Waymo creates the maps by driving around cars equipped with spinning lidar units mounted on their roofs that shoot out laser beams, creating images of the road and the surroundings.
Human engineers, in a time-consuming process, then go over the images and tag the objects that are found, like stop signs, buildings, stoplights and do-not-enter signs. The laser equipment needed to do this scanning is expensive — it can cost $100,000 or more to outfit just one car to do this job.
Another company, Here, which was started by Nokia and then acquired by the German automakers BMW, Daimler and Audi, is also mapping roads in the United States and Europe. It is drawing on data scooped up by scanning systems that trucking companies have agreed to install on their vehicles. Here also has its own fleet of cars collecting images, and is working on algorithms to enable computers to annotate the maps.
The effort may soon shift into higher gear, thanks to an idea borrowed from the internet that has helped in other fields: crowdsourcing.
Mobileye supplies front-facing camera systems that enable cars to detect obstacles and brake to prevent or mitigate collisions. Starting with 2018 models, both Volkswagen and BMW will outfit their vehicles with Mobileye systems that can also transmit their precise locations and images of the roads they are traveling, which can be synthesized into one giant digital map.
Shashua says his company expected to sign on many other automakers to do the same.
“You can leverage the fact that you will have millions of cars with cameras — almost all the new cars that hit the road,” he says. “This is a force multiplier.”
Others are thinking along the same lines. A technology startup called Civil Maps is trying to develop its own image-vacuuming device and hopes to persuade automakers to install it in cars and trucks. The company is also working on artificial intelligence that it hopes will automate the annotating of maps — the other big technological challenge. Its work has attracted an investment from Ford Motor.
“For full autonomy, we believe we need to have a high-definition map of the area we’ve been operating in, a map annotated with what are the permanent fixed objects in that area,” says Raj Nair, the global product development chief at Ford, which has vowed to begin producing a fully autonomous car — with no steering wheel and no pedals — by 2021.
The reason digital maps are so important is that even the most advanced sensors, like radar and cameras, are not enough to enable a car to navigate a chaotic and changing world safely enough to allow occupants to lean back and take a snooze.
Digital maps ease the burden by helping give foresight to a car’s computers, and adding redundancy to the car’s understanding of the situation it faces, says Civil Maps’ chief executive, Sravan Puttagunta. Radar and cameras cannot always recognize a stop sign if pedestrians are standing in the way or the sign has been knocked down, he says.
“But if the map knows there is a stop sign ahead, then the sensors just need to confirm it,” Puttagunta says. “Then the load on the sensors and processor is much lower.”