Deep Learning in country-specific, real road traffic plays a central role on the road to autonomous driving. This is shown by Mercedes-Benz Intelligent World Drive, which ended at the CES in Las Vegas after five months.
A test vehicle on the basis of the current S‑C lass completed a challenging study trip on five continents in order to “learn” in automated test drives in real traffic. From zebra crossings on Chinese motorways, turning off right from the left-hand lane in Melbourne, Australia, pedestrian traffic on all kinds of roads in South Africa or a temporary driving ban in the immediate vicinity of stopping school buses in the USA – on every continent the S‑Class faced challenges which will have an influence on the driving characteristics of future autonomous vehicles.
The Intelligent World Drive also underlines just how important the international harmonization of the legal framework for automated and autonomous driving and its infrastructure is, in particular of lane markings and traffic signs.
With the test vehicle on the basis of a semi-automated S‑Class test drives were carried out in Germany, China, Australia, South Africa and the USA. The differences in the countries give a small insight into the complexity of global challenges in the development of automated and autonomous driving functions. In particular the national particularities in terms of infrastructure, traffic regulations and the conduct of other road users place very different requirements on the sensors and algorithms of the vehicle. It also becomes apparent just how important high-resolution maps could become for the development of higher automation. Daimler AG is thus involved in the map service HERE and is working on faster implementation and updating of even more precise navigation data.
When it comes to traffic signs for speed limits alone there are many different variants. In the USA, for example, their shape and size are fundamentally different from the usual round metal signs in Europe and China. In Australia, electronic displays with variable speed limits are used. Special displays indicate the current speed limit. They are equipped with bright white LEDs, a red LED ring and a yellow LED warning lamp and can also depict simple symbols and letters as well as speed limits. In some cases they are positioned next to one another and can change their display within a short time. This demands more of, for instance, the Multi Purpose Camera (MPC) and the quality of digital maps. Speed limits or even data which only apply at certain times of day are equally as challenging.
A prime example of country-specific traffic signs and rules is the “Hook Turn” sign in Melbourne city centre. It controls the procedure of turning off from roads which are also used by trams. If you want to turn off right over the tram tracks in this country with left-side traffic you have to move to the outer left lane and first let the traffic straight ahead and the tram pass before you are allowed to turn off right. The junction can only be crossed if your own traffic light is on red and that of the cross traffic switches to green. The sensors and algorithms of an automated and autonomous vehicle must be in a position to detect the “Hook Turn” sign, to comprehend the context of the complex turning procedure and take other road users into account.
Road and lane markings are not standardised around the world either. In China, for example, the zebra crossing has a double meaning. In the city it marks a pedestrian crossing, on the motorway, on the other hand, it shows the minimum distance between vehicles driving behind one another. On multi-lane Interstates and Freeways in the USA there are often dedicated lanes for car pools of at least two people. They can be separated from the other lanes by two uninterrupted yellow lines or by metal guard rails. It can be difficult for the vehicle sensors to detect and correctly interpret them as special lanes.
In the USA there are also what are known as Botts’ Dots. These dots for lane marking are plastic or ceramic and also put special demands on lane detection. California is thus the first federal state planning to abolish the Botts’ Dots and to standardise the lane markings for future autonomous driving.
What makes things more difficult is the fact that in some countries signs and lane markings are sometimes missing. So even for experienced drivers it is difficult at mega junctions and on multi-lane roundabouts in the Chinese metropolis of Shanghai to select the correct lane for turning off. In South Africa missing stop or warning signs in front of speed bumps pose challenges when it comes to the performance of sensors and the quality of digital map data.
Equally challenging for vehicle intelligence is pedestrian conduct in South Africa, which bears no resemblance to that in Europe, Australia or the USA. Not only are there many more pedestrians about here, they also frequently walk on the road itself and sometimes unexpectedly cross the carriageway. Future systems must reliably detect such pedestrians even at higher road speeds and interpret their movement correctly.
Overtaking manoeuvres on single-lane roads are the norm in South Africa, with the slower vehicle driving on the hard shoulder and the overtaking vehicle driving past it at clear points in spite of the broken line. Future vehicles must learn to use this tolerance depending on the situation. To do this they would have to be able to tell whether the road is free and clear enough for overtaking – or whether an overtaking manoeuvre is too dangerous due to bends or oncoming traffic. It goes without saying that appropriate infrastructure measures help to facilitate faster and more extensive autonomous driving.
For example, where the danger of wild animals crossing is concerned kangaroos in Australia and springboks in South Africa represent a particular challenge. Depending on their posture they have a different shape and are therefore very difficult to identify definitively. According to statistics from an Australian insurance company, kangaroos cause nine out of ten road accidents in which animals are involved nationally.