Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Remote-control for highly automated vehicles

11.10.2018

At NVIDIA’s GPU Technology Conference (GTC) from October 9th – 11th, 2018 in Munich, Fraunhofer FOKUS researchers will demonstrate on the outdoor exhibition grounds how they can control a vehicle tele-operatively with minimal latency. That helps to bridge the gap from driver-controlled to fully autonomous vehicles. In addition, they will present their semi-automated tool for processing image data from Lidar laser scanners and cameras for training the artificial intelligence (AI) of smart cars.

There will be near-future situations, in which highly automated and autonomous vehicles will also utilize a remote human operator. For example, a truck that can’t drive autonomously from the company premises to a loading ramp because it has no access to digital maps of the private property.


Remote-control for highly automated vehicles

Fraunhofer FOKUS

Or an autonomous car that must navigate an unforeseen construction zone. At GTC Europe, the FOKUS researchers from the business unit Smart Mobility together with the Daimler Center for Automotive IT Innovations (DCAITI) at the TU Berlin, will demonstrate how tele-operated driving with low latency can be achieved to help smooth the path to full-autonomy.

The operator, in this case a person running the demonstration, is connected to the highly automated vehicle by means of wireless data and encrypted transmission – via WLAN and in the future via 5G mobile radio. The vehicle is steered with high efficiency by means of its own compressed environment model.

This model interprets image data from up to eight cameras in combination with Lidar laser scanners. The NVIDIA DRIVE platform provides the computing power to run the diverse and redundant algorithms and applications to enable safe highly automated driving. Significantly reduced meta data is then transmitted to the operator. This saves bandwidth and provides near real-time intelligence of the current situation.

The operator can control the vehicle realistically, with a steering wheel and accelerator, or brake pedal. A map with the current route is viewed on a second monitor. The decisive factor for safe tele-operation is that the data transmission of both the environmental data and the control signals produce as little delay as possible.

Tool for semi-automatic annotation of image data

AI is of great importance for the perception of the immediate surroundings by the vehicle. When a highly automated vehicle drives on the road, a large number of cameras and other sensors, such as a Lidar, record information from the surroundings. The data must be analyzed in real time and reliably detecting pedestrians, bicyclists, vehicles and other objects in the scene.

With new AI methods, particularly deep learning, the computer learns what a human or a tree looks like by training on a huge amount of data. The better the learning data is, the more accurately the car will learn to "see". Until now, it was very time-consuming to label the training data, i.e. to mark what a tree, a person, or a car is.

At GTC Europe, Smart Mobility researchers will present their labeling tool for image data from cameras and Lidar laser scanners, powered by the NVIDIA DGX-1 AI supercomputer datacenter solution. With this tool, the annotations can be pre-labeled, checked and corrected in the shortest possible time. Labeling experts will need on average only 10% of the time that is normally required to generate high quality learning data.

With the help of FOKUS' innovative AI algorithms, image data from cameras and laser scanners are divided into object classes such as roadway, vehicle, pedestrian, and individual elements of the objects are separated from each other. In this way, even pedestrians in a crowd can be kept apart. For each object, the algorithms continue to calculate the correct position and rotation in 3D space.

FOKUS’ mobility-data-backend manages the sensor data of hundreds of vehicles and enables labeling experts and developers worldwide to view and correct the data in a standard web browser. This results in an ever-larger pool of high-quality learning data for AI algorithms in the vehicle.

Further information:
Session at the GTC on Thursday, October 11, 11:00-11:50, room 14c: Deep Learning software applications for Autonomous Vehicles with Dr. Ilja Radusch, head of the business unit Smart Mobility
https://2018gtceurope.smarteventscloud.com/connect/search.ww#loadSearch-searchPh...=

About the GPU Technology Conference:
https://www.nvidia.com/en-eu/gtc/

Press contact:
Fraunhofer Institute for Open Communication Systems FOKUS
Mitra Motakef-Tratar
Corporate Communications
Telephone: +49 30 3463-7517
mitra.motakef-tratar@fokus.fraunhofer.de

A High-resolution photo is available on request: presse@fokus.fraunhofer.de.


Fraunhofer FOKUS
Fraunhofer FOKUS researches digital transformation and its impact on society, economics and technology. Since 1988 it supports commercial enterprises and public administration in the shaping and implementation of the digital transformation. For this purpose, Fraunhofer FOKUS offers research services ranging from requirements analysis to consulting, feasibility studies, technology development right up to prototypes and pilots in the business segments Digital Public Services, Future Applications and Media, Quality Engineering, Smart Mobility, Software-based Networks, Networked Security, Visual Computing und Analytics. With about 430 employees in Berlin and an annual budget of 30 million euros, Fraunhofer FOKUS is the largest ICT institute of the Fraunhofer Society. Around 70% of its budget is generated through projects from industry and the public domain.

Christiane Peters | idw - Informationsdienst Wissenschaft

More articles from Information Technology:

nachricht Man versus machine: Can AI do science?
14.01.2020 | Okinawa Institute of Science and Technology (OIST) Graduate University

nachricht Beyond 5G lab: Communication technology of the future
13.01.2020 | Friedrich-Alexander-Universität Erlangen-Nürnberg

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Miniature double glazing: Material developed which is heat-insulating and heat-conducting at the same time

Styrofoam or copper - both materials have very different properties with regard to their ability to conduct heat. Scientists at the Max Planck Institute for Polymer Research (MPI-P) in Mainz and the University of Bayreuth have now jointly developed and characterized a novel, extremely thin and transparent material that has different thermal conduction properties depending on the direction. While it can conduct heat extremely well in one direction, it shows good thermal insulation in the other direction.

Thermal insulation and thermal conduction play a crucial role in our everyday lives - from computer processors, where it is important to dissipate heat as...

Im Focus: Fraunhofer IAF establishes an application laboratory for quantum sensors

In order to advance the transfer of research developments from the field of quantum sensor technology into industrial applications, an application laboratory is being established at Fraunhofer IAF. This will enable interested companies and especially regional SMEs and start-ups to evaluate the innovation potential of quantum sensors for their specific requirements. Both the state of Baden-Württemberg and the Fraunhofer-Gesellschaft are supporting the four-year project with one million euros each.

The application laboratory is being set up as part of the Fraunhofer lighthouse project »QMag«, short for quantum magnetometry. In this project, researchers...

Im Focus: How Cells Assemble Their Skeleton

Researchers study the formation of microtubules

Microtubules, filamentous structures within the cell, are required for many important processes, including cell division and intracellular transport. A...

Im Focus: World Premiere in Zurich: Machine keeps human livers alive for one week outside of the body

Researchers from the University Hospital Zurich, ETH Zurich, Wyss Zurich and the University of Zurich have developed a machine that repairs injured human livers and keep them alive outside the body for one week. This breakthrough may increase the number of available organs for transplantation saving many lives of patients with severe liver diseases or cancer.

Until now, livers could be stored safely outside the body for only a few hours. With the novel perfusion technology, livers - and even injured livers - can now...

Im Focus: SuperTIGER on its second prowl -- 130,000 feet above Antarctica

A balloon-borne scientific instrument designed to study the origin of cosmic rays is taking its second turn high above the continent of Antarctica three and a half weeks after its launch.

SuperTIGER (Super Trans-Iron Galactic Element Recorder) is designed to measure the rare, heavy elements in cosmic rays that hold clues about their origins...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

11th Advanced Battery Power Conference, March 24-25, 2020 in Münster/Germany

16.01.2020 | Event News

Laser Colloquium Hydrogen LKH2: fast and reliable fuel cell manufacturing

15.01.2020 | Event News

„Advanced Battery Power“- Conference, Contributions are welcome!

07.01.2020 | Event News

 
Latest News

A new 'cool' blue

17.01.2020 | Life Sciences

EU-project SONAR: Better batteries for electricity from renewable energy sources

17.01.2020 | Power and Electrical Engineering

Neuromuscular organoid: It’s contracting!

17.01.2020 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>