Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


New deep learning research breaks records in image recognition ability of self-driving cars


People, bicycles, cars or road, sky, grass: Which pixels of an image represent distinct foreground persons or objects in front of a self-driving car, and which pixels represent background classes? This task, known as panoptic segmentation, is a fundamental problem that has applications in numerous fields such as self-driving cars, robotics, augmented reality and even in biomedical image analysis.

At the Department of Computer Science at the University of Freiburg Dr. Abhinav Valada, Assistant Professor for Robot Learning and member of BrainLinks-BrainTools focuses on this research question.

Red for people, blue for cars: A new method uses artificial intelligence (AI) model that enables coherent recognition of visual scenes more quickly and effectively.

Source: Abhinav Valada

Valada and his team have developed the state-of-the-art “EfficientPS” artificial intelligence (AI) model that enables coherent recognition of visual scenes more quickly and effectively.

This task is mostly tackled using a machine learning technique known as deep learning where artificial neural networks that are inspired from the human brain, learn from large amounts of data, explains the Freiburg researcher. Public benchmarks such as Cityscapes play an important role in measuring the advancement in these techniques.

“For many years, research teams, for example from Google or Uber, compete for the top place in these benchmarks”, says Rohit Mohan, a member of Valada’s team. The method of the computer scientists from Freiburg, which has been developed to understand urban city scenes, has been ranked first in Cityscapes, the most influential leaderboard for scene understanding research in autonomous driving.

EfficientPS also consistently sets the new state-of-the-art on other standard benchmark datasets such as KITTI, Mapillary Vistas, and IDD.

On the project website, Valada shows examples of how the team trained different AI models on various datasets. The results are superimposed on the respective input image, where the colors show which object class that the model assigns the pixel to.

For example, cars are marked in blue, people in red, trees in green, and buildings in gray. In addition, the AI model also draws a border around each object that it considers a separate entity. The Freiburg researchers have succeeded in training the model to transfer the learned information of urban scenes from Stuttgart to New York City.

Although the AI model did not know what a city in the USA could look like, it was able to accurately recognize scenes of New York City.

Most previous methods that address this problem have large model sizes and are computationally expensive for use in real-world applications such as robotics that are highly resource constrained, explains Valada:

“Our EfficientPS not only achieves state-of-the-art performance, it is also the most computationally efficient and fastest method. This further extends the applications in which EfficientPS can be used.”

Demo of AI Models

Sample video: Driving in New York City

“Cityscapes” Benchmark Leaderboard

Dr. Abhinav Valada
Assistant Professor for Robot Learning
University of Freiburg
Tel.: 0761/203-8025


Nicolas Scherger | idw - Informationsdienst Wissenschaft

More articles from Information Technology:

nachricht A soft touch for robotic hardware
15.05.2020 | University of Tokyo

nachricht UCLA and Carnegie Mellon researchers develop real-time physics engine for soft robotics
12.05.2020 | University of California - Los Angeles

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: 'Hot and messy' entanglement of 15 trillion atoms

Quantum entanglement is a process by which microscopic objects like electrons or atoms lose their individuality to become better coordinated with each other. Entanglement is at the heart of quantum technologies that promise large advances in computing, communications and sensing, for example detecting gravitational waves.

Entangled states are famously fragile: in most cases even a tiny disturbance will undo the entanglement. For this reason, current quantum technologies take...

Im Focus: A new, highly sensitive chemical sensor uses protein nanowires

UMass Amherst team introduces high-performing 'green' electronic sensor

Writing in the journal NanoResearch, a team at the University of Massachusetts Amherst reports this week that they have developed bioelectronic ammonia gas...

Im Focus: Surgery Training with Robots and Virtual Reality

Joint press release from the University of Bremen and Chemnitz University of Technology

The insertion of hip implants places high demands on surgeons. To help young doctors practice this operation under realistic conditions, scientists from the...

Im Focus: Technology innovation for neurology: Brain signal measurement using printed tattoo electrodes

TU Graz researcher Francesco Greco has developed ultra-light tattoo electrodes that are hardly noticeable on the skin and make long-term measurements of brain activity cheaper and easier.

In 2015 Francesco Greco, head of the Laboratory of Applied Materials for Printed and Soft electronics (LAMPSe, at the Institute of Solid...

Im Focus: Future information technologies: 3D Quantum Spin Liquid revealed

Quantum Spin Liquids are candidates for potential use in future information technologies. So far, Quantum Spin Liquids have usually only been found in one or two dimensional magnetic systems only. Now an international team led by HZB scientists has investigated crystals of PbCuTe2O6 with neutron experiments at ISIS, NIST and ILL. They found spin liquid behaviour in 3D, due to a so called hyper hyperkagome lattice. The experimental data fit extremely well to theoretical simulations also done at HZB.

IT devices today are based on electronic processes in semiconductors. The next real breakthrough could be to exploit other quantum phenomena, for example...

All Focus news of the innovation-report >>>



Industry & Economy
Event News

Aachen Machine Tool Colloquium AWK'21 will take place on June 10 and 11, 2021

07.04.2020 | Event News

International Coral Reef Symposium in Bremen Postponed by a Year

06.04.2020 | Event News

13th AKL – International Laser Technology Congress: May 4–6, 2022 in Aachen – Laser Technology Live already this year!

02.04.2020 | Event News

Latest News

CD4+ Cells in the Fast Lane - Effect of CAR-T Cells in Focus

15.05.2020 | Life Sciences

'Hot and messy' entanglement of 15 trillion atoms

15.05.2020 | Physics and Astronomy

A soft touch for robotic hardware

15.05.2020 | Information Technology

Science & Research
Overview of more VideoLinks >>>