Neural networks are commonly used today to analyze complex data – for instance to find clues to illnesses in genetic information. Ultimately, though, no one knows how these networks actually work exactly. That is why Fraunhofer researchers developed software that enables them to look into these black boxes and analyze how they function. The researchers will present their software at CeBIT in Hannover from March 20 to 24, 2017 (Hall 6, Booth B 36).
Sorting photos on the computer used to be a tedious job. Today, you simply click on face recognition and instantly get a selection of photos of your daughter or son. Computers have gotten very good at analyzing large volumes of data and searching for certain structures, such as faces in images. This is made possible by neural networks, which have developed into an established and sophisticated IT analysis method.
The problem is that it isn’t just researchers who currently don’t know exactly how neural networks function step by step, or why they reach one result or another. Neural networks are, in a sense, black boxes – computer programs that people feed values into and that reliably return results. If you want to teach a neural network, for instance, to recognize cats, then you instruct the system by feeding it thousands of cat pictures. Just like a small child that slowly learns to distinguish cats from dogs, the neural network, too, learns automatically.
“In many cases, though, researchers are less interested in the result and far more interested in what the neural network actually does – how it reaches decisions,” says Dr. Wojciech Samek, head of the Machine Learning Group at Fraunhofer Heinrich Hertz Institute HHI in Berlin. So Samek and his team, in collaboration with colleagues from TU Berlin (Prof. Dr. Klaus-Robert Müller), developed a method that makes it possible to watch a neural network think.
Machine learning enables customized cancer Treatments
This is important, for instance, in detecting diseases. We already have the capability today to feed patients’ genetic data into computers – or neural networks – which then analyze the probability of a patient having a certain genetic disorder. “But it would be much more interesting to know precisely which characteristics the program bases its decisions on,” says Samek. It could be certain genetic defects the patient has – and these, in turn, could be a possible target for a cancer treatment that is tailored to individual patients.
Neural networks in reverse
The researchers’ method allows them to watch the work of the neural networks in reverse: they work through the program backwards, starting from the result. “We can see exactly where a certain group of neurons made a certain decision, and how strongly this decision impacted the result,” says Samek. The researchers have already impressively demonstrated – multiple times – that the method works. For instance, they compared two programs that are publicly available on the Internet and that are both capable of recognizing horses in images. The result was surprising. The first program actually recognized the horses’ bodies. The second one, however, focused on the copyright symbols on the photos, which pointed to forums for horse lovers, or riding and breeding associations, enabling the program to achieve a high success rate even though it had never learned what horses look like.
Applications in big data
“So you can see how important it is to understand exactly how such a network functions,” says Samek. This knowledge is also of particular interest to industry. “It is conceivable, for instance, that the operating data of a complex production plant could be analyzed to deduce which parameters impact product quality or cause it to fluctuate,” he says. The invention is also interesting for many other applications that involve the neural analysis of large or complex data volumes. “In another experiment, we were able to show which parameters a network uses to decide whether a face appears young or old.”
According to Samek, for a long time banks have even been using neural networks to analyze bank customers’ creditworthiness. To do this, large volumes of customer data are collected and evaluated by a neural network. “If we knew how the network reaches its decision, we could reduce the data volume right from the start by selecting the relevant parameters,” he says. This would certainly be in the customers’ interests, too. At the CeBIT trade fair in Hannover from March 20 to 24, 2017, Samek’s team of researchers will demonstrate how they use their software to analyze the black boxes of neural networks – and how these networks can deduce a person’s age or sex from their face, or recognize animals.
Anne Rommel | Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut, HHI
Paradigm shift in Paris: Encouraging an holistic view of laser machining
10.01.2018 | Fraunhofer-Institut für Lasertechnik ILT
Diamond Lenses and Space Lasers at Photonics West
15.12.2017 | Fraunhofer-Institut für Lasertechnik ILT
On the way to an intelligent laboratory, physicists from Innsbruck and Vienna present an artificial agent that autonomously designs quantum experiments. In initial experiments, the system has independently (re)discovered experimental techniques that are nowadays standard in modern quantum optical laboratories. This shows how machines could play a more creative role in research in the future.
We carry smartphones in our pockets, the streets are dotted with semi-autonomous cars, but in the research laboratory experiments are still being designed by...
What enables electrons to be transferred swiftly, for example during photosynthesis? An interdisciplinary team of researchers has worked out the details of how...
For the first time, scientists have precisely measured the effective electrical charge of a single molecule in solution. This fundamental insight of an SNSF Professor could also pave the way for future medical diagnostics.
Electrical charge is one of the key properties that allows molecules to interact. Life itself depends on this phenomenon: many biological processes involve...
At the JEC World Composite Show in Paris in March 2018, the Fraunhofer Institute for Laser Technology ILT will be focusing on the latest trends and innovations in laser machining of composites. Among other things, researchers at the booth shared with the Aachen Center for Integrative Lightweight Production (AZL) will demonstrate how lasers can be used for joining, structuring, cutting and drilling composite materials.
No other industry has attracted as much public attention to composite materials as the automotive industry, which along with the aerospace industry is a driver...
Scientists at Tokyo Institute of Technology (Tokyo Tech) and Tohoku University have developed high-quality GFO epitaxial films and systematically investigated their ferroelectric and ferromagnetic properties. They also demonstrated the room-temperature magnetocapacitance effects of these GFO thin films.
Multiferroic materials show magnetically driven ferroelectricity. They are attracting increasing attention because of their fascinating properties such as...
08.01.2018 | Event News
11.12.2017 | Event News
08.12.2017 | Event News
19.01.2018 | Life Sciences
19.01.2018 | Life Sciences
19.01.2018 | Physics and Astronomy