Together with Dutch researchers, Fraunhofer MEVIS is starting a project in which computer recognizes suspicious abnormalities in medical image data
MRI, CT, pathology: doctors have to consider medical image data –increasing in both amount and complexity – to perform diagnoses and monitor therapy. The Fraunhofer Institute for Medical Image Computing MEVIS in Bremen is creating a new approach to provide effective assistance.
Deep learning algorithms autonomously find interesting spots in new digital images of tissue samples based on an automated analysis. Starting with the highest resolution, these neuronal networks compress the data until information and image interpretations emerge. They help doctors perform faster and safer diagnoses. When doctors correct the computer diagnosis, new knowledge flows in the self-learning algorithm.
In the recently started AMI project (Automation in Medical Imaging), self-learning computer algorithms will automatically trawl large volumes of data and search for abnormalities to improve the accuracy of computer-generated diagnoses. MEVIS has partnered with the Radboud University in Nijmegen, the Netherlands, which hosts one of the world’s leading research groups for automated image evaluation.
“These deep learning algorithms especially show their strengths when enormous amounts of data have to be processed,” says MEVIS researcher Markus Harz. Such volumes of data accumulate when high-risk patients are screened repeatedly over long time periods. For analysis, doctors must recognize fine differences between newer and older images to detect early-stage tumors.
“These differences in the images often express themselves as slightly varying gray-scale values,” explains Harz. “Computers can perfectly detect such changes in shape, gray-scale value, or texture. A computer can even sift out the crucial changes itself.” It can disregard all cases that show no difference between older and newer images. Doctors would only have to consider cases in which potentially suspicious changes can be seen.
Experts from all over the world are developing promising computer algorithms for automated image recognition and diagnosis. However, many projects run the risk of ending in early research stages. Acquiring approval from respective authorities often presents difficulties. “Researchers have to prove that new methods are reliable and that their diagnostic statements can be scientifically verified,” explains Harz. “With the AMI project, we want to close some gaps on the way to approval and develop computer algorithms that are far easier to certify.”
To prove the capabilities of these self-learning programs, researchers want to compare them to real medical data continuously. This data originates in the clinic in Nijmegen and will soon come from clinics all over the world. Doctors mark important diagnostic details in the data with machine-readable annotations.
With the help of these annotations, software developers can check the reliability and precision of their programs when analyzing medical image data. The researchers can integrate those programs in the clinical workflow and discover to which extent the automatization is helpful. “With this close cooperation between physicians and developers, we want to develop reliable, powerful programs that will gain acceptance among doctors,” says Harz. “The more computers learn to decide independently, the more important it is to develop efficient interfaces with people.”
The AMI team aims to develop the new approach based on three concrete examples:
• Follow-up of cancer patients: People with increased risk of lung cancer are regularly examined with a yearly lung CT scan. Automated algorithms to detect possible lung cancers and compare the images from different years and search for suspicious changes in tissue have already been developed by both partners. The AMI project aims at refining and adapting this software to measure and quantify tumors and monitor treatment response in cancer patients for lung cancer and other types of tumors.
• Ophthalmology: Effective treatment for the most common retinal diseases (AMD, DR) highly depends on a careful monitoring of retinal changes and an objective decision for retreatment. To achieve this, patients are regularly examined with different imaging modalities, such as OCT or color fundus images, which generates enormous amounts of data and increases the clinical workload. With the help of the latest pattern recognition methods, a computer could automatically analyze the generated images and precisely measure changes. The goal is to create the first multimodal ophthalmology computer workstation.
• Digital pathology: The microscopic analysis of tissue sections of regional lymph nodes in cancer patients helps decide upon the most suitable treatment plan. Tissue sections containing metastases (sometimes as small as 0.2mm in diameter) indicate a significantly less favorable prognosis. A computer could analyze the digitized high-resolution tissue sections and find even the tiniest micrometastases.
“In all three application fields, we want the computer to be technically able to make diagnostic decisions by itself,” explains Markus Harz. “However, doctors will always receive a report enabling them to retrace the decision-making process in detail and make corrections if necessary.” As for the goals of AMI: The researchers want to create a process that facilitates the development of self-learning programs. The software components developed in the project should be easy to incorporate into common medical technology software systems.
AMI stands for “Automation in Medical Imaging.” The project, planned for three years, commenced in October 2015 with a project volume of two million euro. AMI is an undertaking of the ICON initiative, in which the Fraunhofer-Gesellschaft promotes close collaboration between its institutes and foreign research facilities. Project partners of Fraunhofer MEVIS in AMI are the Diagnostic Image Analysis Group of Prof. Dr. Bram van Ginneken and participating clinical workgroups at the Radboud University Medical Center in Nijmegen, the Netherlands.
Bianka Hofmann | Fraunhofer MEVIS - Institut für Bildgestützte Medizin
A first look at interstitial fluid flow in the brain
05.07.2018 | American Institute of Physics
A sentinel to watch over ocular pressure
04.07.2018 | Fraunhofer Institute for Microelectronic Circuits and Systems
A new manufacturing technique uses a process similar to newspaper printing to form smoother and more flexible metals for making ultrafast electronic devices.
The low-cost process, developed by Purdue University researchers, combines tools already used in industry for manufacturing metals on a large scale, but uses...
For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.
To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...
For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.
Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...
Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.
A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...
Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.
"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....
13.07.2018 | Event News
12.07.2018 | Event News
03.07.2018 | Event News
20.07.2018 | Power and Electrical Engineering
20.07.2018 | Information Technology
20.07.2018 | Materials Sciences