Together with Dutch researchers, Fraunhofer MEVIS is starting a project in which computer recognizes suspicious abnormalities in medical image data
MRI, CT, pathology: doctors have to consider medical image data –increasing in both amount and complexity – to perform diagnoses and monitor therapy. The Fraunhofer Institute for Medical Image Computing MEVIS in Bremen is creating a new approach to provide effective assistance.
Deep learning algorithms autonomously find interesting spots in new digital images of tissue samples based on an automated analysis. Starting with the highest resolution, these neuronal networks compress the data until information and image interpretations emerge. They help doctors perform faster and safer diagnoses. When doctors correct the computer diagnosis, new knowledge flows in the self-learning algorithm.
In the recently started AMI project (Automation in Medical Imaging), self-learning computer algorithms will automatically trawl large volumes of data and search for abnormalities to improve the accuracy of computer-generated diagnoses. MEVIS has partnered with the Radboud University in Nijmegen, the Netherlands, which hosts one of the world’s leading research groups for automated image evaluation.
“These deep learning algorithms especially show their strengths when enormous amounts of data have to be processed,” says MEVIS researcher Markus Harz. Such volumes of data accumulate when high-risk patients are screened repeatedly over long time periods. For analysis, doctors must recognize fine differences between newer and older images to detect early-stage tumors.
“These differences in the images often express themselves as slightly varying gray-scale values,” explains Harz. “Computers can perfectly detect such changes in shape, gray-scale value, or texture. A computer can even sift out the crucial changes itself.” It can disregard all cases that show no difference between older and newer images. Doctors would only have to consider cases in which potentially suspicious changes can be seen.
Experts from all over the world are developing promising computer algorithms for automated image recognition and diagnosis. However, many projects run the risk of ending in early research stages. Acquiring approval from respective authorities often presents difficulties. “Researchers have to prove that new methods are reliable and that their diagnostic statements can be scientifically verified,” explains Harz. “With the AMI project, we want to close some gaps on the way to approval and develop computer algorithms that are far easier to certify.”
To prove the capabilities of these self-learning programs, researchers want to compare them to real medical data continuously. This data originates in the clinic in Nijmegen and will soon come from clinics all over the world. Doctors mark important diagnostic details in the data with machine-readable annotations.
With the help of these annotations, software developers can check the reliability and precision of their programs when analyzing medical image data. The researchers can integrate those programs in the clinical workflow and discover to which extent the automatization is helpful. “With this close cooperation between physicians and developers, we want to develop reliable, powerful programs that will gain acceptance among doctors,” says Harz. “The more computers learn to decide independently, the more important it is to develop efficient interfaces with people.”
The AMI team aims to develop the new approach based on three concrete examples:
• Follow-up of cancer patients: People with increased risk of lung cancer are regularly examined with a yearly lung CT scan. Automated algorithms to detect possible lung cancers and compare the images from different years and search for suspicious changes in tissue have already been developed by both partners. The AMI project aims at refining and adapting this software to measure and quantify tumors and monitor treatment response in cancer patients for lung cancer and other types of tumors.
• Ophthalmology: Effective treatment for the most common retinal diseases (AMD, DR) highly depends on a careful monitoring of retinal changes and an objective decision for retreatment. To achieve this, patients are regularly examined with different imaging modalities, such as OCT or color fundus images, which generates enormous amounts of data and increases the clinical workload. With the help of the latest pattern recognition methods, a computer could automatically analyze the generated images and precisely measure changes. The goal is to create the first multimodal ophthalmology computer workstation.
• Digital pathology: The microscopic analysis of tissue sections of regional lymph nodes in cancer patients helps decide upon the most suitable treatment plan. Tissue sections containing metastases (sometimes as small as 0.2mm in diameter) indicate a significantly less favorable prognosis. A computer could analyze the digitized high-resolution tissue sections and find even the tiniest micrometastases.
“In all three application fields, we want the computer to be technically able to make diagnostic decisions by itself,” explains Markus Harz. “However, doctors will always receive a report enabling them to retrace the decision-making process in detail and make corrections if necessary.” As for the goals of AMI: The researchers want to create a process that facilitates the development of self-learning programs. The software components developed in the project should be easy to incorporate into common medical technology software systems.
AMI stands for “Automation in Medical Imaging.” The project, planned for three years, commenced in October 2015 with a project volume of two million euro. AMI is an undertaking of the ICON initiative, in which the Fraunhofer-Gesellschaft promotes close collaboration between its institutes and foreign research facilities. Project partners of Fraunhofer MEVIS in AMI are the Diagnostic Image Analysis Group of Prof. Dr. Bram van Ginneken and participating clinical workgroups at the Radboud University Medical Center in Nijmegen, the Netherlands.
Bianka Hofmann | Fraunhofer MEVIS - Institut für Bildgestützte Medizin
3-D visualization of the pancreas -- new tool in diabetes research
15.03.2017 | Umea University
New PET radiotracer identifies inflammation in life-threatening atherosclerosis
02.03.2017 | Society of Nuclear Medicine
Astronomers from Bonn and Tautenburg in Thuringia (Germany) used the 100-m radio telescope at Effelsberg to observe several galaxy clusters. At the edges of these large accumulations of dark matter, stellar systems (galaxies), hot gas, and charged particles, they found magnetic fields that are exceptionally ordered over distances of many million light years. This makes them the most extended magnetic fields in the universe known so far.
The results will be published on March 22 in the journal „Astronomy & Astrophysics“.
Galaxy clusters are the largest gravitationally bound structures in the universe. With a typical extent of about 10 million light years, i.e. 100 times the...
Researchers at the Goethe University Frankfurt, together with partners from the University of Tübingen in Germany and Queen Mary University as well as Francis Crick Institute from London (UK) have developed a novel technology to decipher the secret ubiquitin code.
Ubiquitin is a small protein that can be linked to other cellular proteins, thereby controlling and modulating their functions. The attachment occurs in many...
In the eternal search for next generation high-efficiency solar cells and LEDs, scientists at Los Alamos National Laboratory and their partners are creating...
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are less stable. Now researchers at the Technical University of Munich (TUM) have, for the first time ever, produced a composite material combining silicon nanosheets and a polymer that is both UV-resistant and easy to process. This brings the scientists a significant step closer to industrial applications like flexible displays and photosensors.
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are...
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to simulate these confined natural conditions in artificial vesicles for the first time. As reported in the academic journal Small, the results are offering better insight into the development of nanoreactors and artificial organelles.
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to...
20.03.2017 | Event News
14.03.2017 | Event News
07.03.2017 | Event News
24.03.2017 | Materials Sciences
24.03.2017 | Physics and Astronomy
24.03.2017 | Physics and Astronomy