Successfully visualising multimodal biomedicine data
Picturing complex data may become considerably easier as a solution to display combined information from multiple data formats, currently applied to biomedicine, emerges.
In November 2003, partners in the IST project MULTIMOD succeeded in registering and animating the bone model of a young patient. They developed the DataManager system, whereby the 3D bone models, as derived from CT data, were registered and animated with kinematical data derived from the patient’s gait analysis (walking motion).
The technique enables the programmer to combine multiple representations and display modalities using the same set of data.
Project partners first designed the user interface of a surgical planning software environment, hip-op(c) in May 2002. Using the hip-op ROM, the system computes the range of motion (ROM) of the patient’s joint after the planned total hip replacement.
Their work led to the MULTIMOD Application Framework (MAF), a complex software architecture that provides a framework within which a programmer can quickly develop specialised applications in the domain of computer-aided medicine.
"MAF gives Europe’s bio-engineering community the scaffold upon which each research group can integrate its own tools and methods," explains scientific coordinator Marco Viceconti, from the Laboratorio de Tecnologia Medica, Bologna. "I am convinced that if the consortium can continue its work, MAP will become one of the most important pieces of software for scientific visualisation available in the world."
MAF allows the programmer to:
- Represent the patient by importing data from various sources (medical imaging, diagnostic measurements, computer simulations, laboratory tests) and combine them with complex registration and synchronisation methods. This achieves an effective data fusion into a multi-data representation of the patient’s body.
- Operate the patient representation using advanced algorithms to modify the data, analyse their mutual position in space and time, or simplify their attributes for specific purposes such as surgical simulation or testing in diagnosis or rehabilitation.
- Examine the patient by visualising the multi-data representation through combining multiple views. This allows the composition of a multimodal display adequate for each specific purpose.
Several specialised MAF applications are being explored. The hip-op(c) surgical planning programme is being re-written. Programmers are also writing a new application, FuncEv, which will combine data from multiple sources into a unified representation, allowing the orthopaedic surgeon to perform a complete functional evaluation of a patient’s knee prosthesis.
As for the future Viceconti says, "The sky is the limit. We are doing our very best to build a European biomedical industry success story out of this project."
Laboratorio di Tecnologia Medica
Istituti Ortopedici Rizzoli
Tara Morris | IST Results
The most recent press releases about innovation >>>
Die letzten 5 Focus-News des innovations-reports im Überblick:
An international team of scientists has proposed a new multi-disciplinary approach in which an array of new technologies will allow us to map biodiversity and the risks that wildlife is facing at the scale of whole landscapes. The findings are published in Nature Ecology and Evolution. This international research is led by the Kunming Institute of Zoology from China, University of East Anglia, University of Leicester and the Leibniz Institute for Zoo and Wildlife Research.
Using a combination of satellite and ground data, the team proposes that it is now possible to map biodiversity with an accuracy that has not been previously...
Heatwaves in the Arctic, longer periods of vegetation in Europe, severe floods in West Africa – starting in 2021, scientists want to explore the emissions of the greenhouse gas methane with the German-French satellite MERLIN. This is made possible by a new robust laser system of the Fraunhofer Institute for Laser Technology ILT in Aachen, which achieves unprecedented measurement accuracy.
Methane is primarily the result of the decomposition of organic matter. The gas has a 25 times greater warming potential than carbon dioxide, but is not as...
Hydrogen is regarded as the energy source of the future: It is produced with solar power and can be used to generate heat and electricity in fuel cells. Empa researchers have now succeeded in decoding the movement of hydrogen ions in crystals – a key step towards more efficient energy conversion in the hydrogen industry of tomorrow.
As charge carriers, electrons and ions play the leading role in electrochemical energy storage devices and converters such as batteries and fuel cells. Proton...
Scientists from the Excellence Cluster Universe at the Ludwig-Maximilians-Universität Munich have establised "Cosmowebportal", a unique data centre for cosmological simulations located at the Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences. The complete results of a series of large hydrodynamical cosmological simulations are available, with data volumes typically exceeding several hundred terabytes. Scientists worldwide can interactively explore these complex simulations via a web interface and directly access the results.
With current telescopes, scientists can observe our Universe’s galaxies and galaxy clusters and their distribution along an invisible cosmic web. From the...
Temperature measurements possible even on the smallest scale / Molecular ruby for use in material sciences, biology, and medicine
Chemists at Johannes Gutenberg University Mainz (JGU) in cooperation with researchers of the German Federal Institute for Materials Research and Testing (BAM)...