Until now it has been much harder to operate the monitors because surgical team members are not allowed to touch any objects other than surgical instruments, due to the risk of infection.
That's why experts from Siemens Healthcare and the global research unit Corporate Technology have adapted Microsoft's Xbox technology to make it possible for surgeons to use hand and arm movements to change images, zoom in on details, and rotate three-dimensional images.
The system, which is not yet offered commercially, could be used in the future to provide support during minimally invasive operations, in which a catheter inserted through a small incision is used to perform the surgical procedure. The surgeon must have access to all the details of the patient's anatomy during the entire operation. This is why monitors in the operating theater display cross-sectional x-ray images or three-dimensional x-ray pictures. Now the gesture control system enables the surgeon to switch back and forth between individual images or views.
The basis of the system is provided by the Xbox game console's Kinect technology, which projects a dot pattern of infrared light into the room and records the scene with a camera from another angle. Three-dimensional objects or people distort the captured pattern, making it possible to calculate the distance between the light source and every point in the camera image. Out of these three-dimensional clouds made up of points, the software identifies the people in the room and recognizes their movements.
However, the system isn't aimed at translating slow, precise hand movements into exact commands. With this in mind, the experts from Corporate Technology developed algorithms that first identify the surgeon's hands within the point cloud. To this end, the algorithms are targeted to analyze only the zone in front of the individual users, where the hands of the person using the system would be expected to appear. Once the system distinguishes the hands, it registers their movements without becoming "confused" by the presence of other people in the room. Experts from Siemens Healthcare created the link between the gesture recognition and the display of the x-ray images.
They defined the required commands - for example, spreading the hands apart to enlarge a section of an image. Following successful prototype tests, the technology will be tested in two hospitals under semi-realistic conditions - in other words, without patients.
Dr. Norbert Aschenbrenner | Siemens InnovationNews
UCLA engineers use deep learning to reconstruct holograms and improve optical microscopy
22.11.2017 | University of California - Los Angeles
First transcatheter implant for diastolic heart failure successful
16.11.2017 | The Ohio State University Wexner Medical Center
Heat from the friction of rocks caused by tidal forces could be the “engine” for the hydrothermal activity on Saturn's moon Enceladus. This presupposes that...
The WHO reports an estimated 429,000 malaria deaths each year. The disease mostly affects tropical and subtropical regions and in particular the African continent. The Fraunhofer Institute for Silicate Research ISC teamed up with the Fraunhofer Institute for Molecular Biology and Applied Ecology IME and the Institute of Tropical Medicine at the University of Tübingen for a new test method to detect malaria parasites in blood. The idea of the research project “NanoFRET” is to develop a highly sensitive and reliable rapid diagnostic test so that patient treatment can begin as early as possible.
Malaria is caused by parasites transmitted by mosquito bite. The most dangerous form of malaria is malaria tropica. Left untreated, it is fatal in most cases....
The formation of stars in distant galaxies is still largely unexplored. For the first time, astron-omers at the University of Geneva have now been able to closely observe a star system six billion light-years away. In doing so, they are confirming earlier simulations made by the University of Zurich. One special effect is made possible by the multiple reflections of images that run through the cosmos like a snake.
Today, astronomers have a pretty accurate idea of how stars were formed in the recent cosmic past. But do these laws also apply to older galaxies? For around a...
Just because someone is smart and well-motivated doesn't mean he or she can learn the visual skills needed to excel at tasks like matching fingerprints, interpreting medical X-rays, keeping track of aircraft on radar displays or forensic face matching.
That is the implication of a new study which shows for the first time that there is a broad range of differences in people's visual ability and that these...
Computer Tomography (CT) is a standard procedure in hospitals, but so far, the technology has not been suitable for imaging extremely small objects. In PNAS, a team from the Technical University of Munich (TUM) describes a Nano-CT device that creates three-dimensional x-ray images at resolutions up to 100 nanometers. The first test application: Together with colleagues from the University of Kassel and Helmholtz-Zentrum Geesthacht the researchers analyzed the locomotory system of a velvet worm.
During a CT analysis, the object under investigation is x-rayed and a detector measures the respective amount of radiation absorbed from various angles....
15.11.2017 | Event News
15.11.2017 | Event News
30.10.2017 | Event News
23.11.2017 | Information Technology
23.11.2017 | Physics and Astronomy
23.11.2017 | Life Sciences