Until now it has been much harder to operate the monitors because surgical team members are not allowed to touch any objects other than surgical instruments, due to the risk of infection.
That's why experts from Siemens Healthcare and the global research unit Corporate Technology have adapted Microsoft's Xbox technology to make it possible for surgeons to use hand and arm movements to change images, zoom in on details, and rotate three-dimensional images.
The system, which is not yet offered commercially, could be used in the future to provide support during minimally invasive operations, in which a catheter inserted through a small incision is used to perform the surgical procedure. The surgeon must have access to all the details of the patient's anatomy during the entire operation. This is why monitors in the operating theater display cross-sectional x-ray images or three-dimensional x-ray pictures. Now the gesture control system enables the surgeon to switch back and forth between individual images or views.
The basis of the system is provided by the Xbox game console's Kinect technology, which projects a dot pattern of infrared light into the room and records the scene with a camera from another angle. Three-dimensional objects or people distort the captured pattern, making it possible to calculate the distance between the light source and every point in the camera image. Out of these three-dimensional clouds made up of points, the software identifies the people in the room and recognizes their movements.
However, the system isn't aimed at translating slow, precise hand movements into exact commands. With this in mind, the experts from Corporate Technology developed algorithms that first identify the surgeon's hands within the point cloud. To this end, the algorithms are targeted to analyze only the zone in front of the individual users, where the hands of the person using the system would be expected to appear. Once the system distinguishes the hands, it registers their movements without becoming "confused" by the presence of other people in the room. Experts from Siemens Healthcare created the link between the gesture recognition and the display of the x-ray images.
They defined the required commands - for example, spreading the hands apart to enlarge a section of an image. Following successful prototype tests, the technology will be tested in two hospitals under semi-realistic conditions - in other words, without patients.
Dr. Norbert Aschenbrenner | Siemens InnovationNews
Visualizing gene expression with MRI
23.12.2016 | California Institute of Technology
Illuminating cancer: Researchers invent a pH threshold sensor to improve cancer surgery
21.12.2016 | UT Southwestern Medical Center
For the first time ever, a cloud of ultra-cold atoms has been successfully created in space on board of a sounding rocket. The MAIUS mission demonstrates that quantum optical sensors can be operated even in harsh environments like space – a prerequi-site for finding answers to the most challenging questions of fundamental physics and an important innovation driver for everyday applications.
According to Albert Einstein's Equivalence Principle, all bodies are accelerated at the same rate by the Earth's gravity, regardless of their properties. This...
An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The team of scientists headed by...
Yersiniae cause severe intestinal infections. Studies using Yersinia pseudotuberculosis as a model organism aim to elucidate the infection mechanisms of these...
Researchers from the University of Hamburg in Germany, in collaboration with colleagues from the University of Aarhus in Denmark, have synthesized a new superconducting material by growing a few layers of an antiferromagnetic transition-metal chalcogenide on a bismuth-based topological insulator, both being non-superconducting materials.
While superconductivity and magnetism are generally believed to be mutually exclusive, surprisingly, in this new material, superconducting correlations...
Laser-driving of semimetals allows creating novel quasiparticle states within condensed matter systems and switching between different states on ultrafast time scales
Studying properties of fundamental particles in condensed matter systems is a promising approach to quantum field theory. Quasiparticles offer the opportunity...
19.01.2017 | Event News
10.01.2017 | Event News
09.01.2017 | Event News
23.01.2017 | Health and Medicine
23.01.2017 | Physics and Astronomy
23.01.2017 | Process Engineering