Game Console Technology in the Operating Room

Until now it has been much harder to operate the monitors because surgical team members are not allowed to touch any objects other than surgical instruments, due to the risk of infection.

That's why experts from Siemens Healthcare and the global research unit Corporate Technology have adapted Microsoft's Xbox technology to make it possible for surgeons to use hand and arm movements to change images, zoom in on details, and rotate three-dimensional images.

The system, which is not yet offered commercially, could be used in the future to provide support during minimally invasive operations, in which a catheter inserted through a small incision is used to perform the surgical procedure. The surgeon must have access to all the details of the patient's anatomy during the entire operation. This is why monitors in the operating theater display cross-sectional x-ray images or three-dimensional x-ray pictures. Now the gesture control system enables the surgeon to switch back and forth between individual images or views.

The basis of the system is provided by the Xbox game console's Kinect technology, which projects a dot pattern of infrared light into the room and records the scene with a camera from another angle. Three-dimensional objects or people distort the captured pattern, making it possible to calculate the distance between the light source and every point in the camera image. Out of these three-dimensional clouds made up of points, the software identifies the people in the room and recognizes their movements.

However, the system isn't aimed at translating slow, precise hand movements into exact commands. With this in mind, the experts from Corporate Technology developed algorithms that first identify the surgeon's hands within the point cloud. To this end, the algorithms are targeted to analyze only the zone in front of the individual users, where the hands of the person using the system would be expected to appear. Once the system distinguishes the hands, it registers their movements without becoming “confused” by the presence of other people in the room. Experts from Siemens Healthcare created the link between the gesture recognition and the display of the x-ray images.

They defined the required commands – for example, spreading the hands apart to enlarge a section of an image. Following successful prototype tests, the technology will be tested in two hospitals under semi-realistic conditions – in other words, without patients.

Media Contact

Dr. Norbert Aschenbrenner Siemens InnovationNews

All latest news from the category: Medical Engineering

The development of medical equipment, products and technical procedures is characterized by high research and development costs in a variety of fields related to the study of human medicine.

innovations-report provides informative and stimulating reports and articles on topics ranging from imaging processes, cell and tissue techniques, optical techniques, implants, orthopedic aids, clinical and medical office equipment, dialysis systems and x-ray/radiation monitoring devices to endoscopy, ultrasound, surgical techniques, and dental materials.

Back to home

Comments (0)

Write a comment

Newest articles

Lighting up the future

New multidisciplinary research from the University of St Andrews could lead to more efficient televisions, computer screens and lighting. Researchers at the Organic Semiconductor Centre in the School of Physics and…

Researchers crack sugarcane’s complex genetic code

Sweet success: Scientists created a highly accurate reference genome for one of the most important modern crops and found a rare example of how genes confer disease resistance in plants….

Evolution of the most powerful ocean current on Earth

The Antarctic Circumpolar Current plays an important part in global overturning circulation, the exchange of heat and CO2 between the ocean and atmosphere, and the stability of Antarctica’s ice sheets….

Partners & Sponsors