Engineer Pedro Correa, from the UCL Telecommunications and Teledetection Laboratory, told SINC that, together with professor Ferran Marqués's unit at the UPC, they have developed algorithms that tackle the problem of gesture recognition “in the least invasive way possible, since it does not require wearing any special suit or receivers, using a simple video camera to film the body's movement”.
The images filmed identify the person's outline several dozens of times a second, and the data obtained are analyzed by the algorithm invented by the researchers to identify the “crucial points”: head, hands and feet. The “crucial points extraction algorithm” uses the mathematical concept of geodesic distance to calculate the person's extremities, “in other words”, clarifies Correa, “which points are furthest away from the center of gravity, following a path entirely within the outline”.
Once the extremities have been obtained, the outline is analyzed once again to create "morphological skeletons" that help assign a label to each extremity. The five possible labels are head, left hand, right hand, left foot and right foot. Once identified, they are represented with colored dots for tracking in 2 dimensions. This enables the user to analyze the results visually.
To obtain the same information in 3 dimensions, the same steps are taken with an additional camera. This way, the triangulation of the labels extracted in each of the two views makes it possible to obtain the points in a three dimensional space. The front view provides information on the vertical and horizontal positions of the extremities, and the side view provides information on their depth.
The low level of complexity in this system allows it to be applied in real time on any personal computer, with a margin of error of between 4% and 9% in real situations, depending on the context and the quality of the segmentation carried out.
Correa explained that the applications of this technique are “all those that require motion interaction with the computer; that is, from browsing through applications in an operating system (like moving windows and text with hand movements) to interactive aerobic video games, and much more”. The study was also participated in by a Belgian company specializing in real-size video games, which are used, for example, in amusement parks and museums.
SINC Team | alfa
Stable magnetic bit of three atoms
21.09.2017 | Sonderforschungsbereich 668
Drones can almost see in the dark
20.09.2017 | Universität Zürich
Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.
A warming planet
Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.
The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...
Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...
Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!
When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...
For the first time, physicists have successfully imaged spiral magnetic ordering in a multiferroic material. These materials are considered highly promising candidates for future data storage media. The researchers were able to prove their findings using unique quantum sensors that were developed at Basel University and that can analyze electromagnetic fields on the nanometer scale. The results – obtained by scientists from the University of Basel’s Department of Physics, the Swiss Nanoscience Institute, the University of Montpellier and several laboratories from University Paris-Saclay – were recently published in the journal Nature.
Multiferroics are materials that simultaneously react to electric and magnetic fields. These two properties are rarely found together, and their combined...
19.09.2017 | Event News
12.09.2017 | Event News
06.09.2017 | Event News
22.09.2017 | Life Sciences
22.09.2017 | Medical Engineering
22.09.2017 | Physics and Astronomy