A revolutionary new interface allows users to really feel virtual textiles. The system combines a specially designed glove, a sophisticated computer model and visual representation to reproduce the sensation of cloth with an impressive degree of realism.
“It is a multi-modal approach that has never been tried before,” says Professor Nadia Magnenat-Thalmann, coordinator of the HAPTEX project. HAPTEX stands for Haptic sensing of virtual textiles.
The new system is a major breakthrough achieved through highly focused work of a small consortium of five research institutes. In just three years, they have created a pre-commercialisation prototype of the device and its related multi-modal software.
But it was not easy. Creating the realistic sensation of deformable textiles required a huge amount of modelling. “That was our first big challenge,” says Magnenat-Thalmann, taking precise measurements of the tensile, bending and stretching properties of the material.
“You also need very high resolution; the visual system will give a realistic impression of movement with just 20 frames a second, but touch is much more sensitive. You need a thousand samples a second to recreate touch,” she tells ICT Results.
In the end, the team created two models. One global model tracks the overall properties of the material. A second, fine-resolution model then maps the actual sensation on skin. All this information had to be combined with a detailed visual representation of the textile.
“That was another major problem,” notes Magnenat-Thalmann, “because the two must be in sync or the sensation will not be realistic.” Like a video with the audio out of sync, any latency between the visual and the sensual destroys the effect.
These were three major challenges from the outset, but they were just the beginning. “We had major jobs to do with the hardware, too. Nobody has combined a force-feedback device with a tactile one,” reports Magnenat-Thalmann.
HAPTEX overcame this problem by developing a powered exoskeleton glove with a pair of pin arrays that provide tactile sensation to two fingers. The glove gives the sensation of bending and stretching the fabric, while the pin arrays convey texture. Then this integrated device is combined with the visual and tactile database to give an overall impression.
Feeling is believing
“We have a working prototype device and we have validated it. It gives a reliable and reproducible sensation of real fabrics in a virtual world,” says Magnenat-Thalmann.
Reviewers were very impressed with the project’s results, but Magnenat-Thalmann says the project did not achieve all that they hoped for. “Originally, our vision was to create a system that allowed users to distinguish between, say, cotton, wool and silk in a blind test. The system is not that sensitive yet.”
It is, however, in pre-commercialisation form. The team now hopes to secure funding for a second project that will take the device from prototype stage to full commercialisation. If they succeed, it will be a first of its kind.
It will also mean entirely new markets. The textile industry and online shopping are obvious examples, but Magnenat-Thalmann also sees applications in gaming, where it could be used to make virtual worlds more realistic.
Christian Nielsen | alfa
29.06.2017 | Institute of Science and Technology Austria
Seeing the forest through the trees with a new LiDAR system
28.06.2017 | The Optical Society
Computer scientists use wave packet theory to develop realistic, detailed water wave simulations in real time. Their results will be presented at this year’s SIGGRAPH conference.
Think about the last time you were at a lake, river, or the ocean. Remember the ripples of the water, the waves crashing against the rocks, the wake following...
An international team of scientists has proposed a new multi-disciplinary approach in which an array of new technologies will allow us to map biodiversity and the risks that wildlife is facing at the scale of whole landscapes. The findings are published in Nature Ecology and Evolution. This international research is led by the Kunming Institute of Zoology from China, University of East Anglia, University of Leicester and the Leibniz Institute for Zoo and Wildlife Research.
Using a combination of satellite and ground data, the team proposes that it is now possible to map biodiversity with an accuracy that has not been previously...
Heatwaves in the Arctic, longer periods of vegetation in Europe, severe floods in West Africa – starting in 2021, scientists want to explore the emissions of the greenhouse gas methane with the German-French satellite MERLIN. This is made possible by a new robust laser system of the Fraunhofer Institute for Laser Technology ILT in Aachen, which achieves unprecedented measurement accuracy.
Methane is primarily the result of the decomposition of organic matter. The gas has a 25 times greater warming potential than carbon dioxide, but is not as...
Hydrogen is regarded as the energy source of the future: It is produced with solar power and can be used to generate heat and electricity in fuel cells. Empa researchers have now succeeded in decoding the movement of hydrogen ions in crystals – a key step towards more efficient energy conversion in the hydrogen industry of tomorrow.
As charge carriers, electrons and ions play the leading role in electrochemical energy storage devices and converters such as batteries and fuel cells. Proton...
Scientists from the Excellence Cluster Universe at the Ludwig-Maximilians-Universität Munich have establised "Cosmowebportal", a unique data centre for cosmological simulations located at the Leibniz Supercomputing Centre (LRZ) of the Bavarian Academy of Sciences. The complete results of a series of large hydrodynamical cosmological simulations are available, with data volumes typically exceeding several hundred terabytes. Scientists worldwide can interactively explore these complex simulations via a web interface and directly access the results.
With current telescopes, scientists can observe our Universe’s galaxies and galaxy clusters and their distribution along an invisible cosmic web. From the...
19.06.2017 | Event News
13.06.2017 | Event News
13.06.2017 | Event News
29.06.2017 | Physics and Astronomy
29.06.2017 | Life Sciences
29.06.2017 | Health and Medicine