A revolutionary new interface allows users to really feel virtual textiles. The system combines a specially designed glove, a sophisticated computer model and visual representation to reproduce the sensation of cloth with an impressive degree of realism.
“It is a multi-modal approach that has never been tried before,” says Professor Nadia Magnenat-Thalmann, coordinator of the HAPTEX project. HAPTEX stands for Haptic sensing of virtual textiles.
The new system is a major breakthrough achieved through highly focused work of a small consortium of five research institutes. In just three years, they have created a pre-commercialisation prototype of the device and its related multi-modal software.
But it was not easy. Creating the realistic sensation of deformable textiles required a huge amount of modelling. “That was our first big challenge,” says Magnenat-Thalmann, taking precise measurements of the tensile, bending and stretching properties of the material.
“You also need very high resolution; the visual system will give a realistic impression of movement with just 20 frames a second, but touch is much more sensitive. You need a thousand samples a second to recreate touch,” she tells ICT Results.
In the end, the team created two models. One global model tracks the overall properties of the material. A second, fine-resolution model then maps the actual sensation on skin. All this information had to be combined with a detailed visual representation of the textile.
“That was another major problem,” notes Magnenat-Thalmann, “because the two must be in sync or the sensation will not be realistic.” Like a video with the audio out of sync, any latency between the visual and the sensual destroys the effect.
These were three major challenges from the outset, but they were just the beginning. “We had major jobs to do with the hardware, too. Nobody has combined a force-feedback device with a tactile one,” reports Magnenat-Thalmann.
HAPTEX overcame this problem by developing a powered exoskeleton glove with a pair of pin arrays that provide tactile sensation to two fingers. The glove gives the sensation of bending and stretching the fabric, while the pin arrays convey texture. Then this integrated device is combined with the visual and tactile database to give an overall impression.
Feeling is believing
“We have a working prototype device and we have validated it. It gives a reliable and reproducible sensation of real fabrics in a virtual world,” says Magnenat-Thalmann.
Reviewers were very impressed with the project’s results, but Magnenat-Thalmann says the project did not achieve all that they hoped for. “Originally, our vision was to create a system that allowed users to distinguish between, say, cotton, wool and silk in a blind test. The system is not that sensitive yet.”
It is, however, in pre-commercialisation form. The team now hopes to secure funding for a second project that will take the device from prototype stage to full commercialisation. If they succeed, it will be a first of its kind.
It will also mean entirely new markets. The textile industry and online shopping are obvious examples, but Magnenat-Thalmann also sees applications in gaming, where it could be used to make virtual worlds more realistic.
Christian Nielsen | alfa
Fingerprints of quantum entanglement
16.02.2018 | University of Vienna
Simple in the Cloud: The digitalization of brownfield systems made easy
07.02.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Breakthrough provides a new concept of the design of molecular motors, sensors and electricity generators at nanoscale
Researchers from the Institute of Organic Chemistry and Biochemistry of the CAS (IOCB Prague), Institute of Physics of the CAS (IP CAS) and Palacký University...
For photographers and scientists, lenses are lifesavers. They reflect and refract light, making possible the imaging systems that drive discovery through the microscope and preserve history through cameras.
But today's glass-based lenses are bulky and resist miniaturization. Next-generation technologies, such as ultrathin cameras or tiny microscopes, require...
Scientists from the University of Zurich have succeeded for the first time in tracking individual stem cells and their neuronal progeny over months within the intact adult brain. This study sheds light on how new neurons are produced throughout life.
The generation of new nerve cells was once thought to taper off at the end of embryonic development. However, recent research has shown that the adult brain...
Theoretical physicists propose to use negative interference to control heat flow in quantum devices. Study published in Physical Review Letters
Quantum computer parts are sensitive and need to be cooled to very low temperatures. Their tiny size makes them particularly susceptible to a temperature...
Let’s say the armrest is broken in your vintage car. As things stand, you would need a lot of luck and persistence to find the right spare part. But in the world of Industrie 4.0 and production with batch sizes of one, you can simply scan the armrest and print it out. This is made possible by the first ever 3D scanner capable of working autonomously and in real time. The autonomous scanning system will be on display at the Hannover Messe Preview on February 6 and at the Hannover Messe proper from April 23 to 27, 2018 (Hall 6, Booth A30).
Part of the charm of vintage cars is that they stopped making them long ago, so it is special when you do see one out on the roads. If something breaks or...
15.02.2018 | Event News
13.02.2018 | Event News
12.02.2018 | Event News
16.02.2018 | Information Technology
16.02.2018 | Health and Medicine
16.02.2018 | Physics and Astronomy