Virtual 3-D ‘Knitting’ Adds New Stitch for Graphic Artists

But that doesn’t work for knit sweaters. To make the image realistic, the computer has to simulate the surface right down to the intricate intertwining of yarn.

So scientists must, in effect, teach computers to knit – and graphic artists have to painstakingly model the 3-D structure of every stitch.

A new method for building simulated knitted fabric out of an array of individual stitches was reported at the 39th International Conference and Exhibition of Computer Graphics and Interactive Techniques earlier this month in Los Angeles by Cem Yuksel of the University of Utah; Jonathan Kaldor, of Facebook; and Steve Marschner and Doug James, Cornell University associate professors of computer science. The work was done when Yuksel and Kaldor were at Cornell.

The Cornell innovation is to create a 3-D model of a single stitch and then combine multiple copies into a mesh, like tiles in a mosaic. The computer projects the mesh onto a model of the desired shape of the garment, treating each stitch as a tiny flat polygon that stretches and bends to fit the 3-D surface. Then it “relaxes” the graphic image of each stitch to fit the shape of its polygon, just as real yarn would stretch and bend to fit the shape of the wearer.

The result is a simulation with detail down to the yarn level.

“We are actually changing the shape of the yarn loops that make up the stitches,” Marschner said, “simulating how they wrap around other loops.”

The researchers tested their method with several patterns from knitting books and created images of dresses, sweaters, a shawl and a tea cozy. The simulations are highly realistic, but the researchers noted that the results of knitting a particular pattern depend on the yarn and needles used, as well as the style of the individual knitter. The method has some parameters that can be adjusted to simulate the effects of different needles or yarn, or different yarn tension used by the knitter, they said.

The process is computationally intensive, requiring several hours to simulate a garment (cable stitching takes the longest). As of today it would not be practical for an interactive application such as virtual reality, Marschner said, but it would be usable for movies.

The research was supported by the National Science Foundation, the Alfred P. Sloan Foundation, the John Simon Guggenheim Memorial Foundation and Pixar.

For more information:

A complete project description and downloadable images: www.cs.cornell.edu/projects/stitchmeshes

A video demonstration of the process: www.youtube.com/watch?v=NG5C_a6rxrY