Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


Glasses-free 3-D projector


New design could also make conventional 2-D video higher in resolution and contrast

Over the past three years, researchers in the Camera Culture group at the MIT Media Lab have steadily refined a design for a glasses-free, multiperspective, 3-D video screen, which they hope could provide a cheaper, more practical alternative to holographic video in the short term.

Now they've designed a projector that exploits the same technology, which they'll unveil at this year's Siggraph, the major conference in computer graphics. The projector can also improve the resolution and contrast of conventional video, which could make it an attractive transitional technology as content producers gradually learn to harness the potential of multiperspective 3-D.

Multiperspective 3-D differs from the stereoscopic 3-D now common in movie theaters in that the depicted objects disclose new perspectives as the viewer moves about them, just as real objects would. This means it might have applications in areas like collaborative design and medical imaging, as well as entertainment.

... more about:
»Camera »MIT »Technology »algorithm »explains »hertz »images »produce

The MIT researchers — research scientist Gordon Wetzstein, graduate student Matthew Hirsch, and Ramesh Raskar, the NEC Career Development Associate Professor of Media Arts and Sciences and head of the Camera Culture group — built a prototype of their system using off-the-shelf components.

The heart of the projector is a pair of liquid-crystal modulators — which are like tiny liquid-crystal displays (LCDs) — positioned between the light source and the lens. Patterns of light and dark on the first modulator effectively turn it into a bank of slightly angled light emitters — that is, light passing through it reaches the second modulator only at particular angles. The combinations of the patterns displayed by the two modulators thus ensure that the viewer will see slightly different images from different angles.

The researchers also built a prototype of a new type of screen that widens the angle from which their projector's images can be viewed. The screen combines two lenticular lenses — the type of striated transparent sheets used to create crude 3-D effects in, say, old children's books.

Exploiting redundancy

For every frame of video, each modulator displays six different patterns, which together produce eight different viewing angles: At high enough display rates, the human visual system will automatically combine information from different images. The modulators can refresh their patterns at 240 hertz, or 240 times a second, so even at six patterns per frame, the system could play video at a rate of 40 hertz, which, while below the refresh rate common in today's TVs, is still higher than the 24 frames per second standard in film.

With the technology that has historically been used to produce glasses-free 3-D images — known as a parallax barrier — simultaneously projecting eight different viewing angles would mean allotting each angle one-eighth of the light emitted by the projector, which would make for a dim movie. But like the researchers' prototype monitors, the projector takes advantage of the fact that, as you move around an object, most of the visual change takes place at the edges. If, for instance, you were looking at a blue mailbox as you walked past it, from one step to the next, much of your visual field would be taken up by a blue of approximately the same shade, even though different objects were coming into view behind it.

Algorithmically, the key to the researchers' system is a technique for calculating how much information can be preserved between viewing angles and how much needs to be varied. Preserving as much information as possible enables the projector to produce a brighter image. The resulting set of light angles and intensities then has to be encoded into the patterns displayed by the modulators. That's a tall computational order, but by tailoring their algorithm to the architecture of the graphics processing units designed for video games, the MIT researchers have gotten it to run almost in real time. Their system can receive data in the form of eight images per frame of video and translate it into modulator patterns with very little lag.

Bridge technology

Passing light through two modulators can also heighten the contrast of ordinary 2-D video. One of the problems with LCD screens is that they don't enable "true black": A little light always leaks through even the darkest regions of the display. "Normally you have contrast of, let's say, values between 0 and 1," Wetzstein explains. "That's the full contrast, but in practice, all modulators have something like 0.1 to 1. So you get this 'black level.' But if you multiply two optically together, the black level goes down to 0.01. If you show black on one, which is 10 percent, and black on the other, which is also 10 percent, what you get through is 1 percent. So it's much more black."

By the same token, Hirsch explains, if the patterns displayed on the modulators are slightly offset from each other, the light passing through them will interfere with itself in ways that actually heighten the resolution of the resulting images. Again, the researchers have developed an algorithm that can calculate those patterns on the fly.

As content creators move to so-called "quad HD," video with four times the resolution of today's high-definition video, the combination of higher contrast and higher resolution could make a commercial version of the researchers' technology appealing to theater owners, which in turn could smooth the way for the adoption of multiperspective 3-D. "One thing you could do — and this is what actual projector manufacturers have done in the recent past — is take four 1080p modulators and put them next to each other and build some very complicated optics to tile them all seamlessly and then get a much nicer lens because you have to project a much smaller spot and bundle that all up together," Hirsch says. "We're saying you could take two 1080p modulators, stick them in your projector one after the other, then take your same old 1080p lens and project through it and use this software algorithm, and you end up with a 4k image. But not only that, it's got even higher contrast."


Written by Larry Hardesty, MIT News Office

Additional background

ARCHIVE: Glasses-free 3-D TV looks nearer

ARCHIVE: Better glasses-free 3-D

ARCHIVE: In Profile: Ramesh Raskar

Abby Abazorius | Eurek Alert!
Further information:

Further reports about: Camera MIT Technology algorithm explains hertz images produce

More articles from Medical Engineering:

nachricht New microscopy technology augments surgeon's view for greater accuracy
07.10.2015 | SPIE--International Society for Optics and Photonics

nachricht Infrared thermography can detect joint inflammation and help improving work ergonomics
02.10.2015 | University of Eastern Finland

All articles from Medical Engineering >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Kick-off for a new era of precision astronomy

The MICADO camera, a first light instrument for the European Extremely Large Telescope (E-ELT), has entered a new phase in the project: by agreeing to a Memorandum of Understanding, the partners in Germany, France, the Netherlands, Austria, and Italy, have all confirmed their participation. Following this milestone, the project's transition into its preliminary design phase was approved at a kick-off meeting held in Vienna. Two weeks earlier, on September 18, the consortium and the European Southern Observatory (ESO), which is building the telescope, have signed the corresponding collaboration agreement.

As the first dedicated camera for the E-ELT, MICADO will equip the giant telescope with a capability for diffraction-limited imaging at near-infrared...

Im Focus: Locusts at the wheel: University of Graz investigates collision detector inspired by insect eyes

Self-driving cars will be on our streets in the foreseeable future. In Graz, research is currently dedicated to an innovative driver assistance system that takes over control if there is a danger of collision. It was nature that inspired Dr Manfred Hartbauer from the Institute of Zoology at the University of Graz: in dangerous traffic situations, migratory locusts react around ten times faster than humans. Working together with an interdisciplinary team, Hartbauer is investigating an affordable collision detector that is equipped with artificial locust eyes and can recognise potential crashes in time, during both day and night.

Inspired by insects

Im Focus: Physicists shrink particle accelerator

Prototype demonstrates feasibility of building terahertz accelerators

An interdisciplinary team of researchers has built the first prototype of a miniature particle accelerator that uses terahertz radiation instead of radio...

Im Focus: Simple detection of magnetic skyrmions

New physical effect: researchers discover a change of electrical resistance in magnetic whirls

At present, tiny magnetic whirls – so called skyrmions – are discussed as promising candidates for bits in future robust and compact data storage devices. At...

Im Focus: High-speed march through a layer of graphene

In cooperation with the Center for Nano-Optics of Georgia State University in Atlanta (USA), scientists of the Laboratory for Attosecond Physics of the Max Planck Institute of Quantum Optics and the Ludwig-Maximilians-Universität have made simulations of the processes that happen when a layer of carbon atoms is irradiated with strong laser light.

Electrons hit by strong laser pulses change their location on ultrashort timescales, i.e. within a couple of attoseconds (1 as = 10 to the minus 18 sec). In...

All Focus news of the innovation-report >>>



Event News

EHFG 2015: Securing healthcare and sustainably strengthening healthcare systems

01.10.2015 | Event News

Conference in Brussels: Tracking and Tracing the Smallest Marine Life Forms

30.09.2015 | Event News

World Alzheimer`s Day – Professor Willnow: Clearer Insights into the Development of the Disease

17.09.2015 | Event News

Latest News

New microscopy technology augments surgeon's view for greater accuracy

07.10.2015 | Medical Engineering

Discovery about new battery overturns decades of false assumptions

07.10.2015 | Power and Electrical Engineering

Ancient rocks record first evidence for photosynthesis that made oxygen

07.10.2015 | Earth Sciences

More VideoLinks >>>