Information processing: Adding a touch of color
An innovative computer program brings color to grayscale images
Creating a high-quality realistic color image from a grayscale picture can be challenging. Conventional methods typically require the user’s input, either by using a scribbling tool to color the image manually or by using a color transfer. Both options can result in poor colorization quality limited by the user’s degree of skill or the range of reference images available.
Alex Yong-Sang Chia at the A*STAR’s Institute for Infocomm Research and co-workers1 have now developed a computer program that utilizes the vast amount of imagery available on the internet to find suitable color matches for grayscale images. The program searches hundreds of thousands of online color images, cross-referencing their key features and objects in the foreground with those of grayscale pictures.
“We have developed a method that takes advantage of the plentiful supply of internet data to colorize gray photos,” Chia explains. “The user segments the image into separate major foreground objects and adds semantic labels naming these objects in the gray photo. Our program then scans the internet using these inputs for suitable object color matches.”
Given the vast amount of visual data available online, not all of the chosen images are useful. Once the initial color images have been found, the program then filters them to find the most realistic and suitable matches for the grayscale object inputs.
“Our method automatically detects and segments salient objects from an internet photo,” explains Chia. “It then exploits shape and appearance information of these objects to compute its relevance to the original grayscale image data.”
The grayscale image is then automatically colored using the information collected from internet-based images (pictured). Plausible colorization of images is vitally important, however, as the human eye can quickly distinguish between real and ‘false’ coloring. To this end, the user has the final say over the choice of colors. “The program generates several image colorizations and the user can pick the one that fits best from a graphical user interface,” explains Chia.
To demonstrate the capability of the program, Chia and his team showed a group of people their colored grayscale images alongside real color pictures, asking them to identify which ones had been colored artificially. “Our colored images were classed as ‘real’ up to 65% of the time,” says Chia. “Overall the colorization results are visually pleasing and perceptually meaningful to users.”
The researchers hope to expand the range of applications using this technology in the future. They envision that the technology may one day become so powerful that it could be used to generate realistic animations.
The A*STAR-affiliated researchers contributing to this research are from the Institute for Infocomm Research
Chia, A. Y. S. et al. Semantic colorization with internet images. ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2011 30, 156 (2012).
A*STAR Research | Research asia research news
The most recent press releases about innovation >>>
Die letzten 5 Focus-News des innovations-reports im Überblick:
Innsbruck quantum physicists have constructed a diode for magnetic fields and then tested it in the laboratory. The device, developed by the research groups led by the theorist Oriol Romero-Isart and the experimental physicist Gerhard Kirchmair, could open up a number of new applications.
Electric diodes are essential electronic components that conduct electricity in one direction but prevent conduction in the opposite one. They are found at the...
Max Planck researchers revel the nano-structure of molecular trains and the reason for smooth transport in cellular antennas.
Moving around, sensing the extracellular environment, and signaling to other cells are important for a cell to function properly. Responsible for those tasks...
Researchers at the University of New Hampshire have captured a difficult-to-view singular event involving "magnetic reconnection"--the process by which sparse particles and energy around Earth collide producing a quick but mighty explosion--in the Earth's magnetotail, the magnetic environment that trails behind the planet.
Magnetic reconnection has remained a bit of a mystery to scientists. They know it exists and have documented the effects that the energy explosions can...
Biochips have been developed at TU Wien (Vienna), on which tissue can be produced and examined. This allows supplying the tissue with different substances in a very controlled way.
Cultivating human cells in the Petri dish is not a big challenge today. Producing artificial tissue, however, permeated by fine blood vessels, is a much more...
Faster and secure data communication: This is the goal of a new joint project involving physicists from the University of Würzburg. The German Federal Ministry of Education and Research funds the project with 14.8 million euro.
In our digital world data security and secure communication are becoming more and more important. Quantum communication is a promising approach to achieve...