Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:


What if all software was open source? A code to unlock the desktop

What if all software was open source? Anybody would then be able to add custom features to Microsoft Word, Adobe Photoshop, Apple iTunes or any other program. A University of Washington project may make this possible.

"Microsoft and Apple aren't going to open up all their stuff. But they all create programs that put pixels on the screen. And if we can modify those pixels, then we can change the program's apparent behavior," said James Fogarty, a UW assistant professor of computer science and engineering.

His approach hijacks the display to customize the user's interaction with the program. He will demonstrate his system April 14 in Atlanta at the Association for Computing Machinery's Conference on Human Factors in Computing Systems.

"We really see this as a first step toward a scenario where anybody can modify any application," Fogarty said. "In a sense, this has happened online. You've got this mash-up culture on the Web because everybody can see the HTML. But that hasn't been possible on the desktop."

These days a Web page might include a map from Google, an embedded video from YouTube and a list of recent headlines. This is not yet possible on the personal computer.

"Let's say I'm writing a paper in Microsoft Word but I want to listen to music at the same time," explained co-author Morgan Dixon, a UW doctoral student in computer science and engineering.

Right now he would have to click back and for the between Word and iTunes, but the system he helped create can simply add a few iTunes buttons to the Word toolbar.

"I'm using some program that I love," Dixon said, "and I'm going to stick in some features from some other program that I love, so I have a more unified interface."

More importantly, having more control over widely used programs would allow people to benefit from accessibility tools that have been gathering dust in academic research labs.

One example is target-aware pointing, which can make many interfaces easier for people with muscular dystrophy, Parkinson's disease, cerebral palsy or other motor-control disabilities. On such tool, the bubble cursor, highlights the button closest to it, making it easier for people with disabilities to click a button without having to hit it dead on. Fogarty and Dixon show the first implementation of a bubble cursor in various commercial applications.

"The human-computer interaction community has done 30 years of research on how to make computers more accessible to people with disabilities. But no one change is perfect for everybody," Fogarty said. "That's why you don't see these tools out there."

His research allows people to personalize programs based on their needs.

The UW tool, named Prefab, takes advantage of the fact that almost all displays are made from prefabricated blocks of code such as buttons, sliders, check boxes and drop-down menus. Prefab looks for those blocks as many as 20 times per second and alters their behavior.

The researchers are continuing to develop Prefab and are exploring options for commercialization.

Prefab unlocks previously inaccessible interfaces, allowing people to add the same usability tool to all the applications they run on their desktop. The system could translate a program's interface into a different language, or reorder menus to bump up favorite commands.

The authors hope Prefab will spur development of new innovations.

"If you come up with a new technology, too often it's evaluated in a test environment," Fogarty said. "This lets researchers put it into practice in something real, like Photoshop or iTunes."

Prefab can also produce more advanced effects. One demonstration that will be presented at the conference creates multiple previews of a single image in Photoshop. Behind the scenes, Prefab moves the sliders to different points, captures the output and then displays all of them on a single screen. This could save time by showing a range of effects the user frequently adjusts.

The system could also allow programs to move from computer screens to mobile devices, which do not have a standard operating system.

"It dramatically lowers the threshold to getting new innovation into existing, complex programs," Fogarty said.

Research has been funded by the Hacherl Endowed Graduate Fellowship in the UW Department of Computer Science & Engineering, a fellowship from the Seattle chapter of the Achievement Rewards for College Scientists, and Intel.

For more information, contact Fogarty at 206-685-8081 or

More information about Prefab is at

Hannah Hickey | EurekAlert!
Further information:

More articles from Information Technology:

nachricht Fraunhofer FIT joins Facebook's Telecom Infra Project
25.10.2016 | Fraunhofer-Institut für Angewandte Informationstechnik FIT

nachricht Stanford researchers create new special-purpose computer that may someday save us billions
21.10.2016 | Stanford University

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Etching Microstructures with Lasers

Ultrafast lasers have introduced new possibilities in engraving ultrafine structures, and scientists are now also investigating how to use them to etch microstructures into thin glass. There are possible applications in analytics (lab on a chip) and especially in electronics and the consumer sector, where great interest has been shown.

This new method was born of a surprising phenomenon: irradiating glass in a particular way with an ultrafast laser has the effect of making the glass up to a...

Im Focus: Light-driven atomic rotations excite magnetic waves

Terahertz excitation of selected crystal vibrations leads to an effective magnetic field that drives coherent spin motion

Controlling functional properties by light is one of the grand goals in modern condensed matter physics and materials science. A new study now demonstrates how...

Im Focus: New 3-D wiring technique brings scalable quantum computers closer to reality

Researchers from the Institute for Quantum Computing (IQC) at the University of Waterloo led the development of a new extensible wiring technique capable of controlling superconducting quantum bits, representing a significant step towards to the realization of a scalable quantum computer.

"The quantum socket is a wiring method that uses three-dimensional wires based on spring-loaded pins to address individual qubits," said Jeremy Béjanin, a PhD...

Im Focus: Scientists develop a semiconductor nanocomposite material that moves in response to light

In a paper in Scientific Reports, a research team at Worcester Polytechnic Institute describes a novel light-activated phenomenon that could become the basis for applications as diverse as microscopic robotic grippers and more efficient solar cells.

A research team at Worcester Polytechnic Institute (WPI) has developed a revolutionary, light-activated semiconductor nanocomposite material that can be used...

Im Focus: Diamonds aren't forever: Sandia, Harvard team create first quantum computer bridge

By forcefully embedding two silicon atoms in a diamond matrix, Sandia researchers have demonstrated for the first time on a single chip all the components needed to create a quantum bridge to link quantum computers together.

"People have already built small quantum computers," says Sandia researcher Ryan Camacho. "Maybe the first useful one won't be a single giant quantum computer...

All Focus news of the innovation-report >>>



Event News

#IC2S2: When Social Science meets Computer Science - GESIS will host the IC2S2 conference 2017

14.10.2016 | Event News

Agricultural Trade Developments and Potentials in Central Asia and the South Caucasus

14.10.2016 | Event News

World Health Summit – Day Three: A Call to Action

12.10.2016 | Event News

Latest News

How nanoscience will improve our health and lives in the coming years

27.10.2016 | Materials Sciences

OU-led team discovers rare, newborn tri-star system using ALMA

27.10.2016 | Physics and Astronomy

'Neighbor maps' reveal the genome's 3-D shape

27.10.2016 | Life Sciences

More VideoLinks >>>